Sep 11 16:43:09.314167 ip-10-0-141-153 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 16:43:09.765183 ip-10-0-141-153 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:43:09.765183 ip-10-0-141-153 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 16:43:09.765183 ip-10-0-141-153 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:43:09.765183 ip-10-0-141-153 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 16:43:09.765183 ip-10-0-141-153 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 16:43:09.766035 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.765259    2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 16:43:09.769570 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769547    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:43:09.769570 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769567    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:43:09.769570 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769572    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:43:09.769570 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769576    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769580    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769584    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769588    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769591    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769595    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769598    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769602    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769605    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769612    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769617    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769622    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769626    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769630    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769634    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769638    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769642    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769647    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769651    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:43:09.769852 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769654    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769660    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769665    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769669    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769673    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769678    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769682    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769686    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769690    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769694    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769699    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769703    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769708    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769714    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769718    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769723    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769729    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769733    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769737    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:43:09.770614 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769741    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769745    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769750    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769754    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769758    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769762    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769767    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769771    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769776    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769779    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769783    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769787    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769791    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769813    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769817    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769822    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769825    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769829    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769833    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769837    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:43:09.771423 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769841    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769845    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769849    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769854    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769857    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769863    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769868    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769873    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769878    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769882    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769887    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769891    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769895    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769899    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769903    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769908    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769912    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769916    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769921    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769930    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:43:09.772311 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769936    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769940    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769945    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769949    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769953    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769958    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769962    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769966    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769970    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769974    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769979    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769983    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769987    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769991    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.769995    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.770000    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.770004    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.770008    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771167    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771177    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:43:09.773197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771183    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771187    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771192    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771196    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771201    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771205    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771209    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771213    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771216    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771220    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771225    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771230    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771234    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771238    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771242    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771247    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771251    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771255    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771260    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771264    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:43:09.774101 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771269    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771273    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771277    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771282    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771286    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771290    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771295    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771299    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771302    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771307    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771311    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771315    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771319    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771323    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771328    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771332    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771336    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771339    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771343    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771347    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:43:09.774735 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771351    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771355    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771359    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771363    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771368    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771372    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771376    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771380    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771384    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771391    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771395    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771400    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771403    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771408    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771412    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771416    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771420    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771424    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771429    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771436    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:43:09.775373 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771443    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771447    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771451    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771455    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771460    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771464    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771468    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771473    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771477    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771481    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771484    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771488    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771492    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771497    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771501    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771505    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771509    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771515    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771519    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:43:09.775902 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771525    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771532    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771542    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771551    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771556    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771561    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771565    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771570    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771574    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771579    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771584    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771589    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771594    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771598    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771603    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771608    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771612    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.771617    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772258    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:43:09.776365 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772267    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772272    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772276    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772281    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772285    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772290    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772294    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772298    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772302    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772307    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772313    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772320    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772324    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772328    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772332    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772339    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772344    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772348    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772352    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772357    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:43:09.776838 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772361    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772366    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772370    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772374    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772378    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772383    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772387    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772392    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772396    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772400    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772405    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772411    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772415    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772419    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772423    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772427    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772433    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772437    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772441    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772446    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:43:09.777332 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772450    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772454    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772458    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772462    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772470    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772476    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772480    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772486    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772491    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772495    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772499    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772503    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772507    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772511    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772515    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772519    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772523    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772527    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772532    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:43:09.777847 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772536    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772540    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772544    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772548    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772552    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772556    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772560    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772564    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772568    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772574    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772578    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772584    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772588    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772592    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772595    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772600    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772603    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772608    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772612    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772616    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:43:09.778307 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772622    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772626    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772630    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772634    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772638    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772642    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772646    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772650    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772654    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772658    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772663    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772668    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772672    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772676    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772680    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772684    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772688    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772692    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.772696    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:43:09.778823 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772831    2569 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772885    2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772899    2569 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772906    2569 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772913    2569 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772917    2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772924    2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772931    2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772936    2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772941    2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772946    2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772951    2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772957    2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772964    2569 flags.go:64] FLAG: --cgroup-root=""
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772968    2569 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772973    2569 flags.go:64] FLAG: --client-ca-file=""
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772977    2569 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772982    2569 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772989    2569 flags.go:64] FLAG: --cluster-domain=""
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772993    2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.772998    2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773003    2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773008    2569 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773014    2569 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 16:43:09.779276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773019    2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773024    2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773030    2569 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773035    2569 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773039    2569 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773044    2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773049    2569 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773062    2569 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773069    2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773074    2569 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773081    2569 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773086    2569 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773091    2569 flags.go:64] FLAG: --enable-server="true"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773095    2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773103    2569 flags.go:64] FLAG: --event-burst="100"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773108    2569 flags.go:64] FLAG: --event-qps="50"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773113    2569 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773118    2569 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773123    2569 flags.go:64] FLAG: --eviction-hard=""
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773129    2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773134    2569 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773142    2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773146    2569 flags.go:64] FLAG: --eviction-soft=""
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773151    2569 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773156    2569 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 16:43:09.779873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773160    2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773165    2569 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773169    2569 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773174    2569 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773179    2569 flags.go:64] FLAG: --feature-gates=""
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773185    2569 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773190    2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773194    2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773199    2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773204    2569 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773208    2569 flags.go:64] FLAG: --help="false"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773213    2569 flags.go:64] FLAG: --hostname-override="ip-10-0-141-153.ec2.internal"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773217    2569 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773222    2569 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773226    2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773232    2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773238    2569 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773242    2569 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773247    2569 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773251    2569 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773256    2569 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773260    2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773265    2569 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773270    2569 flags.go:64] FLAG: --kube-reserved=""
Sep 11 16:43:09.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773275    2569 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773280    2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773285    2569 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773290    2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773296    2569 flags.go:64] FLAG: --lock-file=""
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773301    2569 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773306    2569 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773311    2569 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773320    2569 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773325    2569 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773330    2569 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773334    2569 flags.go:64] FLAG: --logging-format="text"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773339    2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773344    2569 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773348    2569 flags.go:64] FLAG: --manifest-url=""
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773353    2569 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773360    2569 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773365    2569 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773371    2569 flags.go:64] FLAG: --max-pods="110"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773376    2569 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773381    2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773385    2569 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773390    2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773394    2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773399    2569 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 16:43:09.781161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773405    2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773416    2569 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773422    2569 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773427    2569 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773432    2569 flags.go:64] FLAG: --pod-cidr=""
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773436    2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773445    2569 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773449    2569 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773454    2569 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773459    2569 flags.go:64] FLAG: --port="10250"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773464    2569 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773469    2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0514ac5654ee68fba"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773475    2569 flags.go:64] FLAG: --qos-reserved=""
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773481    2569 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773486    2569 flags.go:64] FLAG: --register-node="true"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773490    2569 flags.go:64] FLAG: --register-with-taints=""
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773496    2569 flags.go:64] FLAG: --registry-burst="10"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773501    2569 flags.go:64] FLAG: --registry-qps="5"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773505    2569 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773510    2569 flags.go:64] FLAG: --reserved-memory=""
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773515    2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773520    2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773525    2569 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773530    2569 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773534    2569 flags.go:64] FLAG: --runonce="false"
Sep 11 16:43:09.781818 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773539    2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773544    2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773549    2569 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773553    2569 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773558    2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773562    2569 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773567    2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773572    2569 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773577    2569 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773581    2569 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773586    2569 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773591    2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773595    2569 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773600    2569 flags.go:64] FLAG: --system-cgroups=""
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773605    2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773614    2569 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773618    2569 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773623    2569 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773634    2569 flags.go:64] FLAG: --tls-min-version=""
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773640    2569 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773646    2569 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773652    2569 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773657    2569 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773662    2569 flags.go:64] FLAG: --v="2"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773669    2569 flags.go:64] FLAG: --version="false"
Sep 11 16:43:09.782439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773675    2569 flags.go:64] FLAG: --vmodule=""
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773681    2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.773686    2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773904    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773913    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773917    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773922    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773929    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773935    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773940    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773945    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773950    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773954    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773958    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773963    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773966    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773971    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773975    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773979    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773982    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:43:09.783062 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773987    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773991    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.773995    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774000    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774004    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774008    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774014    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774018    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774022    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774027    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774031    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774036    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774040    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774044    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774051    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774057    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774061    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774066    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774072    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774076    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:43:09.783549 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774080    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774085    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774089    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774093    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774097    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774100    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774106    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774111    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774116    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774120    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774124    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774128    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774133    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774137    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774141    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774145    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774150    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774154    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774159    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:43:09.784073 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774163    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774168    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774172    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774177    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774181    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774185    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774189    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774193    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774197    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774201    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774205    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774211    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774215    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774219    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774223    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774227    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774231    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774235    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774239    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774244    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:43:09.784537 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774248    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774252    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774256    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774260    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774264    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774268    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774272    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774276    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774280    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774284    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774287    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774291    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774296    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774300    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774304    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774308    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774313    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774317    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774321    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:43:09.785063 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774326    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774329    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774333    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.774337    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.775192    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.783516    2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.783531    2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.783547    2569 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.783556    2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783638    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783643    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783647    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783650    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783652    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783655    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:43:09.785516 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783658    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783662    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783665    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783667    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783670    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783673    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783675    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783677    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783680    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783683    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783687    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783691    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783694    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783697    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783700    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783709    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783711    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783714    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783716    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783719    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:43:09.785919 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783722    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783724    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783727    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783730    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783733    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783735    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783738    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783740    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783743    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783745    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783748    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783750    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783753    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783755    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783758    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783760    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783763    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783765    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783768    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:43:09.786407 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783770    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783772    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783775    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783778    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783780    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783782    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783785    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783788    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783790    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783816    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783820    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783822    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783825    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783828    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783830    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783833    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783836    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783839    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783842    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783844    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:43:09.786899 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783847    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783850    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783852    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783855    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783858    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783860    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783863    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783865    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783868    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783870    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783873    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783875    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783878    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783880    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783883    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783885    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783888    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783890    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783892    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783895    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:43:09.787447 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783897    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783901    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783910    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783913    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783916    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783919    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783921    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783930    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783933    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783936    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783940    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783944    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783947    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.783951    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:43:09.787983 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.783956    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784110    2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784115    2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784118    2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784121    2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784124    2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784127    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784129    2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784132    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784135    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784137    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784140    2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784142    2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784145    2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784147    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784150    2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784152    2569 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784156    2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784158    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 16:43:09.788450 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784164    2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784167    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784175    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784177    2569 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784180    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784182    2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784185    2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784188    2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784191    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784193    2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784196    2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784198    2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784201    2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784203    2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784206    2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784208    2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784211    2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784213    2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784216    2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784219    2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 16:43:09.788982 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784223    2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784226    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784228    2569 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784231    2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784234    2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784237    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784240    2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784242    2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784245    2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784247    2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784250    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784252    2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784255    2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784257    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784260    2569 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784268    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784270    2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784272    2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784275    2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784277    2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 16:43:09.789575 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784280    2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784282    2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784285    2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784288    2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784290    2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784294    2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784297    2569 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784300    2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784302    2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784305    2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784307    2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784310    2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784312    2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784314    2569 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784317    2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784319    2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784321    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784324    2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784326    2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784329    2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 16:43:09.790161 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784331    2569 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784334    2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784336    2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784339    2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784341    2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784344    2569 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784346    2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784348    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784357    2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784359    2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784362    2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784365    2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784369    2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784372    2569 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784375    2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784377    2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784380    2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784382    2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784384    2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 16:43:09.790679 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784387    2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 16:43:09.791188 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:09.784389    2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 16:43:09.791188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.784394    2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 16:43:09.791188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.784522    2569 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 16:43:09.791188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.786905    2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 16:43:09.791188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.788002    2569 server.go:1019] "Starting client certificate rotation"
Sep 11 16:43:09.791188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.788109    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:43:09.791188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.788162    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 16:43:09.791188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.790819    2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:43:09.795925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.795774    2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 16:43:09.809138 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.809120    2569 log.go:25] "Validated CRI v1 runtime API"
Sep 11 16:43:09.813509 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.813494    2569 log.go:25] "Validated CRI v1 image API"
Sep 11 16:43:09.814336 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.814323    2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 16:43:09.818857 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.818825    2569 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 87523712-6052-44fe-8fe2-dafed4df1ea5:/dev/nvme0n1p3 ef4da968-4e65-4842-994e-532688621b3e:/dev/nvme0n1p4]
Sep 11 16:43:09.818931 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.818857    2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 16:43:09.824268 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.824152    2569 manager.go:216] Machine: {Timestamp:2026-09-11 16:43:09.822527548 +0000 UTC m=+0.381918926 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100452 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e3ce839b13a6f3c44826c40861ec2 SystemUUID:ec2e3ce8-39b1-3a6f-3c44-826c40861ec2 BootID:d16c6886-1e92-4f59-8366-4247de2dd2ea Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:05:bb:c1:f7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:05:bb:c1:f7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:ac:bc:96:34:d1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 16:43:09.824268 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.824261    2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 16:43:09.824435 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.824373    2569 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 16:43:09.826147 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.826119    2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 16:43:09.826322 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.826150    2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 16:43:09.827769 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.827756    2569 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 16:43:09.827841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.827774    2569 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 16:43:09.827841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.827786    2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:43:09.827841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.827825    2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 16:43:09.828842 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.828825    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:43:09.829119 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.829106    2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 16:43:09.833764 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.833749    2569 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:43:09.833917 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.833905    2569 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 16:43:09.833974 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.833946    2569 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 16:43:09.833974 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.833961    2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 16:43:09.834069 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.833986    2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 16:43:09.834069 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.834000    2569 kubelet.go:398] "Adding apiserver pod source"
Sep 11 16:43:09.834069 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.834022    2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 16:43:09.834832 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.834817    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:43:09.834896 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.834845    2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 16:43:09.840771 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.840755    2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 16:43:09.844578 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.844543    2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 16:43:09.844686 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.844600    2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 16:43:09.845407 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:09.845371    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 16:43:09.845552 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:09.845533    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 16:43:09.846871 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846854    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 16:43:09.846932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846875    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 16:43:09.846932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846882    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 16:43:09.846932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846887    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 16:43:09.846932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846895    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 16:43:09.846932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846900    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 16:43:09.846932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846913    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 16:43:09.846932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846918    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 16:43:09.846932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846924    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 16:43:09.846932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846930    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 16:43:09.847171 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846938    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 16:43:09.847171 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.846943    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 16:43:09.847658 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.847648    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 16:43:09.847658 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.847657    2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 16:43:09.850858 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.850841    2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 16:43:09.851418 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.851390    2569 server.go:1268] "Started kubelet"
Sep 11 16:43:09.851521 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.851499    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6k2pq"
Sep 11 16:43:09.851521 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.851477    2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 16:43:09.851600 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.851546    2569 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 16:43:09.851600 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.851538    2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 16:43:09.852524 ip-10-0-141-153 systemd[1]: Started Kubernetes Kubelet.
Sep 11 16:43:09.852839 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.852647    2569 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 16:43:09.853331 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.853267    2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 16:43:09.857147 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:09.857128    2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 16:43:09.860511 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.860492    2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 16:43:09.860511 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.860498    2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 16:43:09.860666 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:09.860617    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:09.861503 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.861304    2569 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 16:43:09.861597 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.861508    2569 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 16:43:09.861597 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.861388    2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 16:43:09.861703 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.861625    2569 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 16:43:09.861703 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.861632    2569 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 16:43:09.862259 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.862241    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6k2pq"
Sep 11 16:43:09.864874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.864790    2569 factory.go:55] Registering systemd factory
Sep 11 16:43:09.864874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.864825    2569 factory.go:223] Registration of the systemd container factory successfully
Sep 11 16:43:09.865120 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.865106    2569 factory.go:153] Registering CRI-O factory
Sep 11 16:43:09.865120 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.865122    2569 factory.go:223] Registration of the crio container factory successfully
Sep 11 16:43:09.865407 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.865171    2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 16:43:09.865407 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.865192    2569 factory.go:103] Registering Raw factory
Sep 11 16:43:09.865407 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.865208    2569 manager.go:1196] Started watching for new ooms in manager
Sep 11 16:43:09.865588 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.865575    2569 manager.go:349] Starting recovery of all containers
Sep 11 16:43:09.872551 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.872526    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:43:09.875925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.875904    2569 manager.go:354] Recovery completed
Sep 11 16:43:09.877280 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:09.877255    2569 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-153.ec2.internal\" not found" node="ip-10-0-141-153.ec2.internal"
Sep 11 16:43:09.881872 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.881857    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:43:09.883685 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.883670    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:43:09.883739 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.883701    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:43:09.883739 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.883713    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:43:09.884327 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.884313    2569 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 16:43:09.884327 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.884324    2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 16:43:09.884435 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.884342    2569 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 16:43:09.884435 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.884316    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:43:09.885153 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.885140    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:43:09.885209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.885166    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:43:09.885209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.885176    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:43:09.886402 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.886387    2569 policy_none.go:49] "None policy: Start"
Sep 11 16:43:09.886439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.886411    2569 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 16:43:09.886439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.886425    2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 16:43:09.888495 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.888482    2569 policy_none.go:47] "Start"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.919279    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.920474    2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.920518    2569 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.920540    2569 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:09.920574    2569 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.923076    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.927392    2569 manager.go:337] "Starting Device Plugin manager"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:09.927423    2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.927432    2569 server.go:87] "Starting device plugin registration server"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.927813    2569 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.927831    2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.927928    2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.928002    2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:09.928011    2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:09.928454    2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 16:43:09.930746 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:09.928504    2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.020914 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.020785    2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal"]
Sep 11 16:43:10.020914 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.020890    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:43:10.022756 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.022740    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:43:10.022855 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.022768    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:43:10.022855 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.022779    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:43:10.025112 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.025100    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:43:10.025237 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.025222    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.025284 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.025264    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:43:10.025841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.025824    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:43:10.025912 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.025855    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:43:10.025912 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.025865    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:43:10.025912 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.025826    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:43:10.026030 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.025922    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:43:10.026030 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.025934    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:43:10.028111 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028099    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:43:10.028152 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028137    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.028194 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028157    2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 16:43:10.028778 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028761    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:43:10.028881 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028784    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:43:10.028881 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028811    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:43:10.028881 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028853    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 16:43:10.028881 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028875    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 16:43:10.029033 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028891    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeHasSufficientPID"
Sep 11 16:43:10.029033 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.028916    2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.036499 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.036487    2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.036566 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.036505    2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-153.ec2.internal\": node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.058416 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.058398    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-153.ec2.internal\" not found" node="ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.062757 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.062743    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1032e07a96b02bfcfeb61cb48d83063d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-153.ec2.internal\" (UID: \"1032e07a96b02bfcfeb61cb48d83063d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.062853 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.062766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41ebf87d480f7c21731bfa60407081d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal\" (UID: \"41ebf87d480f7c21731bfa60407081d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.062853 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.062781    2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-153.ec2.internal\" not found" node="ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.062853 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.062784    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41ebf87d480f7c21731bfa60407081d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal\" (UID: \"41ebf87d480f7c21731bfa60407081d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.067981 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.067966    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.163848 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.163816    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41ebf87d480f7c21731bfa60407081d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal\" (UID: \"41ebf87d480f7c21731bfa60407081d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.163848 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.163851    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41ebf87d480f7c21731bfa60407081d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal\" (UID: \"41ebf87d480f7c21731bfa60407081d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.164049 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.163868    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1032e07a96b02bfcfeb61cb48d83063d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-153.ec2.internal\" (UID: \"1032e07a96b02bfcfeb61cb48d83063d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.164049 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.163900    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/41ebf87d480f7c21731bfa60407081d6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal\" (UID: \"41ebf87d480f7c21731bfa60407081d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.164049 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.163943    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1032e07a96b02bfcfeb61cb48d83063d-config\") pod \"kube-apiserver-proxy-ip-10-0-141-153.ec2.internal\" (UID: \"1032e07a96b02bfcfeb61cb48d83063d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.164049 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.163956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41ebf87d480f7c21731bfa60407081d6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal\" (UID: \"41ebf87d480f7c21731bfa60407081d6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.168916 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.168901    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.269018 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.268985    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.362562 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.362497    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.366409 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.366377    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.369854 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.369837    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.470333 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.470305    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.570872 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.570849    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.671478 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.671409    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.771931 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.771904    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.788085 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.788056    2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 16:43:10.788211 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.788197    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 16:43:10.788276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.788227    2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 16:43:10.868535 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.868476    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 16:38:10 +0000 UTC" deadline="2028-03-19 03:28:15.783979095 +0000 UTC"
Sep 11 16:43:10.868535 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.868531    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13306h45m4.915452598s"
Sep 11 16:43:10.868535 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.868535    2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:43:10.872844 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:10.872814    2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-153.ec2.internal\" not found"
Sep 11 16:43:10.886652 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:10.886556    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1032e07a96b02bfcfeb61cb48d83063d.slice/crio-3a56f3ac63183f373231f683d5f94aca8998dba678d608569e7c2695c35121c2 WatchSource:0}: Error finding container 3a56f3ac63183f373231f683d5f94aca8998dba678d608569e7c2695c35121c2: Status 404 returned error can't find the container with id 3a56f3ac63183f373231f683d5f94aca8998dba678d608569e7c2695c35121c2
Sep 11 16:43:10.887645 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:10.887350    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ebf87d480f7c21731bfa60407081d6.slice/crio-8e37bc497b012c6e4bc121704c0f36a11909d7be5e66596b8cd4131a8bf3b29d WatchSource:0}: Error finding container 8e37bc497b012c6e4bc121704c0f36a11909d7be5e66596b8cd4131a8bf3b29d: Status 404 returned error can't find the container with id 8e37bc497b012c6e4bc121704c0f36a11909d7be5e66596b8cd4131a8bf3b29d
Sep 11 16:43:10.891860 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.891844    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:43:10.924280 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.924212    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal" event={"ID":"1032e07a96b02bfcfeb61cb48d83063d","Type":"ContainerStarted","Data":"3a56f3ac63183f373231f683d5f94aca8998dba678d608569e7c2695c35121c2"}
Sep 11 16:43:10.926016 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.925997    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal" event={"ID":"41ebf87d480f7c21731bfa60407081d6","Type":"ContainerStarted","Data":"8e37bc497b012c6e4bc121704c0f36a11909d7be5e66596b8cd4131a8bf3b29d"}
Sep 11 16:43:10.940037 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.940011    2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:43:10.961178 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.961162    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.974020 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.973994    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:43:10.976155 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.976140    2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal"
Sep 11 16:43:10.983878 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:10.983861    2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 16:43:11.834943 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.834917    2569 apiserver.go:52] "Watching apiserver"
Sep 11 16:43:11.841406 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.841380    2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:43:11.842810 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.842776    2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 16:43:11.844966 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.844925    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z","openshift-image-registry/node-ca-dqgwp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-5tfmw","kube-system/global-pull-secret-syncer-xxksk","openshift-cluster-node-tuning-operator/tuned-48qml","openshift-dns/node-resolver-vztfz","openshift-multus/multus-additional-cni-plugins-mtvm7","openshift-multus/multus-f75n6","openshift-multus/network-metrics-daemon-xgtkk","openshift-network-diagnostics/network-check-target-5cdgz","openshift-network-operator/iptables-alerter-2njqb","kube-system/konnectivity-agent-v64tp"]
Sep 11 16:43:11.847760 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.847736    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.850161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.850140    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:11.852467 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.852430    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:11.854781 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.854751    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:11.857247 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.857228    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.857983 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.857788    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 16:43:11.859855 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.859799    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:11.859951 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:11.859917    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:11.861363 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.861344    2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 16:43:11.862469 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.862441    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.863473 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.863453    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 16:43:11.863586 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.863536    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 16:43:11.863808 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.863764    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 16:43:11.864433 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.864298    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 16:43:11.864433 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.864317    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 16:43:11.864548 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.864300    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 16:43:11.864548 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.864499    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 16:43:11.864548 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.864536    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 16:43:11.864714 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.864654    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:43:11.864771 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.864741    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 16:43:11.865140 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.865119    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.865622 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.865603    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 16:43:11.865716 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.865667    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kwmz6\""
Sep 11 16:43:11.865776 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.865723    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 16:43:11.865776 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.865735    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 16:43:11.865776 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.865759    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kcjgg\""
Sep 11 16:43:11.866012 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.865844    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 16:43:11.866012 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.866002    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 16:43:11.866186 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.866167    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7rvnc\""
Sep 11 16:43:11.866264 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.866237    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 16:43:11.866264 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.866242    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zb52f\""
Sep 11 16:43:11.866368 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.866285    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8kgpz\""
Sep 11 16:43:11.866368 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.866177    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2hfch\""
Sep 11 16:43:11.866497 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.866478    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 16:43:11.866609 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.866483    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 16:43:11.870502 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.870481    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:11.872967 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.872899    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:11.874339 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874320    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-run-systemd\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.874455 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874350    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61af0db4-55a1-48f1-9f49-d97573ee4ebf-host\") pod \"node-ca-dqgwp\" (UID: \"61af0db4-55a1-48f1-9f49-d97573ee4ebf\") " pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:11.874455 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874373    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61af0db4-55a1-48f1-9f49-d97573ee4ebf-serviceca\") pod \"node-ca-dqgwp\" (UID: \"61af0db4-55a1-48f1-9f49-d97573ee4ebf\") " pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:11.874455 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874396    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/880d46a9-faf3-4a41-94aa-67a41da118ea-konnectivity-ca\") pod \"konnectivity-agent-v64tp\" (UID: \"880d46a9-faf3-4a41-94aa-67a41da118ea\") " pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:11.874455 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874424    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93a162ce-a718-4a34-9b4a-426bd6cdcca0-system-cni-dir\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.874455 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874449    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93a162ce-a718-4a34-9b4a-426bd6cdcca0-cnibin\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.874718 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874497    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt2xh\" (UniqueName: \"kubernetes.io/projected/b584b1ae-e14f-4576-989a-eeb7a53eaf15-kube-api-access-nt2xh\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.874718 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874533    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-cni-bin\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.874718 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58fccd04-c863-4e1c-9858-3ed1ff44d577-ovnkube-config\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.874718 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-run-k8s-cni-cncf-io\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.874718 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-conf-dir\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.874718 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874681    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93a162ce-a718-4a34-9b4a-426bd6cdcca0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874721    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-var-lib-cni-multus\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5644c5d4-e518-452e-adab-114bbda4c7c8-iptables-alerter-script\") pod \"iptables-alerter-2njqb\" (UID: \"5644c5d4-e518-452e-adab-114bbda4c7c8\") " pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874783    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58fccd04-c863-4e1c-9858-3ed1ff44d577-ovn-node-metrics-cert\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874895    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-var-lib-openvswitch\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874929    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkfsb\" (UniqueName: \"kubernetes.io/projected/58fccd04-c863-4e1c-9858-3ed1ff44d577-kube-api-access-jkfsb\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874952    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-socket-dir-parent\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.874978    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875012    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-daemon-config\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875044    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-systemd-units\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875070    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-etc-openvswitch\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875092    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-hostroot\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.875106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875112    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-node-log\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875137    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58fccd04-c863-4e1c-9858-3ed1ff44d577-env-overrides\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875190    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-cni-dir\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875211    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b584b1ae-e14f-4576-989a-eeb7a53eaf15-cni-binary-copy\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875239    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-run-netns\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875259    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93a162ce-a718-4a34-9b4a-426bd6cdcca0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875276    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl67q\" (UniqueName: \"kubernetes.io/projected/93a162ce-a718-4a34-9b4a-426bd6cdcca0-kube-api-access-hl67q\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875291    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5644c5d4-e518-452e-adab-114bbda4c7c8-host-slash\") pod \"iptables-alerter-2njqb\" (UID: \"5644c5d4-e518-452e-adab-114bbda4c7c8\") " pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875352    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f761960a-5ee4-4ce3-a071-2ac47c95f963-dbus\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875399    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-slash\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875425    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-run-netns\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875449    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58fccd04-c863-4e1c-9858-3ed1ff44d577-ovnkube-script-lib\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875473    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-cnibin\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875507    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csxzb\" (UniqueName: \"kubernetes.io/projected/61af0db4-55a1-48f1-9f49-d97573ee4ebf-kube-api-access-csxzb\") pod \"node-ca-dqgwp\" (UID: \"61af0db4-55a1-48f1-9f49-d97573ee4ebf\") " pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875544    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f761960a-5ee4-4ce3-a071-2ac47c95f963-kubelet-config\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875577    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-run-ovn\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.875740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875601    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-system-cni-dir\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875634    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875659    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-var-lib-kubelet\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875675    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875695    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93a162ce-a718-4a34-9b4a-426bd6cdcca0-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875745    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-run-openvswitch\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:11.875753    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875786    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875834    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-cni-netd\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875881    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-kubelet\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875946    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-etc-kubernetes\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.875986    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93a162ce-a718-4a34-9b4a-426bd6cdcca0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.876015    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-run-multus-certs\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.876041    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xvhj\" (UniqueName: \"kubernetes.io/projected/5644c5d4-e518-452e-adab-114bbda4c7c8-kube-api-access-8xvhj\") pod \"iptables-alerter-2njqb\" (UID: \"5644c5d4-e518-452e-adab-114bbda4c7c8\") " pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.876080    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/880d46a9-faf3-4a41-94aa-67a41da118ea-agent-certs\") pod \"konnectivity-agent-v64tp\" (UID: \"880d46a9-faf3-4a41-94aa-67a41da118ea\") " pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.876094    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-log-socket\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.876607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.876128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-var-lib-cni-bin\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.878246 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.878225    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:11.878246 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.878240    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:43:11.878400 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:11.878294    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:11.878637 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.878617    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 16:43:11.881608 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.881591    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 16:43:11.881963 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.881941    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 16:43:11.883098 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.883042    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 16:43:11.884227 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.884206    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xbj4f\""
Sep 11 16:43:11.888123 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.888106    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 16:43:11.888499 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.888397    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 16:43:11.890215 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.890188    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ccjpz\""
Sep 11 16:43:11.890815 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.890771    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-k5msh\""
Sep 11 16:43:11.891150 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.891127    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 16:43:11.897628 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.897606    2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 16:43:11.930368 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.930347    2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-klcnj"
Sep 11 16:43:11.951075 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.951052    2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-klcnj"
Sep 11 16:43:11.963092 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.963072    2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 16:43:11.976903 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.976877    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-var-lib-openvswitch\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.976916    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkfsb\" (UniqueName: \"kubernetes.io/projected/58fccd04-c863-4e1c-9858-3ed1ff44d577-kube-api-access-jkfsb\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.976947    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-socket-dir-parent\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.977014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.976970    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-lib-modules\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.977014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.976987    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-etc-selinux\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:11.977014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977005    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-sys-fs\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977033    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977064    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-daemon-config\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977077    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-socket-dir-parent\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-systemd-units\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977002    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-var-lib-openvswitch\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977126    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-etc-openvswitch\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977110    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977140    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-systemd-units\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977154    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc873855-3055-43a4-be85-214ffa906ec8-tmp\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977166    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-etc-openvswitch\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977174    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhkxp\" (UniqueName: \"kubernetes.io/projected/6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5-kube-api-access-lhkxp\") pod \"node-resolver-vztfz\" (UID: \"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5\") " pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977210    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-hostroot\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977228    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-node-log\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977252    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58fccd04-c863-4e1c-9858-3ed1ff44d577-env-overrides\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977276    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-hostroot\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.977299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977277    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-cni-dir\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977330    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b584b1ae-e14f-4576-989a-eeb7a53eaf15-cni-binary-copy\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977341    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-cni-dir\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977279    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-node-log\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977357    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-run-netns\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977384    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-sysctl-d\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977408    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-var-lib-kubelet\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977419    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-run-netns\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977433    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93a162ce-a718-4a34-9b4a-426bd6cdcca0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977464    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl67q\" (UniqueName: \"kubernetes.io/projected/93a162ce-a718-4a34-9b4a-426bd6cdcca0-kube-api-access-hl67q\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977488    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5644c5d4-e518-452e-adab-114bbda4c7c8-host-slash\") pod \"iptables-alerter-2njqb\" (UID: \"5644c5d4-e518-452e-adab-114bbda4c7c8\") " pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977511    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f761960a-5ee4-4ce3-a071-2ac47c95f963-dbus\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977538    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-slash\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977583    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-run-netns\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977600    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5644c5d4-e518-452e-adab-114bbda4c7c8-host-slash\") pod \"iptables-alerter-2njqb\" (UID: \"5644c5d4-e518-452e-adab-114bbda4c7c8\") " pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977607    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58fccd04-c863-4e1c-9858-3ed1ff44d577-ovnkube-script-lib\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977645    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-cnibin\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.978234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977669    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-sysconfig\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977692    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-kubernetes\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977715    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csxzb\" (UniqueName: \"kubernetes.io/projected/61af0db4-55a1-48f1-9f49-d97573ee4ebf-kube-api-access-csxzb\") pod \"node-ca-dqgwp\" (UID: \"61af0db4-55a1-48f1-9f49-d97573ee4ebf\") " pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977743    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f761960a-5ee4-4ce3-a071-2ac47c95f963-kubelet-config\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977752    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-daemon-config\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977762    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58fccd04-c863-4e1c-9858-3ed1ff44d577-env-overrides\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-run-ovn\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977828    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b584b1ae-e14f-4576-989a-eeb7a53eaf15-cni-binary-copy\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-system-cni-dir\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977888    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f761960a-5ee4-4ce3-a071-2ac47c95f963-dbus\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977812    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-run-ovn\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977903    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-cnibin\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977890    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc873855-3055-43a4-be85-214ffa906ec8-etc-tuned\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977934    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f761960a-5ee4-4ce3-a071-2ac47c95f963-kubelet-config\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977956    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-slash\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977955    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j7xt\" (UniqueName: \"kubernetes.io/projected/e9f43f3a-5149-42a7-bef5-63af668caac6-kube-api-access-8j7xt\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.977997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978007    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-run-netns\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.979121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978024    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-system-cni-dir\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978036    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-var-lib-kubelet\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978062    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/93a162ce-a718-4a34-9b4a-426bd6cdcca0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978064    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93a162ce-a718-4a34-9b4a-426bd6cdcca0-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978077    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-var-lib-kubelet\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:11.978094    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-run-openvswitch\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978130    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:11.978158    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret podName:f761960a-5ee4-4ce3-a071-2ac47c95f963 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:12.478135658 +0000 UTC m=+3.037527047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret") pod "global-pull-secret-syncer-xxksk" (UID: "f761960a-5ee4-4ce3-a071-2ac47c95f963") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978165    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-run-ovn-kubernetes\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978188    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-cni-netd\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978218    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978215    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-run-openvswitch\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978259    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-cni-netd\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978298    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-run\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978331    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-kubelet\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978356    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-etc-kubernetes\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.980059 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978395    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-kubelet\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978404    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-etc-kubernetes\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978428    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-sys\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978478    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-host\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978500    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58fccd04-c863-4e1c-9858-3ed1ff44d577-ovnkube-script-lib\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978542    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-socket-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978550    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93a162ce-a718-4a34-9b4a-426bd6cdcca0-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978586    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5-tmp-dir\") pod \"node-resolver-vztfz\" (UID: \"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5\") " pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978613    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978643    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93a162ce-a718-4a34-9b4a-426bd6cdcca0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978672    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-run-multus-certs\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978697    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-modprobe-d\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978717    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-run-multus-certs\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978726    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xvhj\" (UniqueName: \"kubernetes.io/projected/5644c5d4-e518-452e-adab-114bbda4c7c8-kube-api-access-8xvhj\") pod \"iptables-alerter-2njqb\" (UID: \"5644c5d4-e518-452e-adab-114bbda4c7c8\") " pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978753    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/880d46a9-faf3-4a41-94aa-67a41da118ea-agent-certs\") pod \"konnectivity-agent-v64tp\" (UID: \"880d46a9-faf3-4a41-94aa-67a41da118ea\") " pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978778    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-log-socket\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.980784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978803    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-var-lib-cni-bin\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978848    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-sysctl-conf\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-registration-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978891    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-log-socket\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978916    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-var-lib-cni-bin\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978941    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-run-systemd\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978969    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61af0db4-55a1-48f1-9f49-d97573ee4ebf-host\") pod \"node-ca-dqgwp\" (UID: \"61af0db4-55a1-48f1-9f49-d97573ee4ebf\") " pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979001    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-run-systemd\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.978996    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61af0db4-55a1-48f1-9f49-d97573ee4ebf-serviceca\") pod \"node-ca-dqgwp\" (UID: \"61af0db4-55a1-48f1-9f49-d97573ee4ebf\") " pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979050    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/61af0db4-55a1-48f1-9f49-d97573ee4ebf-host\") pod \"node-ca-dqgwp\" (UID: \"61af0db4-55a1-48f1-9f49-d97573ee4ebf\") " pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979073    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/880d46a9-faf3-4a41-94aa-67a41da118ea-konnectivity-ca\") pod \"konnectivity-agent-v64tp\" (UID: \"880d46a9-faf3-4a41-94aa-67a41da118ea\") " pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979101    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93a162ce-a718-4a34-9b4a-426bd6cdcca0-system-cni-dir\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979126    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93a162ce-a718-4a34-9b4a-426bd6cdcca0-cnibin\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979140    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/93a162ce-a718-4a34-9b4a-426bd6cdcca0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979153    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt2xh\" (UniqueName: \"kubernetes.io/projected/b584b1ae-e14f-4576-989a-eeb7a53eaf15-kube-api-access-nt2xh\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-cni-bin\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979203    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58fccd04-c863-4e1c-9858-3ed1ff44d577-ovnkube-config\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.981864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979205    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93a162ce-a718-4a34-9b4a-426bd6cdcca0-system-cni-dir\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979228    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-run-k8s-cni-cncf-io\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-conf-dir\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-systemd\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979308    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5-hosts-file\") pod \"node-resolver-vztfz\" (UID: \"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5\") " pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979334    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93a162ce-a718-4a34-9b4a-426bd6cdcca0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-var-lib-cni-multus\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979394    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxgrd\" (UniqueName: \"kubernetes.io/projected/fc873855-3055-43a4-be85-214ffa906ec8-kube-api-access-nxgrd\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979425    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5644c5d4-e518-452e-adab-114bbda4c7c8-iptables-alerter-script\") pod \"iptables-alerter-2njqb\" (UID: \"5644c5d4-e518-452e-adab-114bbda4c7c8\") " pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979448    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58fccd04-c863-4e1c-9858-3ed1ff44d577-host-cni-bin\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979457    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/61af0db4-55a1-48f1-9f49-d97573ee4ebf-serviceca\") pod \"node-ca-dqgwp\" (UID: \"61af0db4-55a1-48f1-9f49-d97573ee4ebf\") " pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979255    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93a162ce-a718-4a34-9b4a-426bd6cdcca0-cnibin\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58fccd04-c863-4e1c-9858-3ed1ff44d577-ovn-node-metrics-cert\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979483    2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979531    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-var-lib-cni-multus\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979538    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-multus-conf-dir\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979531    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b584b1ae-e14f-4576-989a-eeb7a53eaf15-host-run-k8s-cni-cncf-io\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979584    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-device-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:11.982754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979612    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/880d46a9-faf3-4a41-94aa-67a41da118ea-konnectivity-ca\") pod \"konnectivity-agent-v64tp\" (UID: \"880d46a9-faf3-4a41-94aa-67a41da118ea\") " pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:11.983580 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979621    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7dkn\" (UniqueName: \"kubernetes.io/projected/e2d1bde7-0bee-4822-bb66-0c75f276c565-kube-api-access-w7dkn\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:11.983580 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979728    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93a162ce-a718-4a34-9b4a-426bd6cdcca0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:11.983580 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.979742    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58fccd04-c863-4e1c-9858-3ed1ff44d577-ovnkube-config\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.983580 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.980207    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5644c5d4-e518-452e-adab-114bbda4c7c8-iptables-alerter-script\") pod \"iptables-alerter-2njqb\" (UID: \"5644c5d4-e518-452e-adab-114bbda4c7c8\") " pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:11.983783 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.983697    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58fccd04-c863-4e1c-9858-3ed1ff44d577-ovn-node-metrics-cert\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:11.983907 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.983862    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/880d46a9-faf3-4a41-94aa-67a41da118ea-agent-certs\") pod \"konnectivity-agent-v64tp\" (UID: \"880d46a9-faf3-4a41-94aa-67a41da118ea\") " pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:12.000183 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:11.999983    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkfsb\" (UniqueName: \"kubernetes.io/projected/58fccd04-c863-4e1c-9858-3ed1ff44d577-kube-api-access-jkfsb\") pod \"ovnkube-node-5tfmw\" (UID: \"58fccd04-c863-4e1c-9858-3ed1ff44d577\") " pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:12.009749 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.008807    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt2xh\" (UniqueName: \"kubernetes.io/projected/b584b1ae-e14f-4576-989a-eeb7a53eaf15-kube-api-access-nt2xh\") pod \"multus-f75n6\" (UID: \"b584b1ae-e14f-4576-989a-eeb7a53eaf15\") " pod="openshift-multus/multus-f75n6"
Sep 11 16:43:12.011766 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.011742    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xvhj\" (UniqueName: \"kubernetes.io/projected/5644c5d4-e518-452e-adab-114bbda4c7c8-kube-api-access-8xvhj\") pod \"iptables-alerter-2njqb\" (UID: \"5644c5d4-e518-452e-adab-114bbda4c7c8\") " pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:12.013234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.013206    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl67q\" (UniqueName: \"kubernetes.io/projected/93a162ce-a718-4a34-9b4a-426bd6cdcca0-kube-api-access-hl67q\") pod \"multus-additional-cni-plugins-mtvm7\" (UID: \"93a162ce-a718-4a34-9b4a-426bd6cdcca0\") " pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:12.013536 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.013511    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csxzb\" (UniqueName: \"kubernetes.io/projected/61af0db4-55a1-48f1-9f49-d97573ee4ebf-kube-api-access-csxzb\") pod \"node-ca-dqgwp\" (UID: \"61af0db4-55a1-48f1-9f49-d97573ee4ebf\") " pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:12.062665 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.062629    2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 16:43:12.080865 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.080831    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:12.080865 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.080876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-run\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081092 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.080903    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-sys\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081092 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.080983    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-sys\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081092 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081050    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-run\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081240 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-host\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081240 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081125    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.081240 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081150    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-socket-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.081240 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081174    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5-tmp-dir\") pod \"node-resolver-vztfz\" (UID: \"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5\") " pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:12.081240 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081198    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:12.081240 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081182    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-host\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081240 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081223    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.081240 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081226    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-modprobe-d\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081275    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-sysctl-conf\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081300    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-registration-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081311    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-modprobe-d\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081325    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-socket-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.081300    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081333    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-systemd\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081348    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-registration-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081365    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5-hosts-file\") pod \"node-resolver-vztfz\" (UID: \"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5\") " pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081388    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-systemd\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.081394    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs podName:e2d1bde7-0bee-4822-bb66-0c75f276c565 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:12.581376997 +0000 UTC m=+3.140768363 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs") pod "network-metrics-daemon-xgtkk" (UID: "e2d1bde7-0bee-4822-bb66-0c75f276c565") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081410    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxgrd\" (UniqueName: \"kubernetes.io/projected/fc873855-3055-43a4-be85-214ffa906ec8-kube-api-access-nxgrd\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081424    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-sysctl-conf\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081439    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5-hosts-file\") pod \"node-resolver-vztfz\" (UID: \"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5\") " pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081432    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-device-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081457    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-device-dir\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7dkn\" (UniqueName: \"kubernetes.io/projected/e2d1bde7-0bee-4822-bb66-0c75f276c565-kube-api-access-w7dkn\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:12.081630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081507    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-lib-modules\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081518    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5-tmp-dir\") pod \"node-resolver-vztfz\" (UID: \"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5\") " pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081543    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-etc-selinux\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081628    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-sys-fs\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081646    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-lib-modules\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081651    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc873855-3055-43a4-be85-214ffa906ec8-tmp\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081695    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-sys-fs\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081696    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhkxp\" (UniqueName: \"kubernetes.io/projected/6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5-kube-api-access-lhkxp\") pod \"node-resolver-vztfz\" (UID: \"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5\") " pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081641    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e9f43f3a-5149-42a7-bef5-63af668caac6-etc-selinux\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081740    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-sysctl-d\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-var-lib-kubelet\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081800    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-sysconfig\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081824    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-kubernetes\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081861    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-sysctl-d\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081889    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc873855-3055-43a4-be85-214ffa906ec8-etc-tuned\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081919    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j7xt\" (UniqueName: \"kubernetes.io/projected/e9f43f3a-5149-42a7-bef5-63af668caac6-kube-api-access-8j7xt\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081924    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-var-lib-kubelet\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.082440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081944    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-kubernetes\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.083146 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.081975    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc873855-3055-43a4-be85-214ffa906ec8-etc-sysconfig\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.084393 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.084370    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc873855-3055-43a4-be85-214ffa906ec8-tmp\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.084671 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.084649    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc873855-3055-43a4-be85-214ffa906ec8-etc-tuned\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.105007 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.104934    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:43:12.105007 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.104966    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:43:12.105007 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.104977    2569 projected.go:196] Error preparing data for projected volume kube-api-access-pmch4 for pod openshift-network-diagnostics/network-check-target-5cdgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:12.105213 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.105053    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4 podName:35671487-b20e-4f06-9350-038748458891 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:12.605029913 +0000 UTC m=+3.164421294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pmch4" (UniqueName: "kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4") pod "network-check-target-5cdgz" (UID: "35671487-b20e-4f06-9350-038748458891") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:12.120151 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.120124    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j7xt\" (UniqueName: \"kubernetes.io/projected/e9f43f3a-5149-42a7-bef5-63af668caac6-kube-api-access-8j7xt\") pod \"aws-ebs-csi-driver-node-bk99z\" (UID: \"e9f43f3a-5149-42a7-bef5-63af668caac6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.120907 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.120868    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7dkn\" (UniqueName: \"kubernetes.io/projected/e2d1bde7-0bee-4822-bb66-0c75f276c565-kube-api-access-w7dkn\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:12.121076 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.121060    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxgrd\" (UniqueName: \"kubernetes.io/projected/fc873855-3055-43a4-be85-214ffa906ec8-kube-api-access-nxgrd\") pod \"tuned-48qml\" (UID: \"fc873855-3055-43a4-be85-214ffa906ec8\") " pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.138000 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.137972    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhkxp\" (UniqueName: \"kubernetes.io/projected/6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5-kube-api-access-lhkxp\") pod \"node-resolver-vztfz\" (UID: \"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5\") " pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:12.159577 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.159443    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f75n6"
Sep 11 16:43:12.168369 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.168350    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2njqb"
Sep 11 16:43:12.178250 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.178230    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dqgwp"
Sep 11 16:43:12.185292 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.185259    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:12.192513 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.192487    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:12.202771 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.202750    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mtvm7"
Sep 11 16:43:12.210741 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.210719    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-48qml"
Sep 11 16:43:12.218684 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.218668    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z"
Sep 11 16:43:12.224621 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.224603    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vztfz"
Sep 11 16:43:12.486311 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.486270    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:12.486504 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.486429    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:12.486576 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.486509    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret podName:f761960a-5ee4-4ce3-a071-2ac47c95f963 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:13.486487049 +0000 UTC m=+4.045878421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret") pod "global-pull-secret-syncer-xxksk" (UID: "f761960a-5ee4-4ce3-a071-2ac47c95f963") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:12.587436 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.587394    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:12.587630 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.587570    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:12.587697 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.587669    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs podName:e2d1bde7-0bee-4822-bb66-0c75f276c565 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:13.587645271 +0000 UTC m=+4.147036653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs") pod "network-metrics-daemon-xgtkk" (UID: "e2d1bde7-0bee-4822-bb66-0c75f276c565") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:12.688426 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.688391    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:12.688583 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.688567    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:43:12.688626 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.688591    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:43:12.688626 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.688604    2569 projected.go:196] Error preparing data for projected volume kube-api-access-pmch4 for pod openshift-network-diagnostics/network-check-target-5cdgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:12.688696 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:12.688659    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4 podName:35671487-b20e-4f06-9350-038748458891 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:13.688643491 +0000 UTC m=+4.248034858 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmch4" (UniqueName: "kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4") pod "network-check-target-5cdgz" (UID: "35671487-b20e-4f06-9350-038748458891") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:12.953999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.953957    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 16:38:12 +0000 UTC" deadline="2028-03-11 11:11:17.89880284 +0000 UTC"
Sep 11 16:43:12.953999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:12.953997    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13122h28m4.944811238s"
Sep 11 16:43:13.087197 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:13.087165    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6449cf0d_f5e1_4b0e_bc8e_d489ab5f68e5.slice/crio-3075f646d469e4c7db4e2a2289167dc021e68c993bb425199a6bf4dd34d7211d WatchSource:0}: Error finding container 3075f646d469e4c7db4e2a2289167dc021e68c993bb425199a6bf4dd34d7211d: Status 404 returned error can't find the container with id 3075f646d469e4c7db4e2a2289167dc021e68c993bb425199a6bf4dd34d7211d
Sep 11 16:43:13.090046 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:13.089497    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58fccd04_c863_4e1c_9858_3ed1ff44d577.slice/crio-76c30fa88fa30ca63d55e96d2891727d340dca8ee0819f7ea330034eea463cb0 WatchSource:0}: Error finding container 76c30fa88fa30ca63d55e96d2891727d340dca8ee0819f7ea330034eea463cb0: Status 404 returned error can't find the container with id 76c30fa88fa30ca63d55e96d2891727d340dca8ee0819f7ea330034eea463cb0
Sep 11 16:43:13.091725 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:13.091694    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9f43f3a_5149_42a7_bef5_63af668caac6.slice/crio-27835b321e1d57cbca62ba1a2fb1696fdd6ffba81445e5b37a3440e5962a57aa WatchSource:0}: Error finding container 27835b321e1d57cbca62ba1a2fb1696fdd6ffba81445e5b37a3440e5962a57aa: Status 404 returned error can't find the container with id 27835b321e1d57cbca62ba1a2fb1696fdd6ffba81445e5b37a3440e5962a57aa
Sep 11 16:43:13.098696 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:13.098401    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5644c5d4_e518_452e_adab_114bbda4c7c8.slice/crio-fb144b838c8bd7a4896dcff568960f0db291f7055e4bb7ba2f26ddf409368981 WatchSource:0}: Error finding container fb144b838c8bd7a4896dcff568960f0db291f7055e4bb7ba2f26ddf409368981: Status 404 returned error can't find the container with id fb144b838c8bd7a4896dcff568960f0db291f7055e4bb7ba2f26ddf409368981
Sep 11 16:43:13.099384 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:13.099363    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc873855_3055_43a4_be85_214ffa906ec8.slice/crio-e4f9d9cc310922bd855c08618a654004b9514b305c7f8c76bc3ce673b4d12256 WatchSource:0}: Error finding container e4f9d9cc310922bd855c08618a654004b9514b305c7f8c76bc3ce673b4d12256: Status 404 returned error can't find the container with id e4f9d9cc310922bd855c08618a654004b9514b305c7f8c76bc3ce673b4d12256
Sep 11 16:43:13.101388 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:13.101006    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a162ce_a718_4a34_9b4a_426bd6cdcca0.slice/crio-a4e65fb323cf494fd8b7696d37ddb723158c4ceb6af02f0b836409221ddb7875 WatchSource:0}: Error finding container a4e65fb323cf494fd8b7696d37ddb723158c4ceb6af02f0b836409221ddb7875: Status 404 returned error can't find the container with id a4e65fb323cf494fd8b7696d37ddb723158c4ceb6af02f0b836409221ddb7875
Sep 11 16:43:13.494908 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.494859    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:13.495058 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.495017    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:13.495104 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.495088    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret podName:f761960a-5ee4-4ce3-a071-2ac47c95f963 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:15.495071333 +0000 UTC m=+6.054462700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret") pod "global-pull-secret-syncer-xxksk" (UID: "f761960a-5ee4-4ce3-a071-2ac47c95f963") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:13.595519 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.595480    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:13.595728 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.595663    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:13.595798 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.595740    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs podName:e2d1bde7-0bee-4822-bb66-0c75f276c565 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:15.595718399 +0000 UTC m=+6.155109772 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs") pod "network-metrics-daemon-xgtkk" (UID: "e2d1bde7-0bee-4822-bb66-0c75f276c565") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:13.696215 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.696175    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:13.696424 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.696400    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:43:13.696424 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.696419    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:43:13.696538 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.696432    2569 projected.go:196] Error preparing data for projected volume kube-api-access-pmch4 for pod openshift-network-diagnostics/network-check-target-5cdgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:13.696538 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.696494    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4 podName:35671487-b20e-4f06-9350-038748458891 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:15.696475679 +0000 UTC m=+6.255867068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmch4" (UniqueName: "kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4") pod "network-check-target-5cdgz" (UID: "35671487-b20e-4f06-9350-038748458891") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:13.922075 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.922002    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:13.922075 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.922016    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:13.922339 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.922155    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:13.922849 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.922476    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:13.922849 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.922581    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:13.922849 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:13.922670    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:13.937534 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.937343    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2njqb" event={"ID":"5644c5d4-e518-452e-adab-114bbda4c7c8","Type":"ContainerStarted","Data":"fb144b838c8bd7a4896dcff568960f0db291f7055e4bb7ba2f26ddf409368981"}
Sep 11 16:43:13.954938 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.954823    2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 16:38:12 +0000 UTC" deadline="2028-03-08 04:01:30.434816633 +0000 UTC"
Sep 11 16:43:13.954938 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.954884    2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13043h18m16.479943653s"
Sep 11 16:43:13.960733 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.960698    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f75n6" event={"ID":"b584b1ae-e14f-4576-989a-eeb7a53eaf15","Type":"ContainerStarted","Data":"e8fb6b072cd4954db014923655915edbd24ebb2793c12d659f65141416c86c1f"}
Sep 11 16:43:13.973670 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.973633    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v64tp" event={"ID":"880d46a9-faf3-4a41-94aa-67a41da118ea","Type":"ContainerStarted","Data":"fb980ccad9768359ce7d817255107631712f9c2a71ab5ec02a321cc44285e7ee"}
Sep 11 16:43:13.982561 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.982528    2569 generic.go:356] "Generic (PLEG): container finished" podID="41ebf87d480f7c21731bfa60407081d6" containerID="c7e01ee69f9d03ac4f1e4dd724769c417607144f9422e91ef8a5b15b3975f375" exitCode=0
Sep 11 16:43:13.982709 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.982620    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal" event={"ID":"41ebf87d480f7c21731bfa60407081d6","Type":"ContainerDied","Data":"c7e01ee69f9d03ac4f1e4dd724769c417607144f9422e91ef8a5b15b3975f375"}
Sep 11 16:43:13.996093 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:13.991102    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-48qml" event={"ID":"fc873855-3055-43a4-be85-214ffa906ec8","Type":"ContainerStarted","Data":"e4f9d9cc310922bd855c08618a654004b9514b305c7f8c76bc3ce673b4d12256"}
Sep 11 16:43:14.001095 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:14.001066    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z" event={"ID":"e9f43f3a-5149-42a7-bef5-63af668caac6","Type":"ContainerStarted","Data":"27835b321e1d57cbca62ba1a2fb1696fdd6ffba81445e5b37a3440e5962a57aa"}
Sep 11 16:43:14.008792 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:14.008692    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" event={"ID":"58fccd04-c863-4e1c-9858-3ed1ff44d577","Type":"ContainerStarted","Data":"76c30fa88fa30ca63d55e96d2891727d340dca8ee0819f7ea330034eea463cb0"}
Sep 11 16:43:14.027525 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:14.027437    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vztfz" event={"ID":"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5","Type":"ContainerStarted","Data":"3075f646d469e4c7db4e2a2289167dc021e68c993bb425199a6bf4dd34d7211d"}
Sep 11 16:43:14.039331 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:14.038539    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal" event={"ID":"1032e07a96b02bfcfeb61cb48d83063d","Type":"ContainerStarted","Data":"5271d2699ba81bf58810b34bb37f5cb6b15c2e1cdac71c2dee0152faae1d9001"}
Sep 11 16:43:14.044654 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:14.044624    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtvm7" event={"ID":"93a162ce-a718-4a34-9b4a-426bd6cdcca0","Type":"ContainerStarted","Data":"a4e65fb323cf494fd8b7696d37ddb723158c4ceb6af02f0b836409221ddb7875"}
Sep 11 16:43:14.048199 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:14.048104    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dqgwp" event={"ID":"61af0db4-55a1-48f1-9f49-d97573ee4ebf","Type":"ContainerStarted","Data":"4fbaf8b04f6d216451790f93eaa2c1436705333c02e0f8b58bb87c83d7bf966c"}
Sep 11 16:43:15.069696 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:15.069615    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal" event={"ID":"41ebf87d480f7c21731bfa60407081d6","Type":"ContainerStarted","Data":"f8d824f687c363aca73b5af6b33b5a62440ebffef1e3aa1f1ef3d903bb6fbd9b"}
Sep 11 16:43:15.114742 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:15.113961    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-153.ec2.internal" podStartSLOduration=4.113936203 podStartE2EDuration="4.113936203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:14.06007708 +0000 UTC m=+4.619468471" watchObservedRunningTime="2026-09-11 16:43:15.113936203 +0000 UTC m=+5.673327599"
Sep 11 16:43:15.514046 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:15.513446    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:15.514046 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.513608    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:15.514046 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.513678    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret podName:f761960a-5ee4-4ce3-a071-2ac47c95f963 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:19.513657988 +0000 UTC m=+10.073049361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret") pod "global-pull-secret-syncer-xxksk" (UID: "f761960a-5ee4-4ce3-a071-2ac47c95f963") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:15.614938 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:15.614882    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:15.615105 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.615081    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:15.615182 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.615154    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs podName:e2d1bde7-0bee-4822-bb66-0c75f276c565 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:19.615132608 +0000 UTC m=+10.174523996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs") pod "network-metrics-daemon-xgtkk" (UID: "e2d1bde7-0bee-4822-bb66-0c75f276c565") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:15.716252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:15.716208    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:15.716457 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.716437    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:43:15.716547 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.716462    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:43:15.716547 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.716476    2569 projected.go:196] Error preparing data for projected volume kube-api-access-pmch4 for pod openshift-network-diagnostics/network-check-target-5cdgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:15.716547 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.716545    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4 podName:35671487-b20e-4f06-9350-038748458891 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:19.716522107 +0000 UTC m=+10.275913495 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmch4" (UniqueName: "kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4") pod "network-check-target-5cdgz" (UID: "35671487-b20e-4f06-9350-038748458891") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:15.923119 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:15.923037    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:15.923119 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:15.923040    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:15.923336 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:15.923040    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:15.923336 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.923196    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:15.923336 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.923305    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:15.923581 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:15.923405    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:17.922544 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:17.922057    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:17.922544 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:17.922056    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:17.922544 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:17.922190    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:17.922544 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:17.922206    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:17.922544 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:17.922287    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:17.922544 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:17.922378    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:19.548555 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:19.548521    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:19.549003 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.548695    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:19.549003 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.548752    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret podName:f761960a-5ee4-4ce3-a071-2ac47c95f963 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:27.548735597 +0000 UTC m=+18.108126981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret") pod "global-pull-secret-syncer-xxksk" (UID: "f761960a-5ee4-4ce3-a071-2ac47c95f963") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:19.648922 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:19.648885    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:19.649080 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.649057    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:19.649134 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.649118    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs podName:e2d1bde7-0bee-4822-bb66-0c75f276c565 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:27.649102552 +0000 UTC m=+18.208493938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs") pod "network-metrics-daemon-xgtkk" (UID: "e2d1bde7-0bee-4822-bb66-0c75f276c565") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:19.749723 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:19.749685    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:19.749924 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.749893    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:43:19.749924 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.749918    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:43:19.750031 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.749930    2569 projected.go:196] Error preparing data for projected volume kube-api-access-pmch4 for pod openshift-network-diagnostics/network-check-target-5cdgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:19.750031 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.749978    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4 podName:35671487-b20e-4f06-9350-038748458891 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:27.749963744 +0000 UTC m=+18.309355130 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmch4" (UniqueName: "kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4") pod "network-check-target-5cdgz" (UID: "35671487-b20e-4f06-9350-038748458891") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:19.921537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:19.921459    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:19.921712 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.921562    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:19.921920 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:19.921905    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:19.922039 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.921972    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:19.922039 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:19.922010    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:19.922138 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:19.922071    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:21.923151 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:21.922912    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:21.923569 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:21.923238    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:21.923569 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:21.922930    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:21.923569 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:21.922993    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:21.923569 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:21.923310    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:21.923569 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:21.923383    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:23.921685 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:23.921651    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:23.922177 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:23.921694    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:23.922177 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:23.921650    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:23.922177 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:23.921788    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:23.922177 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:23.921862    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:23.922177 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:23.921961    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:25.921904 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:25.921869    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:25.922388 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:25.921915    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:25.922388 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:25.922001    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:25.922388 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:25.922072    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:25.922388 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:25.922190    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:25.922388 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:25.922294    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:27.607625 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:27.607588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:27.608122 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.607749    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:27.608122 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.607846    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret podName:f761960a-5ee4-4ce3-a071-2ac47c95f963 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:43.607825823 +0000 UTC m=+34.167217192 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret") pod "global-pull-secret-syncer-xxksk" (UID: "f761960a-5ee4-4ce3-a071-2ac47c95f963") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:27.708347 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:27.708319    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:27.708501 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.708443    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:27.708501 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.708497    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs podName:e2d1bde7-0bee-4822-bb66-0c75f276c565 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:43.708483073 +0000 UTC m=+34.267874441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs") pod "network-metrics-daemon-xgtkk" (UID: "e2d1bde7-0bee-4822-bb66-0c75f276c565") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:27.809564 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:27.809537    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:27.809720 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.809704    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:43:27.809777 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.809728    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:43:27.809777 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.809742    2569 projected.go:196] Error preparing data for projected volume kube-api-access-pmch4 for pod openshift-network-diagnostics/network-check-target-5cdgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:27.809888 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.809810    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4 podName:35671487-b20e-4f06-9350-038748458891 nodeName:}" failed. No retries permitted until 2026-09-11 16:43:43.809778931 +0000 UTC m=+34.369170310 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmch4" (UniqueName: "kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4") pod "network-check-target-5cdgz" (UID: "35671487-b20e-4f06-9350-038748458891") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:27.920845 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:27.920761    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:27.920845 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:27.920812    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:27.921011 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:27.920769    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:27.921011 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.920896    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:27.921011 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.920959    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:27.921135 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:27.921035    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:29.921951 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:29.921908    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:29.922489 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:29.922016    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:29.922489 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:29.922089    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:29.922489 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:29.922213    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:29.922489 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:29.922265    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:29.922489 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:29.922342    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:31.920976 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:31.920774    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:31.920976 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:31.920779    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:31.920976 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:31.920920    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:31.921507 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:31.921005    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:31.921507 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:31.921062    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:31.921507 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:31.921126    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:32.109714 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.109485    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-48qml" event={"ID":"fc873855-3055-43a4-be85-214ffa906ec8","Type":"ContainerStarted","Data":"392b00ffe29597083d32a880a592b6d8808036e446a676c74c5e45b77b6aa933"}
Sep 11 16:43:32.111159 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.111139    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z" event={"ID":"e9f43f3a-5149-42a7-bef5-63af668caac6","Type":"ContainerStarted","Data":"73343ef1e792432b1b26810daefe2822184e6ec99dcf9a0c2861bd040b28d3b4"}
Sep 11 16:43:32.113767 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.113746    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" event={"ID":"58fccd04-c863-4e1c-9858-3ed1ff44d577","Type":"ContainerStarted","Data":"03f63398d1c0e51297180b6ff1464a6507829503c00144f1039804efa042d0ad"}
Sep 11 16:43:32.113866 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.113844    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" event={"ID":"58fccd04-c863-4e1c-9858-3ed1ff44d577","Type":"ContainerStarted","Data":"4987ba9fcc0c8ac2ab9a6ed22f7c2763466b400247893dbeca4bca9d8963c2a7"}
Sep 11 16:43:32.113925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.113897    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" event={"ID":"58fccd04-c863-4e1c-9858-3ed1ff44d577","Type":"ContainerStarted","Data":"a940d5b52830b5111ad6bed790ee4c577d6b56502ded0c291859c45f4a92d5ad"}
Sep 11 16:43:32.113984 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.113946    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" event={"ID":"58fccd04-c863-4e1c-9858-3ed1ff44d577","Type":"ContainerStarted","Data":"0301d1bd1e6133de8d8cbdadaea7cf6c2ac105333c14d681e6f4cc4c0bf321fa"}
Sep 11 16:43:32.115280 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.115249    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vztfz" event={"ID":"6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5","Type":"ContainerStarted","Data":"048ff56a743118c5a374c477fe83a48da022a3c632b430260e8d1781a6f2778e"}
Sep 11 16:43:32.116991 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.116965    2569 generic.go:356] "Generic (PLEG): container finished" podID="93a162ce-a718-4a34-9b4a-426bd6cdcca0" containerID="cb80e8f749e42c34eaf205278723e67e9ea9fee72753ebcc9888c128ed2d9e0c" exitCode=0
Sep 11 16:43:32.117076 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.117038    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtvm7" event={"ID":"93a162ce-a718-4a34-9b4a-426bd6cdcca0","Type":"ContainerDied","Data":"cb80e8f749e42c34eaf205278723e67e9ea9fee72753ebcc9888c128ed2d9e0c"}
Sep 11 16:43:32.118564 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.118541    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dqgwp" event={"ID":"61af0db4-55a1-48f1-9f49-d97573ee4ebf","Type":"ContainerStarted","Data":"40d1efba479559474bd4679a5f9cfd9d9e81bfa707ca5c93b6e34cc4c077c64d"}
Sep 11 16:43:32.119918 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.119898    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f75n6" event={"ID":"b584b1ae-e14f-4576-989a-eeb7a53eaf15","Type":"ContainerStarted","Data":"0976e7f9e28834b20618430d62dc3ef197a3bc83a96c8b0cf7ca13be76bd755a"}
Sep 11 16:43:32.121159 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.121138    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-v64tp" event={"ID":"880d46a9-faf3-4a41-94aa-67a41da118ea","Type":"ContainerStarted","Data":"1c8015ae509ffbdd04e7378bc70c47e987ea62a4ce49fa09e5fd410bc0a07f50"}
Sep 11 16:43:32.132238 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.132193    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-48qml" podStartSLOduration=3.538409388 podStartE2EDuration="22.132179796s" totalImagesPullingTime="18.593770408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:32.132104776 +0000 UTC m=+22.691496164" watchObservedRunningTime="2026-09-11 16:43:32.132179796 +0000 UTC m=+22.691571184"
Sep 11 16:43:32.132739 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.132711    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-153.ec2.internal" podStartSLOduration=21.132702746 podStartE2EDuration="21.132702746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:15.114722682 +0000 UTC m=+5.674114076" watchObservedRunningTime="2026-09-11 16:43:32.132702746 +0000 UTC m=+22.692094133"
Sep 11 16:43:32.186698 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.186661    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vztfz" podStartSLOduration=3.590491518 podStartE2EDuration="22.186646123s" totalImagesPullingTime="18.596154605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:32.158705654 +0000 UTC m=+22.718097041" watchObservedRunningTime="2026-09-11 16:43:32.186646123 +0000 UTC m=+22.746037510"
Sep 11 16:43:32.186841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.186818    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f75n6" podStartSLOduration=3.541553723 podStartE2EDuration="22.186789534s" totalImagesPullingTime="18.645235811s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:32.186697993 +0000 UTC m=+22.746089391" watchObservedRunningTime="2026-09-11 16:43:32.186789534 +0000 UTC m=+22.746180943"
Sep 11 16:43:32.208671 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.208634    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-v64tp" podStartSLOduration=7.356660829 podStartE2EDuration="22.208620288s" totalImagesPullingTime="14.851959459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:32.208344575 +0000 UTC m=+22.767735963" watchObservedRunningTime="2026-09-11 16:43:32.208620288 +0000 UTC m=+22.768011674"
Sep 11 16:43:32.644038 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.643965    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:32.644912 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.644884    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:32.665647 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:32.665586    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dqgwp" podStartSLOduration=4.0753318 podStartE2EDuration="22.66556845s" totalImagesPullingTime="18.59023665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:32.268480189 +0000 UTC m=+22.827871575" watchObservedRunningTime="2026-09-11 16:43:32.66556845 +0000 UTC m=+23.224959839"
Sep 11 16:43:33.125917 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.125885    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" event={"ID":"58fccd04-c863-4e1c-9858-3ed1ff44d577","Type":"ContainerStarted","Data":"53d64894931de836961fe1ae79e3dce5cb1d38f766600228b1815e1adff76153"}
Sep 11 16:43:33.126590 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.125956    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" event={"ID":"58fccd04-c863-4e1c-9858-3ed1ff44d577","Type":"ContainerStarted","Data":"0f2275b9435133052c5904dcf59635309a5408ba1ac5cb34aedbcf2f01a77db7"}
Sep 11 16:43:33.127390 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.127362    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2njqb" event={"ID":"5644c5d4-e518-452e-adab-114bbda4c7c8","Type":"ContainerStarted","Data":"57f5c697628346c974829f5930d810503968ef953146d15796684f35b8c99670"}
Sep 11 16:43:33.127859 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.127841    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:33.128311 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.128294    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-v64tp"
Sep 11 16:43:33.190282 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.190213    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2njqb" podStartSLOduration=4.605375474 podStartE2EDuration="23.190190942s" totalImagesPullingTime="18.584815468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:33.157384323 +0000 UTC m=+23.716775719" watchObservedRunningTime="2026-09-11 16:43:33.190190942 +0000 UTC m=+23.749582329"
Sep 11 16:43:33.401728 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.401520    2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 16:43:33.921870 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.921839    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:33.922038 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.921839    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:33.922038 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:33.921947    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:33.922038 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.921970    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:33.922144 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:33.922058    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:33.922144 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:33.922111    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:33.947988 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.947905    2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T16:43:33.401726593Z","UUID":"00f0dbb0-49d6-450d-80ef-db070bbebede","Handler":null,"Name":"","Endpoint":""}
Sep 11 16:43:33.949371 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.949357    2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 16:43:33.949459 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:33.949382    2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 16:43:34.132288 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:34.132242    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z" event={"ID":"e9f43f3a-5149-42a7-bef5-63af668caac6","Type":"ContainerStarted","Data":"6db77e5074eb8e7b5a971b9736213a651789febea8372ba43c753818c6072a12"}
Sep 11 16:43:35.138408 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:35.138368    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z" event={"ID":"e9f43f3a-5149-42a7-bef5-63af668caac6","Type":"ContainerStarted","Data":"facc965abce6c6132620fcc623854e2bc0660127811910fd8caa8513a140f3d2"}
Sep 11 16:43:35.142540 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:35.142512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" event={"ID":"58fccd04-c863-4e1c-9858-3ed1ff44d577","Type":"ContainerStarted","Data":"7ef9dc670a7ac907d641bf569bce5263c27add798421900fad83e9aea5730b6d"}
Sep 11 16:43:35.159361 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:35.159314    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bk99z" podStartSLOduration=4.148428103 podStartE2EDuration="25.159302645s" totalImagesPullingTime="21.010874542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:35.158295474 +0000 UTC m=+25.717686860" watchObservedRunningTime="2026-09-11 16:43:35.159302645 +0000 UTC m=+25.718694032"
Sep 11 16:43:35.921481 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:35.921448    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:35.921481 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:35.921463    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:35.921738 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:35.921448    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:35.921738 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:35.921589    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:35.921738 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:35.921679    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:35.921926 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:35.921781    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:37.921243 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:37.921059    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:37.921743 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:37.921071    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:37.921743 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:37.921325    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:37.921743 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:37.921118    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:37.921743 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:37.921402    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:37.921743 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:37.921465    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:38.152726 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:38.152692    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" event={"ID":"58fccd04-c863-4e1c-9858-3ed1ff44d577","Type":"ContainerStarted","Data":"89c1bcb26ea423d4d83e3f1ee84c62fca6de6183077fe154c9c8cf593cec5d1d"}
Sep 11 16:43:38.153041 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:38.153022    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:38.154839 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:38.154779    2569 generic.go:356] "Generic (PLEG): container finished" podID="93a162ce-a718-4a34-9b4a-426bd6cdcca0" containerID="c22a518f52d6e7b812e0a405c979ab39c396b1f4834babf1d371b6be17bcde66" exitCode=0
Sep 11 16:43:38.154839 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:38.154838    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtvm7" event={"ID":"93a162ce-a718-4a34-9b4a-426bd6cdcca0","Type":"ContainerDied","Data":"c22a518f52d6e7b812e0a405c979ab39c396b1f4834babf1d371b6be17bcde66"}
Sep 11 16:43:38.169467 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:38.169443    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:38.190933 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:38.190896    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw" podStartSLOduration=9.538043924 podStartE2EDuration="28.190882607s" totalImagesPullingTime="18.652838683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:38.189563513 +0000 UTC m=+28.748954900" watchObservedRunningTime="2026-09-11 16:43:38.190882607 +0000 UTC m=+28.750274019"
Sep 11 16:43:38.565468 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:38.565385    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:39.082754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.082720    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5cdgz"]
Sep 11 16:43:39.083545 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.082887    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:39.083545 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:39.082999    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:39.086852 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.086618    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xgtkk"]
Sep 11 16:43:39.086972 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.086922    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:39.087066 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:39.087038    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:39.087319 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.087281    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxksk"]
Sep 11 16:43:39.087386 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.087372    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:39.087466 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:39.087449    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:39.159168 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.159136    2569 generic.go:356] "Generic (PLEG): container finished" podID="93a162ce-a718-4a34-9b4a-426bd6cdcca0" containerID="bc1d7d891c1dc2773d72fab64c5347f9e1ddd2e6faeba572f0a3f0d68e3f88e6" exitCode=0
Sep 11 16:43:39.159320 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.159220    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtvm7" event={"ID":"93a162ce-a718-4a34-9b4a-426bd6cdcca0","Type":"ContainerDied","Data":"bc1d7d891c1dc2773d72fab64c5347f9e1ddd2e6faeba572f0a3f0d68e3f88e6"}
Sep 11 16:43:39.159625 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.159603    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:39.174780 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:39.174761    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:43:40.160598 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:40.160497    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v64tp_880d46a9-faf3-4a41-94aa-67a41da118ea/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:40.163643 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:40.163621    2569 generic.go:356] "Generic (PLEG): container finished" podID="93a162ce-a718-4a34-9b4a-426bd6cdcca0" containerID="4dd50c3ff38def093114a1d6b032d1e0677d109535151c55138bb9382ef7ad37" exitCode=0
Sep 11 16:43:40.163759 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:40.163694    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtvm7" event={"ID":"93a162ce-a718-4a34-9b4a-426bd6cdcca0","Type":"ContainerDied","Data":"4dd50c3ff38def093114a1d6b032d1e0677d109535151c55138bb9382ef7ad37"}
Sep 11 16:43:40.268533 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:40.268502    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v64tp_880d46a9-faf3-4a41-94aa-67a41da118ea/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:40.921056 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:40.920965    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:40.921196 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:40.920974    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:40.921196 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:40.921079    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:40.921196 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:40.921100    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:40.921318 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:40.921197    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:40.921318 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:40.921267    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:42.920944 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:42.920912    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:42.920944 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:42.920932    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:42.920944 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:42.920941    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:42.921431 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:42.921055    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xgtkk" podUID="e2d1bde7-0bee-4822-bb66-0c75f276c565"
Sep 11 16:43:42.921431 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:42.921119    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxksk" podUID="f761960a-5ee4-4ce3-a071-2ac47c95f963"
Sep 11 16:43:42.921431 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:42.921199    2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5cdgz" podUID="35671487-b20e-4f06-9350-038748458891"
Sep 11 16:43:43.122034 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:43.121958    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v64tp_880d46a9-faf3-4a41-94aa-67a41da118ea/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:43.228084 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:43.228054    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v64tp_880d46a9-faf3-4a41-94aa-67a41da118ea/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:43.625485 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:43.625450    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:43.625684 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:43.625656    2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:43.625756 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:43.625744    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret podName:f761960a-5ee4-4ce3-a071-2ac47c95f963 nodeName:}" failed. No retries permitted until 2026-09-11 16:44:15.625714775 +0000 UTC m=+66.185106159 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret") pod "global-pull-secret-syncer-xxksk" (UID: "f761960a-5ee4-4ce3-a071-2ac47c95f963") : object "kube-system"/"original-pull-secret" not registered
Sep 11 16:43:43.726120 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:43.726088    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:43.726308 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:43.726237    2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:43.726308 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:43.726300    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs podName:e2d1bde7-0bee-4822-bb66-0c75f276c565 nodeName:}" failed. No retries permitted until 2026-09-11 16:44:15.726278725 +0000 UTC m=+66.285670094 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs") pod "network-metrics-daemon-xgtkk" (UID: "e2d1bde7-0bee-4822-bb66-0c75f276c565") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 16:43:43.827257 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:43.827215    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:43.827480 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:43.827411    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 16:43:43.827480 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:43.827438    2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 16:43:43.827480 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:43.827452    2569 projected.go:196] Error preparing data for projected volume kube-api-access-pmch4 for pod openshift-network-diagnostics/network-check-target-5cdgz: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:43.827616 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:43.827519    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4 podName:35671487-b20e-4f06-9350-038748458891 nodeName:}" failed. No retries permitted until 2026-09-11 16:44:15.827500944 +0000 UTC m=+66.386892314 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pmch4" (UniqueName: "kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4") pod "network-check-target-5cdgz" (UID: "35671487-b20e-4f06-9350-038748458891") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 16:43:44.627516 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.627478    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v64tp_880d46a9-faf3-4a41-94aa-67a41da118ea/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:44.711526 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.711498    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v64tp_880d46a9-faf3-4a41-94aa-67a41da118ea/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:44.778354 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.778296    2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-153.ec2.internal" event="NodeReady"
Sep 11 16:43:44.778454 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.778388    2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 16:43:44.837014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.836989    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-665d4779d7-c978d"]
Sep 11 16:43:44.858846 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.858823    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:44.865376 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.865149    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ptp2z\""
Sep 11 16:43:44.865376 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.865198    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 16:43:44.870373 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.870353    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zpks4"]
Sep 11 16:43:44.870711 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.870697    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 16:43:44.870813 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.870721    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 16:43:44.880100 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.880085    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 16:43:44.890410 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.890395    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:44.905456 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:44.905435    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-dockercfg-wbvg9\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wbvg9\"" type="*v1.Secret"
Sep 11 16:43:44.906687 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:44.906665    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-default-metrics-tls\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret"
Sep 11 16:43:44.906821 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:44.906684    2569 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"dns-default\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap"
Sep 11 16:43:44.910856 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.910828    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-665d4779d7-c978d"]
Sep 11 16:43:44.911520 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.911499    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zpks4"]
Sep 11 16:43:44.921025 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.921006    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:43:44.921113 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.921040    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:43:44.921113 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.921012    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:43:44.925343 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.925323    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 16:43:44.925435 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.925354    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dw8q7\""
Sep 11 16:43:44.925494 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.925435    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 16:43:44.925494 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.925464    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 16:43:44.925643 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.925627    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xdv2\""
Sep 11 16:43:44.925827 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.925792    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 16:43:44.935853 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.935833    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:44.935940 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.935871    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-image-registry-private-configuration\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:44.935940 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.935920    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-trusted-ca\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:44.936030 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.936013    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-certificates\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:44.936068 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.936045    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qmx7\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-kube-api-access-7qmx7\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:44.936100 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.936072    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-installation-pull-secrets\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:44.936100 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.936092    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-bound-sa-token\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:44.936196 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.936133    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0505cbd6-8ed4-4dac-aedc-2918078355fc-ca-trust-extracted\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:44.942117 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.942072    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vhxk6"]
Sep 11 16:43:44.963170 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.963152    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vhxk6"
Sep 11 16:43:44.968620 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.968601    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7nrk4\""
Sep 11 16:43:44.968927 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.968913    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 16:43:44.969624 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.969602    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 16:43:44.975551 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.975535    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 16:43:44.982585 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:44.982565    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vhxk6"]
Sep 11 16:43:45.037165 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-certificates\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.037165 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037124    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qmx7\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-kube-api-access-7qmx7\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.037165 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037148    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a9bb07f-b6d4-4857-8275-0379dc808b2b-tmp-dir\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.037415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037167    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.037415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037195    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-installation-pull-secrets\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.037415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037220    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-bound-sa-token\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.037415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037242    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a9bb07f-b6d4-4857-8275-0379dc808b2b-config-volume\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.037415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0505cbd6-8ed4-4dac-aedc-2918078355fc-ca-trust-extracted\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.037415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037321    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bv7p\" (UniqueName: \"kubernetes.io/projected/8a9bb07f-b6d4-4857-8275-0379dc808b2b-kube-api-access-9bv7p\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.037415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037368    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.037415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037392    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqhhf\" (UniqueName: \"kubernetes.io/projected/0a39c11e-d284-48e4-a93d-ee72a2f106a1-kube-api-access-pqhhf\") pod \"ingress-canary-vhxk6\" (UID: \"0a39c11e-d284-48e4-a93d-ee72a2f106a1\") " pod="openshift-ingress-canary/ingress-canary-vhxk6"
Sep 11 16:43:45.037838 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037428    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-image-registry-private-configuration\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.037838 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037453    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-trusted-ca\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.037838 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037473    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a39c11e-d284-48e4-a93d-ee72a2f106a1-cert\") pod \"ingress-canary-vhxk6\" (UID: \"0a39c11e-d284-48e4-a93d-ee72a2f106a1\") " pod="openshift-ingress-canary/ingress-canary-vhxk6"
Sep 11 16:43:45.037838 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:45.037605    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:43:45.037838 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:45.037622    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665d4779d7-c978d: secret "image-registry-tls" not found
Sep 11 16:43:45.037838 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037759    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-certificates\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.037838 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.037770    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0505cbd6-8ed4-4dac-aedc-2918078355fc-ca-trust-extracted\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.038115 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:45.037999    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls podName:0505cbd6-8ed4-4dac-aedc-2918078355fc nodeName:}" failed. No retries permitted until 2026-09-11 16:43:45.537978542 +0000 UTC m=+36.097369922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls") pod "image-registry-665d4779d7-c978d" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc") : secret "image-registry-tls" not found
Sep 11 16:43:45.038697 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.038665    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-trusted-ca\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.041447 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.041432    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-installation-pull-secrets\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.041495 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.041444    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-image-registry-private-configuration\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.048697 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.048669    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-bound-sa-token\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.048776 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.048673    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qmx7\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-kube-api-access-7qmx7\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.106728 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.106692    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v64tp_880d46a9-faf3-4a41-94aa-67a41da118ea/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:45.138253 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.138233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a9bb07f-b6d4-4857-8275-0379dc808b2b-tmp-dir\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.138374 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.138260    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.138374 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.138298    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a9bb07f-b6d4-4857-8275-0379dc808b2b-config-volume\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.138374 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.138333    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bv7p\" (UniqueName: \"kubernetes.io/projected/8a9bb07f-b6d4-4857-8275-0379dc808b2b-kube-api-access-9bv7p\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.138517 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.138389    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqhhf\" (UniqueName: \"kubernetes.io/projected/0a39c11e-d284-48e4-a93d-ee72a2f106a1-kube-api-access-pqhhf\") pod \"ingress-canary-vhxk6\" (UID: \"0a39c11e-d284-48e4-a93d-ee72a2f106a1\") " pod="openshift-ingress-canary/ingress-canary-vhxk6"
Sep 11 16:43:45.138517 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.138421    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a39c11e-d284-48e4-a93d-ee72a2f106a1-cert\") pod \"ingress-canary-vhxk6\" (UID: \"0a39c11e-d284-48e4-a93d-ee72a2f106a1\") " pod="openshift-ingress-canary/ingress-canary-vhxk6"
Sep 11 16:43:45.138617 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.138587    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a9bb07f-b6d4-4857-8275-0379dc808b2b-tmp-dir\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.140922 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.140904    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a39c11e-d284-48e4-a93d-ee72a2f106a1-cert\") pod \"ingress-canary-vhxk6\" (UID: \"0a39c11e-d284-48e4-a93d-ee72a2f106a1\") " pod="openshift-ingress-canary/ingress-canary-vhxk6"
Sep 11 16:43:45.147562 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.147540    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bv7p\" (UniqueName: \"kubernetes.io/projected/8a9bb07f-b6d4-4857-8275-0379dc808b2b-kube-api-access-9bv7p\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:45.147643 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.147569    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqhhf\" (UniqueName: \"kubernetes.io/projected/0a39c11e-d284-48e4-a93d-ee72a2f106a1-kube-api-access-pqhhf\") pod \"ingress-canary-vhxk6\" (UID: \"0a39c11e-d284-48e4-a93d-ee72a2f106a1\") " pod="openshift-ingress-canary/ingress-canary-vhxk6"
Sep 11 16:43:45.206045 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.206014    2569 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-v64tp_880d46a9-faf3-4a41-94aa-67a41da118ea/konnectivity-agent/0.log" limit=1024
Sep 11 16:43:45.270162 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.270139    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vhxk6"
Sep 11 16:43:45.542078 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.541858    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:45.542268 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:45.542001    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:43:45.542268 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:45.542113    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665d4779d7-c978d: secret "image-registry-tls" not found
Sep 11 16:43:45.542268 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:45.542183    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls podName:0505cbd6-8ed4-4dac-aedc-2918078355fc nodeName:}" failed. No retries permitted until 2026-09-11 16:43:46.542160863 +0000 UTC m=+37.101552248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls") pod "image-registry-665d4779d7-c978d" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc") : secret "image-registry-tls" not found
Sep 11 16:43:45.604139 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.604110    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vhxk6"]
Sep 11 16:43:45.608666 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:45.608641    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a39c11e_d284_48e4_a93d_ee72a2f106a1.slice/crio-4e1d6b27501f864fe06426ee10728dae77667e9565c5b4a49b0ccff5262aa47c WatchSource:0}: Error finding container 4e1d6b27501f864fe06426ee10728dae77667e9565c5b4a49b0ccff5262aa47c: Status 404 returned error can't find the container with id 4e1d6b27501f864fe06426ee10728dae77667e9565c5b4a49b0ccff5262aa47c
Sep 11 16:43:45.762496 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.762466    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 16:43:45.769010 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:45.768991    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8a9bb07f-b6d4-4857-8275-0379dc808b2b-config-volume\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:46.067740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:46.067713    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 16:43:46.068724 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:46.068706    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:43:46.068785 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:46.068775    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls podName:8a9bb07f-b6d4-4857-8275-0379dc808b2b nodeName:}" failed. No retries permitted until 2026-09-11 16:43:46.56875438 +0000 UTC m=+37.128145759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls") pod "dns-default-zpks4" (UID: "8a9bb07f-b6d4-4857-8275-0379dc808b2b") : secret "dns-default-metrics-tls" not found
Sep 11 16:43:46.181476 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:46.181440    2569 generic.go:356] "Generic (PLEG): container finished" podID="93a162ce-a718-4a34-9b4a-426bd6cdcca0" containerID="11ff9b3c434d3e8e6bfb3e9509769e71b829a67262219d75dd34e81c18a13e41" exitCode=0
Sep 11 16:43:46.181642 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:46.181555    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtvm7" event={"ID":"93a162ce-a718-4a34-9b4a-426bd6cdcca0","Type":"ContainerDied","Data":"11ff9b3c434d3e8e6bfb3e9509769e71b829a67262219d75dd34e81c18a13e41"}
Sep 11 16:43:46.182909 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:46.182884    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vhxk6" event={"ID":"0a39c11e-d284-48e4-a93d-ee72a2f106a1","Type":"ContainerStarted","Data":"4e1d6b27501f864fe06426ee10728dae77667e9565c5b4a49b0ccff5262aa47c"}
Sep 11 16:43:46.302091 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:46.302039    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wbvg9\""
Sep 11 16:43:46.549271 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:46.549232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:46.549439 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:46.549362    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:43:46.549439 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:46.549375    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665d4779d7-c978d: secret "image-registry-tls" not found
Sep 11 16:43:46.549439 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:46.549432    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls podName:0505cbd6-8ed4-4dac-aedc-2918078355fc nodeName:}" failed. No retries permitted until 2026-09-11 16:43:48.549412551 +0000 UTC m=+39.108803916 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls") pod "image-registry-665d4779d7-c978d" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc") : secret "image-registry-tls" not found
Sep 11 16:43:46.650306 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:46.650226    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:46.650461 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:46.650353    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:43:46.650461 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:46.650417    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls podName:8a9bb07f-b6d4-4857-8275-0379dc808b2b nodeName:}" failed. No retries permitted until 2026-09-11 16:43:47.650399295 +0000 UTC m=+38.209790679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls") pod "dns-default-zpks4" (UID: "8a9bb07f-b6d4-4857-8275-0379dc808b2b") : secret "dns-default-metrics-tls" not found
Sep 11 16:43:47.189576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:47.189532    2569 generic.go:356] "Generic (PLEG): container finished" podID="93a162ce-a718-4a34-9b4a-426bd6cdcca0" containerID="6bac7d3ddae0572e257cab57faca3036704056700964d3bcbcc6e51ddff4734d" exitCode=0
Sep 11 16:43:47.189576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:47.189555    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtvm7" event={"ID":"93a162ce-a718-4a34-9b4a-426bd6cdcca0","Type":"ContainerDied","Data":"6bac7d3ddae0572e257cab57faca3036704056700964d3bcbcc6e51ddff4734d"}
Sep 11 16:43:47.659387 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:47.659342    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:47.659551 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:47.659513    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:43:47.659593 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:47.659583    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls podName:8a9bb07f-b6d4-4857-8275-0379dc808b2b nodeName:}" failed. No retries permitted until 2026-09-11 16:43:49.659566787 +0000 UTC m=+40.218958171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls") pod "dns-default-zpks4" (UID: "8a9bb07f-b6d4-4857-8275-0379dc808b2b") : secret "dns-default-metrics-tls" not found
Sep 11 16:43:48.195085 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:48.194881    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtvm7" event={"ID":"93a162ce-a718-4a34-9b4a-426bd6cdcca0","Type":"ContainerStarted","Data":"3492b9e1565323fa97dbb3acce080b11b47d3a1da81ebcf5e2120370313d0c82"}
Sep 11 16:43:48.219196 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:48.219139    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mtvm7" podStartSLOduration=8.349972281 podStartE2EDuration="38.219119154s" totalImagesPullingTime="29.869146873s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:48.217837415 +0000 UTC m=+38.777228801" watchObservedRunningTime="2026-09-11 16:43:48.219119154 +0000 UTC m=+38.778510542"
Sep 11 16:43:48.568268 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:48.568230    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:48.568410 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:48.568384    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:43:48.568410 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:48.568404    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665d4779d7-c978d: secret "image-registry-tls" not found
Sep 11 16:43:48.568474 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:48.568462    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls podName:0505cbd6-8ed4-4dac-aedc-2918078355fc nodeName:}" failed. No retries permitted until 2026-09-11 16:43:52.568444611 +0000 UTC m=+43.127835975 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls") pod "image-registry-665d4779d7-c978d" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc") : secret "image-registry-tls" not found
Sep 11 16:43:49.198931 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:49.198901    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vhxk6" event={"ID":"0a39c11e-d284-48e4-a93d-ee72a2f106a1","Type":"ContainerStarted","Data":"6289513273a52a68f905ed6025f7c78037bea8f92af422005c273927105ded68"}
Sep 11 16:43:49.215173 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:49.215087    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vhxk6" podStartSLOduration=2.717388342 podStartE2EDuration="5.215071969s" totalImagesPullingTime="2.497683627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:49.214964916 +0000 UTC m=+39.774356304" watchObservedRunningTime="2026-09-11 16:43:49.215071969 +0000 UTC m=+39.774463357"
Sep 11 16:43:49.676449 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:49.676376    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:49.676578 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:49.676477    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:43:49.676578 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:49.676525    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls podName:8a9bb07f-b6d4-4857-8275-0379dc808b2b nodeName:}" failed. No retries permitted until 2026-09-11 16:43:53.676512841 +0000 UTC m=+44.235904206 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls") pod "dns-default-zpks4" (UID: "8a9bb07f-b6d4-4857-8275-0379dc808b2b") : secret "dns-default-metrics-tls" not found
Sep 11 16:43:52.597540 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:52.597499    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:43:52.597927 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:52.597658    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:43:52.597927 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:52.597680    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665d4779d7-c978d: secret "image-registry-tls" not found
Sep 11 16:43:52.597927 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:52.597737    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls podName:0505cbd6-8ed4-4dac-aedc-2918078355fc nodeName:}" failed. No retries permitted until 2026-09-11 16:44:00.597722282 +0000 UTC m=+51.157113651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls") pod "image-registry-665d4779d7-c978d" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc") : secret "image-registry-tls" not found
Sep 11 16:43:53.705296 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:53.705260    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:43:53.705685 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:53.705393    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:43:53.705685 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:53.705455    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls podName:8a9bb07f-b6d4-4857-8275-0379dc808b2b nodeName:}" failed. No retries permitted until 2026-09-11 16:44:01.705441827 +0000 UTC m=+52.264833210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls") pod "dns-default-zpks4" (UID: "8a9bb07f-b6d4-4857-8275-0379dc808b2b") : secret "dns-default-metrics-tls" not found
Sep 11 16:43:55.691978 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:55.691943    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq"]
Sep 11 16:43:55.731949 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:55.731918    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq"]
Sep 11 16:43:55.732099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:55.732018    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq"
Sep 11 16:43:55.734612 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:55.734595    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-25bxt\""
Sep 11 16:43:55.735135 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:55.735115    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 16:43:55.735181 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:55.735137    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 16:43:55.821258 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:55.821227    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gmjs\" (UniqueName: \"kubernetes.io/projected/7a23f8fd-95ac-4629-8848-519384e530a3-kube-api-access-4gmjs\") pod \"migrator-8b4d697c5-llgdq\" (UID: \"7a23f8fd-95ac-4629-8848-519384e530a3\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq"
Sep 11 16:43:55.921688 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:55.921658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gmjs\" (UniqueName: \"kubernetes.io/projected/7a23f8fd-95ac-4629-8848-519384e530a3-kube-api-access-4gmjs\") pod \"migrator-8b4d697c5-llgdq\" (UID: \"7a23f8fd-95ac-4629-8848-519384e530a3\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq"
Sep 11 16:43:55.931721 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:55.931698    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gmjs\" (UniqueName: \"kubernetes.io/projected/7a23f8fd-95ac-4629-8848-519384e530a3-kube-api-access-4gmjs\") pod \"migrator-8b4d697c5-llgdq\" (UID: \"7a23f8fd-95ac-4629-8848-519384e530a3\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq"
Sep 11 16:43:56.040779 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.040706    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq"
Sep 11 16:43:56.335301 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.335236    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq"]
Sep 11 16:43:56.338312 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:43:56.338285    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a23f8fd_95ac_4629_8848_519384e530a3.slice/crio-08893326a323e4f3a78ec800f75fcf24d096642f7739ce585ffce78f53fcc8de WatchSource:0}: Error finding container 08893326a323e4f3a78ec800f75fcf24d096642f7739ce585ffce78f53fcc8de: Status 404 returned error can't find the container with id 08893326a323e4f3a78ec800f75fcf24d096642f7739ce585ffce78f53fcc8de
Sep 11 16:43:56.819847 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.819811    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hxlzb"]
Sep 11 16:43:56.853041 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.853012    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hxlzb"]
Sep 11 16:43:56.853182 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.853126    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:56.855341 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.855319    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 16:43:56.855603 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.855582    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 16:43:56.855722 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.855649    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 16:43:56.855722 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.855648    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 16:43:56.855827 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:56.855790    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zkcq\""
Sep 11 16:43:57.029741 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.029708    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31d9734e-3785-4700-84ab-fd7599cd1f4a-data-volume\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.029931 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.029757    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8stnv\" (UniqueName: \"kubernetes.io/projected/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-api-access-8stnv\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.029931 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.029813    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.029931 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.029837    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.029931 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.029874    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31d9734e-3785-4700-84ab-fd7599cd1f4a-crio-socket\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.131129 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.131047    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8stnv\" (UniqueName: \"kubernetes.io/projected/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-api-access-8stnv\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.131129 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.131087    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.131129 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.131106    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.131379 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.131138    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31d9734e-3785-4700-84ab-fd7599cd1f4a-crio-socket\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.131379 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:57.131185    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:43:57.131379 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.131256    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31d9734e-3785-4700-84ab-fd7599cd1f4a-data-volume\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.131379 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:57.131279    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:43:57.131379 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:57.131316    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:43:57.631295779 +0000 UTC m=+48.190687166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : configmap "kube-rbac-proxy" not found
Sep 11 16:43:57.131379 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:57.131343    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:43:57.631326925 +0000 UTC m=+48.190718290 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:43:57.131618 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.131453    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/31d9734e-3785-4700-84ab-fd7599cd1f4a-crio-socket\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.131618 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.131571    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/31d9734e-3785-4700-84ab-fd7599cd1f4a-data-volume\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.140567 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.140541    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8stnv\" (UniqueName: \"kubernetes.io/projected/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-api-access-8stnv\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.218104 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.218073    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq" event={"ID":"7a23f8fd-95ac-4629-8848-519384e530a3","Type":"ContainerStarted","Data":"08893326a323e4f3a78ec800f75fcf24d096642f7739ce585ffce78f53fcc8de"}
Sep 11 16:43:57.635193 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.635158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.635381 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:57.635204    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:57.635381 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:57.635290    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:43:57.635381 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:57.635361    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:43:58.635345245 +0000 UTC m=+49.194736630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : configmap "kube-rbac-proxy" not found
Sep 11 16:43:57.635510 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:57.635391    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:43:57.635510 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:57.635444    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:43:58.635432207 +0000 UTC m=+49.194823596 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:43:58.222555 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:58.222523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq" event={"ID":"7a23f8fd-95ac-4629-8848-519384e530a3","Type":"ContainerStarted","Data":"4f9cc7fed99d7ff2a9ff991ecf543b6f0e7539b89c1ecd8f20b8d3283abd0226"}
Sep 11 16:43:58.222875 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:58.222585    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq" event={"ID":"7a23f8fd-95ac-4629-8848-519384e530a3","Type":"ContainerStarted","Data":"54539d28e44c0caf208f9e98c131087da324a0bf60595377839f8208522e39c3"}
Sep 11 16:43:58.238330 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:58.238253    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-llgdq" podStartSLOduration=1.603509674 podStartE2EDuration="3.238234865s" totalImagesPullingTime="1.634725191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:43:58.237456157 +0000 UTC m=+48.796847544" watchObservedRunningTime="2026-09-11 16:43:58.238234865 +0000 UTC m=+48.797626249"
Sep 11 16:43:58.642520 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:58.642432    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:58.642520 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:58.642470    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:43:58.642706 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:58.642548    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:43:58.642706 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:58.642563    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:43:58.642706 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:58.642609    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:44:00.642594518 +0000 UTC m=+51.201985883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : configmap "kube-rbac-proxy" not found
Sep 11 16:43:58.642706 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:43:58.642623    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:44:00.64261687 +0000 UTC m=+51.202008234 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:43:59.397154 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.397125    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vztfz_6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5/dns-node-resolver/0.log"
Sep 11 16:43:59.405546 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.405519    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-f8qgj"]
Sep 11 16:43:59.430241 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.430221    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.434233 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.434211    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-f8qgj"]
Sep 11 16:43:59.439188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.439169    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 16:43:59.439287 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.439209    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 16:43:59.440213 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.440197    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 16:43:59.440295 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.440198    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 16:43:59.440373 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.440201    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xx924\""
Sep 11 16:43:59.548360 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.548326    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f710f7fa-29d9-48d3-9631-71e3b408cb30-signing-key\") pod \"service-ca-568869fdc5-f8qgj\" (UID: \"f710f7fa-29d9-48d3-9631-71e3b408cb30\") " pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.548360 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.548360    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f710f7fa-29d9-48d3-9631-71e3b408cb30-signing-cabundle\") pod \"service-ca-568869fdc5-f8qgj\" (UID: \"f710f7fa-29d9-48d3-9631-71e3b408cb30\") " pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.548557 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.548387    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wj2l\" (UniqueName: \"kubernetes.io/projected/f710f7fa-29d9-48d3-9631-71e3b408cb30-kube-api-access-5wj2l\") pod \"service-ca-568869fdc5-f8qgj\" (UID: \"f710f7fa-29d9-48d3-9631-71e3b408cb30\") " pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.649099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.649006    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f710f7fa-29d9-48d3-9631-71e3b408cb30-signing-key\") pod \"service-ca-568869fdc5-f8qgj\" (UID: \"f710f7fa-29d9-48d3-9631-71e3b408cb30\") " pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.649099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.649048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f710f7fa-29d9-48d3-9631-71e3b408cb30-signing-cabundle\") pod \"service-ca-568869fdc5-f8qgj\" (UID: \"f710f7fa-29d9-48d3-9631-71e3b408cb30\") " pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.649099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.649069    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wj2l\" (UniqueName: \"kubernetes.io/projected/f710f7fa-29d9-48d3-9631-71e3b408cb30-kube-api-access-5wj2l\") pod \"service-ca-568869fdc5-f8qgj\" (UID: \"f710f7fa-29d9-48d3-9631-71e3b408cb30\") " pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.649793 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.649774    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f710f7fa-29d9-48d3-9631-71e3b408cb30-signing-cabundle\") pod \"service-ca-568869fdc5-f8qgj\" (UID: \"f710f7fa-29d9-48d3-9631-71e3b408cb30\") " pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.651645 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.651619    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f710f7fa-29d9-48d3-9631-71e3b408cb30-signing-key\") pod \"service-ca-568869fdc5-f8qgj\" (UID: \"f710f7fa-29d9-48d3-9631-71e3b408cb30\") " pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.660560 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.660537    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wj2l\" (UniqueName: \"kubernetes.io/projected/f710f7fa-29d9-48d3-9631-71e3b408cb30-kube-api-access-5wj2l\") pod \"service-ca-568869fdc5-f8qgj\" (UID: \"f710f7fa-29d9-48d3-9631-71e3b408cb30\") " pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.739493 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.739459    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-f8qgj"
Sep 11 16:43:59.989199 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:43:59.989174    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dqgwp_61af0db4-55a1-48f1-9f49-d97573ee4ebf/node-ca/0.log"
Sep 11 16:44:00.030878 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:00.030850    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-f8qgj"]
Sep 11 16:44:00.032235 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:00.032211    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf710f7fa_29d9_48d3_9631_71e3b408cb30.slice/crio-643b7eb5bebd76a678cc86bd2d15fcf7395df0506b0a958c841ad23d6b616dc0 WatchSource:0}: Error finding container 643b7eb5bebd76a678cc86bd2d15fcf7395df0506b0a958c841ad23d6b616dc0: Status 404 returned error can't find the container with id 643b7eb5bebd76a678cc86bd2d15fcf7395df0506b0a958c841ad23d6b616dc0
Sep 11 16:44:00.228423 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:00.228389    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-f8qgj" event={"ID":"f710f7fa-29d9-48d3-9631-71e3b408cb30","Type":"ContainerStarted","Data":"643b7eb5bebd76a678cc86bd2d15fcf7395df0506b0a958c841ad23d6b616dc0"}
Sep 11 16:44:00.658421 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:00.658382    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:44:00.658909 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:00.658483    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:00.658909 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:00.658565    2569 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 16:44:00.658909 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:00.658591    2569 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-665d4779d7-c978d: secret "image-registry-tls" not found
Sep 11 16:44:00.658909 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:00.658602    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:44:00.658909 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:00.658650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:00.658909 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:00.658664    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:44:04.658644717 +0000 UTC m=+55.218036095 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : configmap "kube-rbac-proxy" not found
Sep 11 16:44:00.658909 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:00.658686    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls podName:0505cbd6-8ed4-4dac-aedc-2918078355fc nodeName:}" failed. No retries permitted until 2026-09-11 16:44:16.65867651 +0000 UTC m=+67.218067875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls") pod "image-registry-665d4779d7-c978d" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc") : secret "image-registry-tls" not found
Sep 11 16:44:00.658909 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:00.658737    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:44:00.658909 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:00.658771    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:44:04.658764168 +0000 UTC m=+55.218155532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:44:00.778993 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:00.778954    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vhxk6_0a39c11e-d284-48e4-a93d-ee72a2f106a1/serve-healthcheck-canary/0.log"
Sep 11 16:44:01.179836 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:01.179787    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-llgdq_7a23f8fd-95ac-4629-8848-519384e530a3/migrator/0.log"
Sep 11 16:44:01.379521 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:01.379488    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-llgdq_7a23f8fd-95ac-4629-8848-519384e530a3/graceful-termination/0.log"
Sep 11 16:44:01.769427 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:01.769394    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:44:01.769901 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:01.769568    2569 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 16:44:01.769901 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:01.769656    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls podName:8a9bb07f-b6d4-4857-8275-0379dc808b2b nodeName:}" failed. No retries permitted until 2026-09-11 16:44:17.769637866 +0000 UTC m=+68.329029250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls") pod "dns-default-zpks4" (UID: "8a9bb07f-b6d4-4857-8275-0379dc808b2b") : secret "dns-default-metrics-tls" not found
Sep 11 16:44:02.235432 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:02.235395    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-f8qgj" event={"ID":"f710f7fa-29d9-48d3-9631-71e3b408cb30","Type":"ContainerStarted","Data":"393d72c6310aa3ad25954d3df518337c86b8bfaab119679282a352b9e9b050e6"}
Sep 11 16:44:02.252464 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:02.252416    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-f8qgj" podStartSLOduration=1.1394613439999999 podStartE2EDuration="3.252400002s" totalImagesPullingTime="2.112938658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:02.251523769 +0000 UTC m=+52.810915155" watchObservedRunningTime="2026-09-11 16:44:02.252400002 +0000 UTC m=+52.811791389"
Sep 11 16:44:04.693168 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:04.693131    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:04.693515 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:04.693174    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:04.693515 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:04.693256    2569 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 16:44:04.693515 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:04.693279    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:44:04.693515 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:04.693324    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:44:12.693310029 +0000 UTC m=+63.252701406 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:44:04.693515 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:04.693338    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:44:12.693329848 +0000 UTC m=+63.252721214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : configmap "kube-rbac-proxy" not found
Sep 11 16:44:11.176411 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:11.176382    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5tfmw"
Sep 11 16:44:12.754964 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:12.754920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:12.754964 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:12.754966    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:12.755412 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:12.755098    2569 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 16:44:12.755412 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:12.755153    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls podName:31d9734e-3785-4700-84ab-fd7599cd1f4a nodeName:}" failed. No retries permitted until 2026-09-11 16:44:28.755139845 +0000 UTC m=+79.314531224 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hxlzb" (UID: "31d9734e-3785-4700-84ab-fd7599cd1f4a") : secret "insights-runtime-extractor-tls" not found
Sep 11 16:44:12.755486 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:12.755445    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/31d9734e-3785-4700-84ab-fd7599cd1f4a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:15.675620 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.675587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:44:15.678185 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.678170    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 16:44:15.688351 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.688329    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f761960a-5ee4-4ce3-a071-2ac47c95f963-original-pull-secret\") pod \"global-pull-secret-syncer-xxksk\" (UID: \"f761960a-5ee4-4ce3-a071-2ac47c95f963\") " pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:44:15.775949 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.775913    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:44:15.778231 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.778213    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 16:44:15.789183 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.789157    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e2d1bde7-0bee-4822-bb66-0c75f276c565-metrics-certs\") pod \"network-metrics-daemon-xgtkk\" (UID: \"e2d1bde7-0bee-4822-bb66-0c75f276c565\") " pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:44:15.835536 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.835505    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dw8q7\""
Sep 11 16:44:15.838212 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.838199    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxksk"
Sep 11 16:44:15.844427 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.844407    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xgtkk"
Sep 11 16:44:15.876407 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.876384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:44:15.878469 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.878448    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 16:44:15.889199 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.889181    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 16:44:15.900365 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:15.900342    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmch4\" (UniqueName: \"kubernetes.io/projected/35671487-b20e-4f06-9350-038748458891-kube-api-access-pmch4\") pod \"network-check-target-5cdgz\" (UID: \"35671487-b20e-4f06-9350-038748458891\") " pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:44:16.139858 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.139827    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxksk"]
Sep 11 16:44:16.142462 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:16.142439    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf761960a_5ee4_4ce3_a071_2ac47c95f963.slice/crio-c57d45d2b6858259cf23206edeaa70b680cdddd5844dda4023b7da81bfde4f39 WatchSource:0}: Error finding container c57d45d2b6858259cf23206edeaa70b680cdddd5844dda4023b7da81bfde4f39: Status 404 returned error can't find the container with id c57d45d2b6858259cf23206edeaa70b680cdddd5844dda4023b7da81bfde4f39
Sep 11 16:44:16.145135 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.145115    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xdv2\""
Sep 11 16:44:16.153835 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.153814    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:44:16.170572 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.170553    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xgtkk"]
Sep 11 16:44:16.173390 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:16.173373    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d1bde7_0bee_4822_bb66_0c75f276c565.slice/crio-27d853bb0e7f0baf8f3817851b8cbcb5b66c88f87f49ab0736bfe0fa594b308f WatchSource:0}: Error finding container 27d853bb0e7f0baf8f3817851b8cbcb5b66c88f87f49ab0736bfe0fa594b308f: Status 404 returned error can't find the container with id 27d853bb0e7f0baf8f3817851b8cbcb5b66c88f87f49ab0736bfe0fa594b308f
Sep 11 16:44:16.271852 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.271823    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xgtkk" event={"ID":"e2d1bde7-0bee-4822-bb66-0c75f276c565","Type":"ContainerStarted","Data":"27d853bb0e7f0baf8f3817851b8cbcb5b66c88f87f49ab0736bfe0fa594b308f"}
Sep 11 16:44:16.272892 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.272869    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxksk" event={"ID":"f761960a-5ee4-4ce3-a071-2ac47c95f963","Type":"ContainerStarted","Data":"c57d45d2b6858259cf23206edeaa70b680cdddd5844dda4023b7da81bfde4f39"}
Sep 11 16:44:16.451979 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.451909    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5cdgz"]
Sep 11 16:44:16.455355 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:16.455322    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35671487_b20e_4f06_9350_038748458891.slice/crio-fd5d28f9d5ca385ba9f53d1c345c2a18798d4968461e35189306eeaf95baec51 WatchSource:0}: Error finding container fd5d28f9d5ca385ba9f53d1c345c2a18798d4968461e35189306eeaf95baec51: Status 404 returned error can't find the container with id fd5d28f9d5ca385ba9f53d1c345c2a18798d4968461e35189306eeaf95baec51
Sep 11 16:44:16.682752 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.682570    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:44:16.685616 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.685570    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"image-registry-665d4779d7-c978d\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") " pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:44:16.969831 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.969781    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ptp2z\""
Sep 11 16:44:16.978207 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:16.978038    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:44:17.278224 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:17.278188    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5cdgz" event={"ID":"35671487-b20e-4f06-9350-038748458891","Type":"ContainerStarted","Data":"fd5d28f9d5ca385ba9f53d1c345c2a18798d4968461e35189306eeaf95baec51"}
Sep 11 16:44:17.535035 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:17.535001    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-665d4779d7-c978d"]
Sep 11 16:44:17.542697 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:17.542666    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0505cbd6_8ed4_4dac_aedc_2918078355fc.slice/crio-83d4e85a3aad0be2eae83396cf094c12570e37ef148cb8cb947650ee86578b61 WatchSource:0}: Error finding container 83d4e85a3aad0be2eae83396cf094c12570e37ef148cb8cb947650ee86578b61: Status 404 returned error can't find the container with id 83d4e85a3aad0be2eae83396cf094c12570e37ef148cb8cb947650ee86578b61
Sep 11 16:44:17.793608 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:17.793230    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:44:17.798164 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:17.798111    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8a9bb07f-b6d4-4857-8275-0379dc808b2b-metrics-tls\") pod \"dns-default-zpks4\" (UID: \"8a9bb07f-b6d4-4857-8275-0379dc808b2b\") " pod="openshift-dns/dns-default-zpks4"
Sep 11 16:44:17.900034 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:17.900000    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wbvg9\""
Sep 11 16:44:17.908920 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:17.908881    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zpks4"
Sep 11 16:44:18.200138 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:18.200034    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zpks4"]
Sep 11 16:44:18.204275 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:18.204235    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9bb07f_b6d4_4857_8275_0379dc808b2b.slice/crio-518954639eb75b8217a1e99cdc030585dcf70594a9e35fb0a3ac26c501e4f98c WatchSource:0}: Error finding container 518954639eb75b8217a1e99cdc030585dcf70594a9e35fb0a3ac26c501e4f98c: Status 404 returned error can't find the container with id 518954639eb75b8217a1e99cdc030585dcf70594a9e35fb0a3ac26c501e4f98c
Sep 11 16:44:18.289700 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:18.289662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zpks4" event={"ID":"8a9bb07f-b6d4-4857-8275-0379dc808b2b","Type":"ContainerStarted","Data":"518954639eb75b8217a1e99cdc030585dcf70594a9e35fb0a3ac26c501e4f98c"}
Sep 11 16:44:18.292710 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:18.292682    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-665d4779d7-c978d" event={"ID":"0505cbd6-8ed4-4dac-aedc-2918078355fc","Type":"ContainerStarted","Data":"a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f"}
Sep 11 16:44:18.292932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:18.292916    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:44:18.293062 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:18.293047    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-665d4779d7-c978d" event={"ID":"0505cbd6-8ed4-4dac-aedc-2918078355fc","Type":"ContainerStarted","Data":"83d4e85a3aad0be2eae83396cf094c12570e37ef148cb8cb947650ee86578b61"}
Sep 11 16:44:18.297008 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:18.296983    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xgtkk" event={"ID":"e2d1bde7-0bee-4822-bb66-0c75f276c565","Type":"ContainerStarted","Data":"8632b2333be46f3c016cd4014206011debdf39bd86867327b7449ab2e061f3dc"}
Sep 11 16:44:18.297092 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:18.297032    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xgtkk" event={"ID":"e2d1bde7-0bee-4822-bb66-0c75f276c565","Type":"ContainerStarted","Data":"df2c07b705801ff66361b0b7a8e93b0a606ccf937b66667970a35595599cab16"}
Sep 11 16:44:18.334035 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:18.333982    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xgtkk" podStartSLOduration=67.207825077 podStartE2EDuration="1m8.333961536s" totalImagesPullingTime="1.126136459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:18.333389448 +0000 UTC m=+68.892780836" watchObservedRunningTime="2026-09-11 16:44:18.333961536 +0000 UTC m=+68.893352925"
Sep 11 16:44:18.334186 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:18.334151    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-665d4779d7-c978d" podStartSLOduration=42.334141937 podStartE2EDuration="42.334141937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:18.316417823 +0000 UTC m=+68.875809211" watchObservedRunningTime="2026-09-11 16:44:18.334141937 +0000 UTC m=+68.893533326"
Sep 11 16:44:21.879962 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:21.879190    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-665d4779d7-c978d"]
Sep 11 16:44:22.313408 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:22.313373    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxksk" event={"ID":"f761960a-5ee4-4ce3-a071-2ac47c95f963","Type":"ContainerStarted","Data":"b43364986a346372df9cb3107629900ab0cc00a14af74d7658eb3f407ce17c12"}
Sep 11 16:44:22.315273 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:22.315246    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zpks4" event={"ID":"8a9bb07f-b6d4-4857-8275-0379dc808b2b","Type":"ContainerStarted","Data":"54f120f07c1c9ae3c7534dc6a6eff73a4eb9a9696c99aeeef1f7847b3115ea79"}
Sep 11 16:44:22.315401 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:22.315292    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zpks4" event={"ID":"8a9bb07f-b6d4-4857-8275-0379dc808b2b","Type":"ContainerStarted","Data":"0b04faba31e0608dbf2901979f3b3142a383eb021027d420cf46e34f0f28540b"}
Sep 11 16:44:22.315401 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:22.315312    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zpks4"
Sep 11 16:44:22.316781 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:22.316763    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5cdgz" event={"ID":"35671487-b20e-4f06-9350-038748458891","Type":"ContainerStarted","Data":"ecd4afdc027ac6c83fddb9881f22420dd87d1c3ac800121a15d3aa2be8da01ef"}
Sep 11 16:44:22.316867 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:22.316839    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:44:22.337064 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:22.337022    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xxksk" podStartSLOduration=66.646067494 podStartE2EDuration="1m12.337008348s" totalImagesPullingTime="5.690940854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:22.336335087 +0000 UTC m=+72.895726478" watchObservedRunningTime="2026-09-11 16:44:22.337008348 +0000 UTC m=+72.896399726"
Sep 11 16:44:22.380909 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:22.380868    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5cdgz" podStartSLOduration=67.002959765 podStartE2EDuration="1m12.380853916s" totalImagesPullingTime="5.377894151s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:22.379910944 +0000 UTC m=+72.939302333" watchObservedRunningTime="2026-09-11 16:44:22.380853916 +0000 UTC m=+72.940245304"
Sep 11 16:44:22.381208 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:22.381189    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zpks4" podStartSLOduration=34.747658908 podStartE2EDuration="38.381184266s" totalImagesPullingTime="3.633525358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:43:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:22.361040444 +0000 UTC m=+72.920431825" watchObservedRunningTime="2026-09-11 16:44:22.381184266 +0000 UTC m=+72.940575655"
Sep 11 16:44:28.773977 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:28.773922    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:28.776294 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:28.776274    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/31d9734e-3785-4700-84ab-fd7599cd1f4a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hxlzb\" (UID: \"31d9734e-3785-4700-84ab-fd7599cd1f4a\") " pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:28.964706 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:28.964673    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9zkcq\""
Sep 11 16:44:28.972522 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:28.972501    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hxlzb"
Sep 11 16:44:29.103947 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.103876    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f97c8c5fd-dszq2"]
Sep 11 16:44:29.107867 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.107852    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.110300 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.110270    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 16:44:29.110300 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.110273    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 16:44:29.110474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.110273    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-czrjz\""
Sep 11 16:44:29.110474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.110359    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 16:44:29.110474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.110435    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 16:44:29.110971 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.110955    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 16:44:29.111293 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.111277    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 16:44:29.111293 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.111292    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 16:44:29.116183 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.116153    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 16:44:29.118642 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.118625    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f97c8c5fd-dszq2"]
Sep 11 16:44:29.176026 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.176000    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bht6g\" (UniqueName: \"kubernetes.io/projected/520556db-d2ba-4344-937c-84350758bcb8-kube-api-access-bht6g\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.176026 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.176028    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-trusted-ca-bundle\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.176209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.176052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-console-config\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.176209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.176076    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-service-ca\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.176209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.176131    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-oauth-serving-cert\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.176209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.176171    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-serving-cert\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.176209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.176207    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-oauth-config\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.247355 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.247336    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hxlzb"]
Sep 11 16:44:29.276646 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.276626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-console-config\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.276752 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.276658    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-service-ca\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.276752 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.276680    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-oauth-serving-cert\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.276752 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.276699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-serving-cert\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.276752 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.276722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-oauth-config\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.276965 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.276755    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bht6g\" (UniqueName: \"kubernetes.io/projected/520556db-d2ba-4344-937c-84350758bcb8-kube-api-access-bht6g\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.276965 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.276784    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-trusted-ca-bundle\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.277436 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.277360    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-console-config\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.277640 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.277512    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-oauth-serving-cert\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.277640 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.277591    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-trusted-ca-bundle\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.277766 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.277616    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-service-ca\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.279179 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.279155    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-oauth-config\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.279290 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.279268    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-serving-cert\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.284470 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.284449    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bht6g\" (UniqueName: \"kubernetes.io/projected/520556db-d2ba-4344-937c-84350758bcb8-kube-api-access-bht6g\") pod \"console-5f97c8c5fd-dszq2\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") " pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.342606 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.342563    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxlzb" event={"ID":"31d9734e-3785-4700-84ab-fd7599cd1f4a","Type":"ContainerStarted","Data":"2e48e7adc35bb17d96b4c147e666f1b4e754454e82fd16b96c68e0e6dd3865d0"}
Sep 11 16:44:29.342746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.342626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxlzb" event={"ID":"31d9734e-3785-4700-84ab-fd7599cd1f4a","Type":"ContainerStarted","Data":"ca6ac35bf7be722004be7fe8fe3143477b622cc3260f8f02bf54434028ff2084"}
Sep 11 16:44:29.418049 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.417980    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:29.697578 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:29.697550    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f97c8c5fd-dszq2"]
Sep 11 16:44:29.700626 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:29.700601    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod520556db_d2ba_4344_937c_84350758bcb8.slice/crio-31f47ec0dff7691da49e0d758fd70d131210ceeac4b019fde58c55a7a82d81a3 WatchSource:0}: Error finding container 31f47ec0dff7691da49e0d758fd70d131210ceeac4b019fde58c55a7a82d81a3: Status 404 returned error can't find the container with id 31f47ec0dff7691da49e0d758fd70d131210ceeac4b019fde58c55a7a82d81a3
Sep 11 16:44:30.347675 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.347590    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f97c8c5fd-dszq2" event={"ID":"520556db-d2ba-4344-937c-84350758bcb8","Type":"ContainerStarted","Data":"31f47ec0dff7691da49e0d758fd70d131210ceeac4b019fde58c55a7a82d81a3"}
Sep 11 16:44:30.349537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.349512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxlzb" event={"ID":"31d9734e-3785-4700-84ab-fd7599cd1f4a","Type":"ContainerStarted","Data":"1db3356eccd3448f665360fb7d909101dff7967813cfe6c12ac6b776a49f9dd3"}
Sep 11 16:44:30.459435 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.459396    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"]
Sep 11 16:44:30.462902 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.462872    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.466483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.465767    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ftc8h\""
Sep 11 16:44:30.466483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.465868    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 16:44:30.466483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.465999    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 16:44:30.466483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.466157    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 16:44:30.466483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.466181    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 16:44:30.466483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.466332    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 16:44:30.466483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.466382    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 16:44:30.474984 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.474958    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mn29k"]
Sep 11 16:44:30.479709 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.479541    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.480079 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.480062    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"]
Sep 11 16:44:30.483239 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.483218    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 16:44:30.483566 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.483541    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7dzm5\""
Sep 11 16:44:30.483790 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.483773    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 16:44:30.484131 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.484110    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586200    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17e74aef-6d15-4a65-957a-ab0fbb614b9a-sys\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586257    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586283    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-wtmp\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586311    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-tls\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586343    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/25d1cc38-84b2-4411-91d8-e6e84c23f922-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586369    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/17e74aef-6d15-4a65-957a-ab0fbb614b9a-root\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586421    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25d1cc38-84b2-4411-91d8-e6e84c23f922-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586443    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfm84\" (UniqueName: \"kubernetes.io/projected/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-api-access-cfm84\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586464    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e74aef-6d15-4a65-957a-ab0fbb614b9a-metrics-client-ca\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586485    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586512    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586529    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjdpt\" (UniqueName: \"kubernetes.io/projected/17e74aef-6d15-4a65-957a-ab0fbb614b9a-kube-api-access-mjdpt\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586546    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-textfile\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.586690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.586563    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.687874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.687587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17e74aef-6d15-4a65-957a-ab0fbb614b9a-sys\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.687874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.687638    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.687874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.687666    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-wtmp\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.687874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.687692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-tls\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.687874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.687719    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/25d1cc38-84b2-4411-91d8-e6e84c23f922-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.687874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.687746    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.687874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.687769    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/17e74aef-6d15-4a65-957a-ab0fbb614b9a-root\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.690485 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:30.688896    2569 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 11 16:44:30.690485 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:30.688969    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-tls podName:25d1cc38-84b2-4411-91d8-e6e84c23f922 nodeName:}" failed. No retries permitted until 2026-09-11 16:44:31.188946775 +0000 UTC m=+81.748338163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-5jpz5" (UID: "25d1cc38-84b2-4411-91d8-e6e84c23f922") : secret "kube-state-metrics-tls" not found
Sep 11 16:44:30.690485 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.689232    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/17e74aef-6d15-4a65-957a-ab0fbb614b9a-sys\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.690485 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.689365    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-wtmp\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.690485 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.690119    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.690485 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.690381    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/25d1cc38-84b2-4411-91d8-e6e84c23f922-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.690485 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.690437    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/17e74aef-6d15-4a65-957a-ab0fbb614b9a-root\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.692077 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.691471    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25d1cc38-84b2-4411-91d8-e6e84c23f922-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.692077 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.691514    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/25d1cc38-84b2-4411-91d8-e6e84c23f922-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.692077 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.691559    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfm84\" (UniqueName: \"kubernetes.io/projected/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-api-access-cfm84\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.692077 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.691585    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e74aef-6d15-4a65-957a-ab0fbb614b9a-metrics-client-ca\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.692077 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.691626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.692077 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.691670    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.692077 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.691696    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjdpt\" (UniqueName: \"kubernetes.io/projected/17e74aef-6d15-4a65-957a-ab0fbb614b9a-kube-api-access-mjdpt\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.692077 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.691725    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-textfile\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.692077 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.691750    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.692529 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.692277    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17e74aef-6d15-4a65-957a-ab0fbb614b9a-metrics-client-ca\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.694849 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.694362    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-textfile\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.694978 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.694852    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-accelerators-collector-config\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.696725 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.696700    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-tls\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.702180 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.702152    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17e74aef-6d15-4a65-957a-ab0fbb614b9a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.702833 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.702810    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.703432 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.703394    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfm84\" (UniqueName: \"kubernetes.io/projected/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-api-access-cfm84\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:30.706520 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.706496    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjdpt\" (UniqueName: \"kubernetes.io/projected/17e74aef-6d15-4a65-957a-ab0fbb614b9a-kube-api-access-mjdpt\") pod \"node-exporter-mn29k\" (UID: \"17e74aef-6d15-4a65-957a-ab0fbb614b9a\") " pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.791720 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:30.791680    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mn29k"
Sep 11 16:44:30.810130 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:30.810097    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e74aef_6d15_4a65_957a_ab0fbb614b9a.slice/crio-4ddf8bc50badb913abe493227d82990fb6de1cc1ab952305870739692313a92c WatchSource:0}: Error finding container 4ddf8bc50badb913abe493227d82990fb6de1cc1ab952305870739692313a92c: Status 404 returned error can't find the container with id 4ddf8bc50badb913abe493227d82990fb6de1cc1ab952305870739692313a92c
Sep 11 16:44:31.196226 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.196101    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:31.198839 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.198812    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/25d1cc38-84b2-4411-91d8-e6e84c23f922-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-5jpz5\" (UID: \"25d1cc38-84b2-4411-91d8-e6e84c23f922\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:31.355042 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.355007    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mn29k" event={"ID":"17e74aef-6d15-4a65-957a-ab0fbb614b9a","Type":"ContainerStarted","Data":"4ddf8bc50badb913abe493227d82990fb6de1cc1ab952305870739692313a92c"}
Sep 11 16:44:31.378241 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.378210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"
Sep 11 16:44:31.520697 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.520620    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:44:31.525871 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.524413    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.526978 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.526953    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 16:44:31.527832 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.527224    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 16:44:31.527832 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.527439    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 16:44:31.527832 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.527467    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ccgd9\""
Sep 11 16:44:31.527832 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.527669    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 16:44:31.528734 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.528239    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 16:44:31.528734 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.528334    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 16:44:31.528734 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.528523    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 16:44:31.528734 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.528535    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 16:44:31.528734 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.528585    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 16:44:31.539078 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.538985    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:44:31.600431 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600388    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.600661 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600451    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.600661 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600480    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-out\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.600661 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600519    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-web-config\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.600661 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600543    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qn2s\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-kube-api-access-5qn2s\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.600661 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600619    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.600661 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.601053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600688    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.601053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600725    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.601053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600766    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.601053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600839    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.601053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600871    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.601053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.600894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.701490 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-web-config\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.701606 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701497    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qn2s\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-kube-api-access-5qn2s\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.701606 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701523    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701781    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701833    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701879    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701896    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701917    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.701940    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:31.702123    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-trusted-ca-bundle podName:c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c nodeName:}" failed. No retries permitted until 2026-09-11 16:44:32.202100744 +0000 UTC m=+82.761492125 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c") : configmap references non-existent config key: ca-bundle.crt
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.702430    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.702482    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.702526    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.702576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.702551    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-out\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.703900 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.703877    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.709475 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.709425    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-out\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.709862 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.709626    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.710199 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.710113    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-volume\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.710199 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.710184    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.710624 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.710577    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.710711 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.710631    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-web-config\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.711094 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.711072    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.711916 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.711892    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.712844 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.712823    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qn2s\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-kube-api-access-5qn2s\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.713028 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.713013    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:31.917980 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:31.917950    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5"]
Sep 11 16:44:32.207752 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:32.207709    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:32.208659 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:32.208631    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:32.322355 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:32.322327    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zpks4"
Sep 11 16:44:32.362514 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:32.362480    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hxlzb" event={"ID":"31d9734e-3785-4700-84ab-fd7599cd1f4a","Type":"ContainerStarted","Data":"727adbc41cb491b29e0796c08fed886e66a0a6473e04441a66fcf5ed09c8409f"}
Sep 11 16:44:32.437628 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:32.437598    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:44:32.819954 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:32.819918    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25d1cc38_84b2_4411_91d8_e6e84c23f922.slice/crio-7d205f45ce9f615fe49a1ee3360e2f0e0dce1e4d037a0f782861e12065b015ae WatchSource:0}: Error finding container 7d205f45ce9f615fe49a1ee3360e2f0e0dce1e4d037a0f782861e12065b015ae: Status 404 returned error can't find the container with id 7d205f45ce9f615fe49a1ee3360e2f0e0dce1e4d037a0f782861e12065b015ae
Sep 11 16:44:33.357680 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:33.357572    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hxlzb" podStartSLOduration=35.039320621 podStartE2EDuration="37.357550545s" totalImagesPullingTime="2.318229924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 16:43:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:32.386468179 +0000 UTC m=+82.945859566" watchObservedRunningTime="2026-09-11 16:44:33.357550545 +0000 UTC m=+83.916941934"
Sep 11 16:44:33.358436 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:33.358412    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:44:33.362992 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:33.362882    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b20005_1d20_4a10_bbbd_a78c3c5bdf3c.slice/crio-1616544cbbccef6211fea4073b7c13ded5319db48b76106b5890fd0d6ebae760 WatchSource:0}: Error finding container 1616544cbbccef6211fea4073b7c13ded5319db48b76106b5890fd0d6ebae760: Status 404 returned error can't find the container with id 1616544cbbccef6211fea4073b7c13ded5319db48b76106b5890fd0d6ebae760
Sep 11 16:44:33.368430 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:33.368400    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f97c8c5fd-dszq2" event={"ID":"520556db-d2ba-4344-937c-84350758bcb8","Type":"ContainerStarted","Data":"74874640edf02f8cba6a8b24a7da1eb755f559141d4f11885092b0495cc057ca"}
Sep 11 16:44:33.370434 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:33.370413    2569 generic.go:356] "Generic (PLEG): container finished" podID="17e74aef-6d15-4a65-957a-ab0fbb614b9a" containerID="ae359d02a81da335ec02d37bce15977ca1745731bf6bec297f36e3287151dc87" exitCode=0
Sep 11 16:44:33.370533 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:33.370493    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mn29k" event={"ID":"17e74aef-6d15-4a65-957a-ab0fbb614b9a","Type":"ContainerDied","Data":"ae359d02a81da335ec02d37bce15977ca1745731bf6bec297f36e3287151dc87"}
Sep 11 16:44:33.371931 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:33.371910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerStarted","Data":"1616544cbbccef6211fea4073b7c13ded5319db48b76106b5890fd0d6ebae760"}
Sep 11 16:44:33.373450 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:33.373419    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5" event={"ID":"25d1cc38-84b2-4411-91d8-e6e84c23f922","Type":"ContainerStarted","Data":"7d205f45ce9f615fe49a1ee3360e2f0e0dce1e4d037a0f782861e12065b015ae"}
Sep 11 16:44:33.395630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:33.395588    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f97c8c5fd-dszq2" podStartSLOduration=1.018293753 podStartE2EDuration="4.395574503s" totalImagesPullingTime="3.37728075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:33.394572076 +0000 UTC m=+83.953963464" watchObservedRunningTime="2026-09-11 16:44:33.395574503 +0000 UTC m=+83.954965889"
Sep 11 16:44:34.380954 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.380920    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mn29k" event={"ID":"17e74aef-6d15-4a65-957a-ab0fbb614b9a","Type":"ContainerStarted","Data":"313ed65863274075c480d5bb81379660fb5d19e0b3ddfd98325d7c36a7a539d5"}
Sep 11 16:44:34.381382 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.380992    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mn29k" event={"ID":"17e74aef-6d15-4a65-957a-ab0fbb614b9a","Type":"ContainerStarted","Data":"b8ed0f0de9b8e7304444442f9e16693b87ef63c775dc7537a9b8e1fc5d2c8371"}
Sep 11 16:44:34.402052 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.401997    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mn29k" podStartSLOduration=2.064247643 podStartE2EDuration="4.401977744s" totalImagesPullingTime="2.267581708s" totalInitContainerRuntime="70.148393ms" isStatefulPod=true podCreationTimestamp="2026-09-11 16:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:34.400719778 +0000 UTC m=+84.960111187" watchObservedRunningTime="2026-09-11 16:44:34.401977744 +0000 UTC m=+84.961369318"
Sep 11 16:44:34.762556 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.762525    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-59cb5dd857-tpc8h"]
Sep 11 16:44:34.766959 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.766937    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.769568 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.769363    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7z2dq\""
Sep 11 16:44:34.769941 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.769917    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 16:44:34.770072 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.769943    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 16:44:34.770215 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.770197    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 16:44:34.770310 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.770249    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 16:44:34.770405 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.770381    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-clehfje2b2c8k\""
Sep 11 16:44:34.780463 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.780439    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59cb5dd857-tpc8h"]
Sep 11 16:44:34.830385 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.830362    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a50fe3bf-e56b-4088-b9e1-d496fbad1465-secret-metrics-server-client-certs\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.830492 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.830391    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a50fe3bf-e56b-4088-b9e1-d496fbad1465-client-ca-bundle\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.830492 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.830423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a50fe3bf-e56b-4088-b9e1-d496fbad1465-secret-metrics-server-tls\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.830492 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.830450    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a50fe3bf-e56b-4088-b9e1-d496fbad1465-metrics-server-audit-profiles\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.830492 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.830478    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdpl5\" (UniqueName: \"kubernetes.io/projected/a50fe3bf-e56b-4088-b9e1-d496fbad1465-kube-api-access-vdpl5\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.830662 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.830503    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a50fe3bf-e56b-4088-b9e1-d496fbad1465-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.830662 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.830525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a50fe3bf-e56b-4088-b9e1-d496fbad1465-audit-log\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.932100 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.932011    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a50fe3bf-e56b-4088-b9e1-d496fbad1465-secret-metrics-server-client-certs\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.932100 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.932057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a50fe3bf-e56b-4088-b9e1-d496fbad1465-client-ca-bundle\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.932316 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.932104    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a50fe3bf-e56b-4088-b9e1-d496fbad1465-secret-metrics-server-tls\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.932316 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.932135    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a50fe3bf-e56b-4088-b9e1-d496fbad1465-metrics-server-audit-profiles\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.932316 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.932161    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdpl5\" (UniqueName: \"kubernetes.io/projected/a50fe3bf-e56b-4088-b9e1-d496fbad1465-kube-api-access-vdpl5\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.932316 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.932194    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a50fe3bf-e56b-4088-b9e1-d496fbad1465-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.932316 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.932219    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a50fe3bf-e56b-4088-b9e1-d496fbad1465-audit-log\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.932658 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.932638    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a50fe3bf-e56b-4088-b9e1-d496fbad1465-audit-log\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.933145 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.933121    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a50fe3bf-e56b-4088-b9e1-d496fbad1465-metrics-server-audit-profiles\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.933239 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.933205    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a50fe3bf-e56b-4088-b9e1-d496fbad1465-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.935063 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.935039    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a50fe3bf-e56b-4088-b9e1-d496fbad1465-client-ca-bundle\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.935333 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.935318    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a50fe3bf-e56b-4088-b9e1-d496fbad1465-secret-metrics-server-client-certs\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.935527 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.935505    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a50fe3bf-e56b-4088-b9e1-d496fbad1465-secret-metrics-server-tls\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:34.940390 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:34.940371    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdpl5\" (UniqueName: \"kubernetes.io/projected/a50fe3bf-e56b-4088-b9e1-d496fbad1465-kube-api-access-vdpl5\") pod \"metrics-server-59cb5dd857-tpc8h\" (UID: \"a50fe3bf-e56b-4088-b9e1-d496fbad1465\") " pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:35.092068 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.092028    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:35.364423 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.364395    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-59cb5dd857-tpc8h"]
Sep 11 16:44:35.367204 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:35.367178    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda50fe3bf_e56b_4088_b9e1_d496fbad1465.slice/crio-22ec26a0b39823cc9ba5559cf96651301dddf4c2aa8a5e61badc0c400f0b7fcf WatchSource:0}: Error finding container 22ec26a0b39823cc9ba5559cf96651301dddf4c2aa8a5e61badc0c400f0b7fcf: Status 404 returned error can't find the container with id 22ec26a0b39823cc9ba5559cf96651301dddf4c2aa8a5e61badc0c400f0b7fcf
Sep 11 16:44:35.386505 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.386483    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerID="ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28" exitCode=0
Sep 11 16:44:35.386874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.386561    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerDied","Data":"ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28"}
Sep 11 16:44:35.388861 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.388832    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5" event={"ID":"25d1cc38-84b2-4411-91d8-e6e84c23f922","Type":"ContainerStarted","Data":"1d50476860eecb464dc535cc1af74118c1331ce013b4e1295cc73fcc02df2829"}
Sep 11 16:44:35.388960 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.388894    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5" event={"ID":"25d1cc38-84b2-4411-91d8-e6e84c23f922","Type":"ContainerStarted","Data":"5fd7ccd2a03446f74e02448687c9a5a2970e4c4bea17c2d33a8d7f6c12031b58"}
Sep 11 16:44:35.388960 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.388923    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5" event={"ID":"25d1cc38-84b2-4411-91d8-e6e84c23f922","Type":"ContainerStarted","Data":"a6b5bd445677b49eaf384a1ff18efbf4e0ba11c6ff1e827b8bf6fde1b7ea9bc5"}
Sep 11 16:44:35.390181 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.390161    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h" event={"ID":"a50fe3bf-e56b-4088-b9e1-d496fbad1465","Type":"ContainerStarted","Data":"22ec26a0b39823cc9ba5559cf96651301dddf4c2aa8a5e61badc0c400f0b7fcf"}
Sep 11 16:44:35.434724 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.434677    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-5jpz5" podStartSLOduration=3.665345212 podStartE2EDuration="5.43466444s" totalImagesPullingTime="1.769319228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:35.434427953 +0000 UTC m=+85.993819341" watchObservedRunningTime="2026-09-11 16:44:35.43466444 +0000 UTC m=+85.994055840"
Sep 11 16:44:35.681437 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.681351    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-747fd97f8b-54d8h"]
Sep 11 16:44:35.690626 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.690600    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.693219 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.693198    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 16:44:35.693428 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.693409    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 16:44:35.693543 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.693440    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 16:44:35.693543 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.693481    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 16:44:35.693543 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.693506    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-w9d7z\""
Sep 11 16:44:35.693714 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.693691    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 16:44:35.699414 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.699389    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 16:44:35.700350 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.700311    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-747fd97f8b-54d8h"]
Sep 11 16:44:35.839835 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.839789    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-telemeter-client-tls\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.839835 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.839839    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3626dc1-e536-4891-9e47-a74700143b8d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.840020 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.839882    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-federate-client-tls\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.840020 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.839907    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3626dc1-e536-4891-9e47-a74700143b8d-serving-certs-ca-bundle\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.840020 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.839927    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3626dc1-e536-4891-9e47-a74700143b8d-metrics-client-ca\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.840020 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.839984    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2phwx\" (UniqueName: \"kubernetes.io/projected/d3626dc1-e536-4891-9e47-a74700143b8d-kube-api-access-2phwx\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.840134 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.840024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-secret-telemeter-client\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.840134 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.840063    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.940876 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.940855    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-secret-telemeter-client\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.941006 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.940895    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.941006 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.940921    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-telemeter-client-tls\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.941006 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.940944    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3626dc1-e536-4891-9e47-a74700143b8d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.941006 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.940988    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-federate-client-tls\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.941217 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.941020    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3626dc1-e536-4891-9e47-a74700143b8d-serving-certs-ca-bundle\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.941217 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.941048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3626dc1-e536-4891-9e47-a74700143b8d-metrics-client-ca\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.941217 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.941082    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2phwx\" (UniqueName: \"kubernetes.io/projected/d3626dc1-e536-4891-9e47-a74700143b8d-kube-api-access-2phwx\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.941921 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.941894    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3626dc1-e536-4891-9e47-a74700143b8d-serving-certs-ca-bundle\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.942054 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.941894    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d3626dc1-e536-4891-9e47-a74700143b8d-metrics-client-ca\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.942506 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.942481    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d3626dc1-e536-4891-9e47-a74700143b8d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.943557 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.943537    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.943974 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.943951    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-federate-client-tls\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.944073 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.943959    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-telemeter-client-tls\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.944073 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.944028    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d3626dc1-e536-4891-9e47-a74700143b8d-secret-telemeter-client\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:35.949343 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:35.949316    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2phwx\" (UniqueName: \"kubernetes.io/projected/d3626dc1-e536-4891-9e47-a74700143b8d-kube-api-access-2phwx\") pod \"telemeter-client-747fd97f8b-54d8h\" (UID: \"d3626dc1-e536-4891-9e47-a74700143b8d\") " pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:36.001531 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:36.001507    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h"
Sep 11 16:44:36.284585 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:36.284558    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-747fd97f8b-54d8h"]
Sep 11 16:44:36.285931 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:36.285907    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3626dc1_e536_4891_9e47_a74700143b8d.slice/crio-43fca0c9bf52e9fd22796780d1a3fb6792b3942b0ad9619c93c374fad41525b8 WatchSource:0}: Error finding container 43fca0c9bf52e9fd22796780d1a3fb6792b3942b0ad9619c93c374fad41525b8: Status 404 returned error can't find the container with id 43fca0c9bf52e9fd22796780d1a3fb6792b3942b0ad9619c93c374fad41525b8
Sep 11 16:44:36.301854 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:36.301789    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f97c8c5fd-dszq2"]
Sep 11 16:44:36.397662 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:36.397627    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h" event={"ID":"d3626dc1-e536-4891-9e47-a74700143b8d","Type":"ContainerStarted","Data":"43fca0c9bf52e9fd22796780d1a3fb6792b3942b0ad9619c93c374fad41525b8"}
Sep 11 16:44:38.408605 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:38.408576    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerStarted","Data":"5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22"}
Sep 11 16:44:38.408991 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:38.408660    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerStarted","Data":"068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4"}
Sep 11 16:44:38.408991 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:38.408710    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerStarted","Data":"efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d"}
Sep 11 16:44:38.408991 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:38.408752    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerStarted","Data":"ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709"}
Sep 11 16:44:38.408991 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:38.408792    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerStarted","Data":"b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c"}
Sep 11 16:44:38.410109 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:38.410079    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h" event={"ID":"a50fe3bf-e56b-4088-b9e1-d496fbad1465","Type":"ContainerStarted","Data":"9e84a5b6bc07c015b6e1424699cd16874306d4e6af0066fe7d98e13ebaf1e56e"}
Sep 11 16:44:38.428876 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:38.428832    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h" podStartSLOduration=2.461819634 podStartE2EDuration="4.428789916s" totalImagesPullingTime="1.966970282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:38.427177836 +0000 UTC m=+88.986569226" watchObservedRunningTime="2026-09-11 16:44:38.428789916 +0000 UTC m=+88.988181302"
Sep 11 16:44:39.416836 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:39.416785    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h" event={"ID":"d3626dc1-e536-4891-9e47-a74700143b8d","Type":"ContainerStarted","Data":"a2e8d7635fc808f35270f8b267b626779c2835b43fdcc90e46d4a610f7d08b1c"}
Sep 11 16:44:39.417270 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:39.416865    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h" event={"ID":"d3626dc1-e536-4891-9e47-a74700143b8d","Type":"ContainerStarted","Data":"9f00c2ca9ab36c76e77ebd3cecd5792cd85e39a82eefebef29010407a39c2868"}
Sep 11 16:44:39.417270 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:39.416894    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h" event={"ID":"d3626dc1-e536-4891-9e47-a74700143b8d","Type":"ContainerStarted","Data":"ab18300a138cf126760f33d010ec7e4987c22d1c629260d6d7e69d705617991e"}
Sep 11 16:44:39.418050 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:39.418032    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:44:39.420220 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:39.420198    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerStarted","Data":"bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc"}
Sep 11 16:44:39.443129 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:39.443087    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-747fd97f8b-54d8h" podStartSLOduration=2.369836075 podStartE2EDuration="4.443072742s" totalImagesPullingTime="2.073236667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:39.442010869 +0000 UTC m=+90.001402254" watchObservedRunningTime="2026-09-11 16:44:39.443072742 +0000 UTC m=+90.002464129"
Sep 11 16:44:39.470437 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:39.470392    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.175704114 podStartE2EDuration="8.470375716s" totalImagesPullingTime="4.277397117s" totalInitContainerRuntime="17.274485ms" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:39.469393439 +0000 UTC m=+90.028784826" watchObservedRunningTime="2026-09-11 16:44:39.470375716 +0000 UTC m=+90.029767107"
Sep 11 16:44:41.740726 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.740694    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b5d7c68cc-8vs9f"]
Sep 11 16:44:41.744885 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.744867    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.755312 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.755292    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5d7c68cc-8vs9f"]
Sep 11 16:44:41.885406 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.885380    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:44:41.896669 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.896650    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-trusted-ca-bundle\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.896746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.896687    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-oauth-serving-cert\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.896746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.896714    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-service-ca\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.896746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.896731    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9qjp\" (UniqueName: \"kubernetes.io/projected/a4626bb7-3511-4908-8086-814391bedc1a-kube-api-access-r9qjp\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.896867 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.896815    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-oauth-config\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.896867 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.896849    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-serving-cert\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.896947 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.896869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-console-config\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.997561 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.997478    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-trusted-ca-bundle\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.997561 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.997529    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-oauth-serving-cert\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.997925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.997602    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-service-ca\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.997925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.997629    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9qjp\" (UniqueName: \"kubernetes.io/projected/a4626bb7-3511-4908-8086-814391bedc1a-kube-api-access-r9qjp\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.997925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.997674    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-oauth-config\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.997925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.997714    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-serving-cert\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.997925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.997786    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-console-config\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.998204 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.998151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-oauth-serving-cert\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.998585 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.998562    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-trusted-ca-bundle\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.998665 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.998628    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-service-ca\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:41.998714 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:41.998674    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-console-config\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:42.000339 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:42.000317    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-serving-cert\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:42.000624 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:42.000604    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-oauth-config\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:42.012036 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:42.012013    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9qjp\" (UniqueName: \"kubernetes.io/projected/a4626bb7-3511-4908-8086-814391bedc1a-kube-api-access-r9qjp\") pod \"console-6b5d7c68cc-8vs9f\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") " pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:42.053924 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:42.053895    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:42.326507 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:42.326479    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b5d7c68cc-8vs9f"]
Sep 11 16:44:42.328935 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:44:42.328901    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4626bb7_3511_4908_8086_814391bedc1a.slice/crio-1454083f400f1836ed49d02b570b4354b7cb8ac93015a4f6f25c64fa085c5d6d WatchSource:0}: Error finding container 1454083f400f1836ed49d02b570b4354b7cb8ac93015a4f6f25c64fa085c5d6d: Status 404 returned error can't find the container with id 1454083f400f1836ed49d02b570b4354b7cb8ac93015a4f6f25c64fa085c5d6d
Sep 11 16:44:42.439603 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:42.439560    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5d7c68cc-8vs9f" event={"ID":"a4626bb7-3511-4908-8086-814391bedc1a","Type":"ContainerStarted","Data":"30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39"}
Sep 11 16:44:42.439756 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:42.439648    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5d7c68cc-8vs9f" event={"ID":"a4626bb7-3511-4908-8086-814391bedc1a","Type":"ContainerStarted","Data":"1454083f400f1836ed49d02b570b4354b7cb8ac93015a4f6f25c64fa085c5d6d"}
Sep 11 16:44:42.458321 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:42.458261    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b5d7c68cc-8vs9f" podStartSLOduration=1.458240965 podStartE2EDuration="1.458240965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:44:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:44:42.456104922 +0000 UTC m=+93.015496312" watchObservedRunningTime="2026-09-11 16:44:42.458240965 +0000 UTC m=+93.017632352"
Sep 11 16:44:46.907963 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:46.907921    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-665d4779d7-c978d" podUID="0505cbd6-8ed4-4dac-aedc-2918078355fc" containerName="registry" containerID="cri-o://a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f" gracePeriod=30
Sep 11 16:44:47.140094 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.140068    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:44:47.245717 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.245686    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0505cbd6-8ed4-4dac-aedc-2918078355fc-ca-trust-extracted\") pod \"0505cbd6-8ed4-4dac-aedc-2918078355fc\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") "
Sep 11 16:44:47.245901 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.245730    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-trusted-ca\") pod \"0505cbd6-8ed4-4dac-aedc-2918078355fc\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") "
Sep 11 16:44:47.245901 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.245764    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-certificates\") pod \"0505cbd6-8ed4-4dac-aedc-2918078355fc\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") "
Sep 11 16:44:47.245901 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.245823    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-installation-pull-secrets\") pod \"0505cbd6-8ed4-4dac-aedc-2918078355fc\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") "
Sep 11 16:44:47.246085 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.245998    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qmx7\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-kube-api-access-7qmx7\") pod \"0505cbd6-8ed4-4dac-aedc-2918078355fc\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") "
Sep 11 16:44:47.246085 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.246046    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-bound-sa-token\") pod \"0505cbd6-8ed4-4dac-aedc-2918078355fc\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") "
Sep 11 16:44:47.246188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.246094    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") pod \"0505cbd6-8ed4-4dac-aedc-2918078355fc\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") "
Sep 11 16:44:47.246188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.246128    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0505cbd6-8ed4-4dac-aedc-2918078355fc" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:44:47.246188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.246140    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-image-registry-private-configuration\") pod \"0505cbd6-8ed4-4dac-aedc-2918078355fc\" (UID: \"0505cbd6-8ed4-4dac-aedc-2918078355fc\") "
Sep 11 16:44:47.246335 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.246187    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0505cbd6-8ed4-4dac-aedc-2918078355fc" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:44:47.246440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.246417    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-trusted-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:44:47.246511 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.246449    2569 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-certificates\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:44:47.248829 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.248761    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0505cbd6-8ed4-4dac-aedc-2918078355fc" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:44:47.248829 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.248768    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0505cbd6-8ed4-4dac-aedc-2918078355fc" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:44:47.248829 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.248815    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0505cbd6-8ed4-4dac-aedc-2918078355fc" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:44:47.249062 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.248977    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-kube-api-access-7qmx7" (OuterVolumeSpecName: "kube-api-access-7qmx7") pod "0505cbd6-8ed4-4dac-aedc-2918078355fc" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc"). InnerVolumeSpecName "kube-api-access-7qmx7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:44:47.249062 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.248988    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0505cbd6-8ed4-4dac-aedc-2918078355fc" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:44:47.254542 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.254519    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0505cbd6-8ed4-4dac-aedc-2918078355fc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0505cbd6-8ed4-4dac-aedc-2918078355fc" (UID: "0505cbd6-8ed4-4dac-aedc-2918078355fc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:44:47.347063 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.347033    2569 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0505cbd6-8ed4-4dac-aedc-2918078355fc-ca-trust-extracted\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:44:47.347063 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.347060    2569 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-installation-pull-secrets\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:44:47.347063 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.347070    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qmx7\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-kube-api-access-7qmx7\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:44:47.347273 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.347081    2569 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-bound-sa-token\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:44:47.347273 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.347090    2569 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0505cbd6-8ed4-4dac-aedc-2918078355fc-registry-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:44:47.347273 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.347099    2569 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0505cbd6-8ed4-4dac-aedc-2918078355fc-image-registry-private-configuration\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:44:47.459314 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.459280    2569 generic.go:356] "Generic (PLEG): container finished" podID="0505cbd6-8ed4-4dac-aedc-2918078355fc" containerID="a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f" exitCode=0
Sep 11 16:44:47.459478 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.459332    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-665d4779d7-c978d"
Sep 11 16:44:47.459478 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.459369    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-665d4779d7-c978d" event={"ID":"0505cbd6-8ed4-4dac-aedc-2918078355fc","Type":"ContainerDied","Data":"a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f"}
Sep 11 16:44:47.459478 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.459423    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-665d4779d7-c978d" event={"ID":"0505cbd6-8ed4-4dac-aedc-2918078355fc","Type":"ContainerDied","Data":"83d4e85a3aad0be2eae83396cf094c12570e37ef148cb8cb947650ee86578b61"}
Sep 11 16:44:47.459478 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.459464    2569 scope.go:117] "RemoveContainer" containerID="a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f"
Sep 11 16:44:47.470971 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.470952    2569 scope.go:117] "RemoveContainer" containerID="a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f"
Sep 11 16:44:47.471245 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:44:47.471224    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f\": container with ID starting with a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f not found: ID does not exist" containerID="a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f"
Sep 11 16:44:47.471286 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.471253    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f"} err="failed to get container status \"a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f\": rpc error: code = NotFound desc = could not find container \"a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f\": container with ID starting with a6b3e9bbfa59bc2458a98a1757134e5c850941275f53a519c5f7697a017a671f not found: ID does not exist"
Sep 11 16:44:47.501354 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.501298    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-665d4779d7-c978d"]
Sep 11 16:44:47.518745 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.518722    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-665d4779d7-c978d"]
Sep 11 16:44:47.925512 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:47.925436    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0505cbd6-8ed4-4dac-aedc-2918078355fc" path="/var/lib/kubelet/pods/0505cbd6-8ed4-4dac-aedc-2918078355fc/volumes"
Sep 11 16:44:52.054999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:52.054969    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:52.055341 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:52.055029    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:52.060553 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:52.060532    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:52.484240 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:52.484208    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:44:53.321835 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:53.321793    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5cdgz"
Sep 11 16:44:55.092566 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:55.092539    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:44:55.092939 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:44:55.092588    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:45:01.328743 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.328672    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f97c8c5fd-dszq2" podUID="520556db-d2ba-4344-937c-84350758bcb8" containerName="console" containerID="cri-o://74874640edf02f8cba6a8b24a7da1eb755f559141d4f11885092b0495cc057ca" gracePeriod=15
Sep 11 16:45:01.516326 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.516298    2569 generic.go:356] "Generic (PLEG): container finished" podID="520556db-d2ba-4344-937c-84350758bcb8" containerID="74874640edf02f8cba6a8b24a7da1eb755f559141d4f11885092b0495cc057ca" exitCode=0
Sep 11 16:45:01.516478 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.516369    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f97c8c5fd-dszq2" event={"ID":"520556db-d2ba-4344-937c-84350758bcb8","Type":"ContainerDied","Data":"74874640edf02f8cba6a8b24a7da1eb755f559141d4f11885092b0495cc057ca"}
Sep 11 16:45:01.563218 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.563193    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:45:01.657255 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657168    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-oauth-serving-cert\") pod \"520556db-d2ba-4344-937c-84350758bcb8\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") "
Sep 11 16:45:01.657255 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657207    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-serving-cert\") pod \"520556db-d2ba-4344-937c-84350758bcb8\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") "
Sep 11 16:45:01.657255 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657224    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-oauth-config\") pod \"520556db-d2ba-4344-937c-84350758bcb8\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") "
Sep 11 16:45:01.657510 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657269    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-service-ca\") pod \"520556db-d2ba-4344-937c-84350758bcb8\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") "
Sep 11 16:45:01.657510 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657300    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bht6g\" (UniqueName: \"kubernetes.io/projected/520556db-d2ba-4344-937c-84350758bcb8-kube-api-access-bht6g\") pod \"520556db-d2ba-4344-937c-84350758bcb8\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") "
Sep 11 16:45:01.657510 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657368    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-trusted-ca-bundle\") pod \"520556db-d2ba-4344-937c-84350758bcb8\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") "
Sep 11 16:45:01.657510 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657398    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-console-config\") pod \"520556db-d2ba-4344-937c-84350758bcb8\" (UID: \"520556db-d2ba-4344-937c-84350758bcb8\") "
Sep 11 16:45:01.657712 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657537    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "520556db-d2ba-4344-937c-84350758bcb8" (UID: "520556db-d2ba-4344-937c-84350758bcb8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:01.657712 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657656    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-oauth-serving-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:01.657860 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657831    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-service-ca" (OuterVolumeSpecName: "service-ca") pod "520556db-d2ba-4344-937c-84350758bcb8" (UID: "520556db-d2ba-4344-937c-84350758bcb8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:01.657919 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657858    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "520556db-d2ba-4344-937c-84350758bcb8" (UID: "520556db-d2ba-4344-937c-84350758bcb8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:01.657919 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.657885    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-console-config" (OuterVolumeSpecName: "console-config") pod "520556db-d2ba-4344-937c-84350758bcb8" (UID: "520556db-d2ba-4344-937c-84350758bcb8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:01.659708 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.659679    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "520556db-d2ba-4344-937c-84350758bcb8" (UID: "520556db-d2ba-4344-937c-84350758bcb8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:01.659832 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.659733    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "520556db-d2ba-4344-937c-84350758bcb8" (UID: "520556db-d2ba-4344-937c-84350758bcb8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:01.659832 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.659763    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/520556db-d2ba-4344-937c-84350758bcb8-kube-api-access-bht6g" (OuterVolumeSpecName: "kube-api-access-bht6g") pod "520556db-d2ba-4344-937c-84350758bcb8" (UID: "520556db-d2ba-4344-937c-84350758bcb8"). InnerVolumeSpecName "kube-api-access-bht6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:01.758415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.758383    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-trusted-ca-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:01.758415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.758412    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-console-config\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:01.758415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.758421    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-serving-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:01.758630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.758429    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/520556db-d2ba-4344-937c-84350758bcb8-console-oauth-config\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:01.758630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.758440    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/520556db-d2ba-4344-937c-84350758bcb8-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:01.758630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:01.758449    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bht6g\" (UniqueName: \"kubernetes.io/projected/520556db-d2ba-4344-937c-84350758bcb8-kube-api-access-bht6g\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:02.521380 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:02.521349    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f97c8c5fd-dszq2"
Sep 11 16:45:02.521833 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:02.521349    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f97c8c5fd-dszq2" event={"ID":"520556db-d2ba-4344-937c-84350758bcb8","Type":"ContainerDied","Data":"31f47ec0dff7691da49e0d758fd70d131210ceeac4b019fde58c55a7a82d81a3"}
Sep 11 16:45:02.521833 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:02.521479    2569 scope.go:117] "RemoveContainer" containerID="74874640edf02f8cba6a8b24a7da1eb755f559141d4f11885092b0495cc057ca"
Sep 11 16:45:02.543925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:02.543898    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f97c8c5fd-dszq2"]
Sep 11 16:45:02.548220 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:02.548196    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f97c8c5fd-dszq2"]
Sep 11 16:45:03.925607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:03.925575    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="520556db-d2ba-4344-937c-84350758bcb8" path="/var/lib/kubelet/pods/520556db-d2ba-4344-937c-84350758bcb8/volumes"
Sep 11 16:45:15.098247 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:15.098220    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:45:15.102131 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:15.102101    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-59cb5dd857-tpc8h"
Sep 11 16:45:50.899854 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:50.899819    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:45:50.900308 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:50.900256    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="alertmanager" containerID="cri-o://b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c" gracePeriod=120
Sep 11 16:45:50.900380 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:50.900283    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy-web" containerID="cri-o://efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d" gracePeriod=120
Sep 11 16:45:50.900380 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:50.900315    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="prom-label-proxy" containerID="cri-o://bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc" gracePeriod=120
Sep 11 16:45:50.900487 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:50.900272    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy-metric" containerID="cri-o://5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22" gracePeriod=120
Sep 11 16:45:50.900487 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:50.900447    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy" containerID="cri-o://068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4" gracePeriod=120
Sep 11 16:45:50.900580 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:50.900347    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="config-reloader" containerID="cri-o://ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709" gracePeriod=120
Sep 11 16:45:51.704193 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:51.704161    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerID="bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc" exitCode=0
Sep 11 16:45:51.704193 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:51.704187    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerID="068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4" exitCode=0
Sep 11 16:45:51.704193 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:51.704193    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerID="ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709" exitCode=0
Sep 11 16:45:51.704193 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:51.704200    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerID="b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c" exitCode=0
Sep 11 16:45:51.704439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:51.704230    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerDied","Data":"bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc"}
Sep 11 16:45:51.704439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:51.704288    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerDied","Data":"068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4"}
Sep 11 16:45:51.704439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:51.704314    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerDied","Data":"ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709"}
Sep 11 16:45:51.704439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:51.704337    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerDied","Data":"b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c"}
Sep 11 16:45:52.138736 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.138715    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.227196 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227168    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qn2s\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-kube-api-access-5qn2s\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227366 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227208    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227366 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227260    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-metrics-client-ca\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227366 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227285    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-tls-assets\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227366 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227325    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-main-db\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227573 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227448    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-web\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227573 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227495    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-main-tls\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227573 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227537    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-cluster-tls-config\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227729 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227578    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227729 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227627    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-web-config\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227729 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227653    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:45:52.227729 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227665    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-trusted-ca-bundle\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227729 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227686    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:52.227729 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227701    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-out\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.227729 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.227727    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-volume\") pod \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\" (UID: \"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c\") "
Sep 11 16:45:52.228098 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.228011    2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-main-db\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.228098 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.228029    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-metrics-client-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.229283 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.229187    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:45:52.230494 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.230468    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:52.231018 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.230887    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:52.231018 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.230965    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:52.232343 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.232299    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-volume" (OuterVolumeSpecName: "config-volume") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:52.232343 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.232310    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-kube-api-access-5qn2s" (OuterVolumeSpecName: "kube-api-access-5qn2s") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "kube-api-access-5qn2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:45:52.232863 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.232838    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:52.233023 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.233003    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:52.234221 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.234183    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-out" (OuterVolumeSpecName: "config-out") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:45:52.236176 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.236151    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:52.242021 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.241998    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-web-config" (OuterVolumeSpecName: "web-config") pod "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" (UID: "c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:45:52.328660 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328628    2569 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-cluster-tls-config\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328660 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328662    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328787 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328693    2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-web-config\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328787 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328702    2569 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328787 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328710    2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-out\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328787 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328720    2569 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328787 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328728    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qn2s\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-kube-api-access-5qn2s\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328787 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328736    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328787 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328745    2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-tls-assets\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328787 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328754    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.328787 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.328764    2569 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c-secret-alertmanager-main-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:45:52.711266 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.711235    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerID="5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22" exitCode=0
Sep 11 16:45:52.711266 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.711258    2569 generic.go:356] "Generic (PLEG): container finished" podID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerID="efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d" exitCode=0
Sep 11 16:45:52.711453 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.711290    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerDied","Data":"5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22"}
Sep 11 16:45:52.711453 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.711309    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.711453 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.711367    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerDied","Data":"efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d"}
Sep 11 16:45:52.711453 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.711394    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c","Type":"ContainerDied","Data":"1616544cbbccef6211fea4073b7c13ded5319db48b76106b5890fd0d6ebae760"}
Sep 11 16:45:52.711453 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.711424    2569 scope.go:117] "RemoveContainer" containerID="bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc"
Sep 11 16:45:52.721704 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.721686    2569 scope.go:117] "RemoveContainer" containerID="5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22"
Sep 11 16:45:52.728754 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.728739    2569 scope.go:117] "RemoveContainer" containerID="068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4"
Sep 11 16:45:52.735362 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.735339    2569 scope.go:117] "RemoveContainer" containerID="efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d"
Sep 11 16:45:52.739148 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.739124    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:45:52.741018 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.740994    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:45:52.743043 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.743026    2569 scope.go:117] "RemoveContainer" containerID="ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709"
Sep 11 16:45:52.749728 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.749714    2569 scope.go:117] "RemoveContainer" containerID="b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c"
Sep 11 16:45:52.756340 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.756325    2569 scope.go:117] "RemoveContainer" containerID="ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28"
Sep 11 16:45:52.762841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.762819    2569 scope.go:117] "RemoveContainer" containerID="bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc"
Sep 11 16:45:52.763282 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:45:52.763147    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc\": container with ID starting with bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc not found: ID does not exist" containerID="bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc"
Sep 11 16:45:52.763282 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.763183    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc"} err="failed to get container status \"bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc\": rpc error: code = NotFound desc = could not find container \"bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc\": container with ID starting with bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc not found: ID does not exist"
Sep 11 16:45:52.763282 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.763206    2569 scope.go:117] "RemoveContainer" containerID="5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22"
Sep 11 16:45:52.763548 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:45:52.763530    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22\": container with ID starting with 5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22 not found: ID does not exist" containerID="5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22"
Sep 11 16:45:52.763608 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.763557    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22"} err="failed to get container status \"5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22\": rpc error: code = NotFound desc = could not find container \"5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22\": container with ID starting with 5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22 not found: ID does not exist"
Sep 11 16:45:52.763608 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.763593    2569 scope.go:117] "RemoveContainer" containerID="068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4"
Sep 11 16:45:52.763886 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:45:52.763869    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4\": container with ID starting with 068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4 not found: ID does not exist" containerID="068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4"
Sep 11 16:45:52.763958 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.763894    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4"} err="failed to get container status \"068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4\": rpc error: code = NotFound desc = could not find container \"068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4\": container with ID starting with 068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4 not found: ID does not exist"
Sep 11 16:45:52.763958 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.763914    2569 scope.go:117] "RemoveContainer" containerID="efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d"
Sep 11 16:45:52.764198 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:45:52.764178    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d\": container with ID starting with efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d not found: ID does not exist" containerID="efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d"
Sep 11 16:45:52.764236 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.764205    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d"} err="failed to get container status \"efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d\": rpc error: code = NotFound desc = could not find container \"efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d\": container with ID starting with efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d not found: ID does not exist"
Sep 11 16:45:52.764236 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.764219    2569 scope.go:117] "RemoveContainer" containerID="ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709"
Sep 11 16:45:52.764447 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:45:52.764433    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709\": container with ID starting with ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709 not found: ID does not exist" containerID="ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709"
Sep 11 16:45:52.764485 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.764450    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709"} err="failed to get container status \"ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709\": rpc error: code = NotFound desc = could not find container \"ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709\": container with ID starting with ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709 not found: ID does not exist"
Sep 11 16:45:52.764485 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.764461    2569 scope.go:117] "RemoveContainer" containerID="b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c"
Sep 11 16:45:52.764682 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:45:52.764665    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c\": container with ID starting with b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c not found: ID does not exist" containerID="b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c"
Sep 11 16:45:52.764749 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.764690    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c"} err="failed to get container status \"b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c\": rpc error: code = NotFound desc = could not find container \"b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c\": container with ID starting with b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c not found: ID does not exist"
Sep 11 16:45:52.764749 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.764709    2569 scope.go:117] "RemoveContainer" containerID="ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28"
Sep 11 16:45:52.764962 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:45:52.764947    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28\": container with ID starting with ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28 not found: ID does not exist" containerID="ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28"
Sep 11 16:45:52.765000 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.764967    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28"} err="failed to get container status \"ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28\": rpc error: code = NotFound desc = could not find container \"ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28\": container with ID starting with ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28 not found: ID does not exist"
Sep 11 16:45:52.765000 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.764980    2569 scope.go:117] "RemoveContainer" containerID="bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc"
Sep 11 16:45:52.765195 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.765178    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc"} err="failed to get container status \"bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc\": rpc error: code = NotFound desc = could not find container \"bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc\": container with ID starting with bb1797c8d539c74c956449a03a57299b1e7780140f0ca5b09fa1c0f10422e1cc not found: ID does not exist"
Sep 11 16:45:52.765252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.765196    2569 scope.go:117] "RemoveContainer" containerID="5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22"
Sep 11 16:45:52.765415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.765397    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22"} err="failed to get container status \"5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22\": rpc error: code = NotFound desc = could not find container \"5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22\": container with ID starting with 5484e842c8300d0b70cb4af63b2cf77e06beabaaae0a3c8f89de072e063e6a22 not found: ID does not exist"
Sep 11 16:45:52.765466 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.765416    2569 scope.go:117] "RemoveContainer" containerID="068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4"
Sep 11 16:45:52.765624 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.765607    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4"} err="failed to get container status \"068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4\": rpc error: code = NotFound desc = could not find container \"068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4\": container with ID starting with 068c1d14ce87596346650ad24ce0819d7b436e4e9e208dcf6c88a5e97cdbbdf4 not found: ID does not exist"
Sep 11 16:45:52.765692 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.765625    2569 scope.go:117] "RemoveContainer" containerID="efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d"
Sep 11 16:45:52.765904 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.765883    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d"} err="failed to get container status \"efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d\": rpc error: code = NotFound desc = could not find container \"efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d\": container with ID starting with efc7f1c245f15a5c44d9747c13b5657f4925aca507275c5dc6007cbf44a88b6d not found: ID does not exist"
Sep 11 16:45:52.765953 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.765906    2569 scope.go:117] "RemoveContainer" containerID="ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709"
Sep 11 16:45:52.766148 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.766131    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709"} err="failed to get container status \"ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709\": rpc error: code = NotFound desc = could not find container \"ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709\": container with ID starting with ca64117c572bab1c026d21d4005988c2d16cdc8e1f19d66bad3c0490e94b5709 not found: ID does not exist"
Sep 11 16:45:52.766213 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.766150    2569 scope.go:117] "RemoveContainer" containerID="b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c"
Sep 11 16:45:52.766384 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.766368    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c"} err="failed to get container status \"b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c\": rpc error: code = NotFound desc = could not find container \"b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c\": container with ID starting with b210c0fe54426aa90fc1343dcae2648d19f2b8ec505e9238e69236a2bdd54f5c not found: ID does not exist"
Sep 11 16:45:52.766429 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.766384    2569 scope.go:117] "RemoveContainer" containerID="ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28"
Sep 11 16:45:52.766581 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.766565    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28"} err="failed to get container status \"ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28\": rpc error: code = NotFound desc = could not find container \"ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28\": container with ID starting with ba761bc3e0cb60c28586f8e043a4745669f16de55989df88ffdb8adee51dac28 not found: ID does not exist"
Sep 11 16:45:52.773416 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773331    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:45:52.773643 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773628    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0505cbd6-8ed4-4dac-aedc-2918078355fc" containerName="registry"
Sep 11 16:45:52.773689 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773647    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0505cbd6-8ed4-4dac-aedc-2918078355fc" containerName="registry"
Sep 11 16:45:52.773689 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773659    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy-web"
Sep 11 16:45:52.773689 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773665    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy-web"
Sep 11 16:45:52.773689 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773671    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="520556db-d2ba-4344-937c-84350758bcb8" containerName="console"
Sep 11 16:45:52.773689 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773676    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="520556db-d2ba-4344-937c-84350758bcb8" containerName="console"
Sep 11 16:45:52.773689 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773682    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="prom-label-proxy"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773687    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="prom-label-proxy"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773717    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="alertmanager"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773722    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="alertmanager"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773731    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="config-reloader"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773737    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="config-reloader"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773744    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773749    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773754    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy-metric"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773759    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy-metric"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773765    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="init-config-reloader"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773779    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="init-config-reloader"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773837    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy-web"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773844    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773849    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="520556db-d2ba-4344-937c-84350758bcb8" containerName="console"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773855    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="prom-label-proxy"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773860    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="alertmanager"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773866    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="config-reloader"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773870    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" containerName="kube-rbac-proxy-metric"
Sep 11 16:45:52.773894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.773875    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0505cbd6-8ed4-4dac-aedc-2918078355fc" containerName="registry"
Sep 11 16:45:52.778755 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.778741    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.782630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.782596    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 16:45:52.782733 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.782717    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 16:45:52.782781 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.782717    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 16:45:52.782843 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.782777    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 16:45:52.783520 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.783504    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 16:45:52.784264 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.784246    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 16:45:52.784349 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.784318    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 16:45:52.784405 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.784394    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 16:45:52.785159 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.785006    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-ccgd9\""
Sep 11 16:45:52.789642 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.789624    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 16:45:52.800260 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.800242    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:45:52.934851 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.934818    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-config-out\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.934851 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.934852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.934875    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.934894    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.934916    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.934934    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.934947    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-web-config\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.934981    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.935018    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.935033    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww954\" (UniqueName: \"kubernetes.io/projected/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-kube-api-access-ww954\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.935049    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935070 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.935067    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:52.935375 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:52.935083    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036325 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036240    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-config-out\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036325 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036284    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036517 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036408    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036517 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036443    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036517 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036469    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036517 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036491    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036686 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036515    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-web-config\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036727 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036683    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036766 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036746    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036835 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036774    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww954\" (UniqueName: \"kubernetes.io/projected/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-kube-api-access-ww954\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036835 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036826    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036940 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036862    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.036940 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.036888    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.039428 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.037967    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.039428 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.038517    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.039428 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.039312    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.039639 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.039532    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-web-config\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.039639 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.039537    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-config-out\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.039639 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.039561    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.039785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.039696    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.039785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.039725    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.040162 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.040145    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.040414 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.040394    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.041516 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.041497    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-config-volume\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.041600 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.041588    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-tls-assets\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.046745 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.046726    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww954\" (UniqueName: \"kubernetes.io/projected/cb4a28d4-19ab-4bc4-bafd-e873723e32fd-kube-api-access-ww954\") pod \"alertmanager-main-0\" (UID: \"cb4a28d4-19ab-4bc4-bafd-e873723e32fd\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.087778 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.087758    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 16:45:53.381537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.381517    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 16:45:53.383340 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:45:53.383314    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4a28d4_19ab_4bc4_bafd_e873723e32fd.slice/crio-c1dd45f1a72639207f22b91b8382f98e8d56b87cdf6c343392e8ab8ea13ff325 WatchSource:0}: Error finding container c1dd45f1a72639207f22b91b8382f98e8d56b87cdf6c343392e8ab8ea13ff325: Status 404 returned error can't find the container with id c1dd45f1a72639207f22b91b8382f98e8d56b87cdf6c343392e8ab8ea13ff325
Sep 11 16:45:53.716055 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.716024    2569 generic.go:356] "Generic (PLEG): container finished" podID="cb4a28d4-19ab-4bc4-bafd-e873723e32fd" containerID="eeccf543ad0972fb345308bc4c8329794f89232f7f2da57e68a8a5eb84267168" exitCode=0
Sep 11 16:45:53.716306 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.716114    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb4a28d4-19ab-4bc4-bafd-e873723e32fd","Type":"ContainerDied","Data":"eeccf543ad0972fb345308bc4c8329794f89232f7f2da57e68a8a5eb84267168"}
Sep 11 16:45:53.716306 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.716193    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb4a28d4-19ab-4bc4-bafd-e873723e32fd","Type":"ContainerStarted","Data":"c1dd45f1a72639207f22b91b8382f98e8d56b87cdf6c343392e8ab8ea13ff325"}
Sep 11 16:45:53.927710 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:53.927551    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c" path="/var/lib/kubelet/pods/c8b20005-1d20-4a10-bbbd-a78c3c5bdf3c/volumes"
Sep 11 16:45:54.725553 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:54.725515    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb4a28d4-19ab-4bc4-bafd-e873723e32fd","Type":"ContainerStarted","Data":"f56e8d2917ffe8e9b9c5456ee5438fbf6f8743db05eaaabb817980539daf1761"}
Sep 11 16:45:54.725958 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:54.725575    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb4a28d4-19ab-4bc4-bafd-e873723e32fd","Type":"ContainerStarted","Data":"061d64b96bf64ca29ad4f7e7709a6bb16113ee1b2f0e945ed16a507fd0c93cb3"}
Sep 11 16:45:54.725958 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:54.725600    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb4a28d4-19ab-4bc4-bafd-e873723e32fd","Type":"ContainerStarted","Data":"555e34ea9f4e0f86f3b36c0bac6ee6523f1154cdbd6faf258e07d5747955e882"}
Sep 11 16:45:54.725958 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:54.725622    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb4a28d4-19ab-4bc4-bafd-e873723e32fd","Type":"ContainerStarted","Data":"749072f8b0412ffa04f3a96124deaaba9967c3c9fd70cb857d53d4994d7f5b3e"}
Sep 11 16:45:54.725958 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:54.725647    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb4a28d4-19ab-4bc4-bafd-e873723e32fd","Type":"ContainerStarted","Data":"267917bf576a58be1711bdce25ce3fdc9ea308094b3ab8ba56929e666f3c6c44"}
Sep 11 16:45:54.725958 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:54.725669    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"cb4a28d4-19ab-4bc4-bafd-e873723e32fd","Type":"ContainerStarted","Data":"be839cd0edbf8d53dc19b68c9b8e1365c3c0bc15b74489bbf396a85edf66d132"}
Sep 11 16:45:54.761129 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:45:54.761087    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.738984982 podStartE2EDuration="2.761072342s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.08736ms" isStatefulPod=false podCreationTimestamp="2026-09-11 16:45:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:45:54.758189175 +0000 UTC m=+165.317580563" watchObservedRunningTime="2026-09-11 16:45:54.761072342 +0000 UTC m=+165.320463728"
Sep 11 16:46:14.198288 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.198256    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54ccffdc57-hhvlw"]
Sep 11 16:46:14.202596 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.202577    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.213375 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.213356    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ccffdc57-hhvlw"]
Sep 11 16:46:14.297402 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.297372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-service-ca\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.297556 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.297415    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9qq9\" (UniqueName: \"kubernetes.io/projected/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-kube-api-access-s9qq9\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.297556 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.297439    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-oauth-serving-cert\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.297556 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.297465    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-trusted-ca-bundle\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.297556 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.297484    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-serving-cert\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.297556 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.297498    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-oauth-config\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.297556 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.297515    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-config\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.398562 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.398538    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-serving-cert\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.398771 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.398569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-oauth-config\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.398771 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.398588    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-config\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.398771 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.398615    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-service-ca\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.398771 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.398656    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9qq9\" (UniqueName: \"kubernetes.io/projected/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-kube-api-access-s9qq9\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.398771 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.398697    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-oauth-serving-cert\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.398771 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.398739    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-trusted-ca-bundle\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.399407 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.399379    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-service-ca\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.399521 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.399423    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-config\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.399603 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.399587    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-trusted-ca-bundle\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.399716 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.399695    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-oauth-serving-cert\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.401209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.401187    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-oauth-config\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.401356 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.401340    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-serving-cert\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.408039 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.408019    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9qq9\" (UniqueName: \"kubernetes.io/projected/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-kube-api-access-s9qq9\") pod \"console-54ccffdc57-hhvlw\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") " pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.512182 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.512116    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:14.796001 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:14.795978    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54ccffdc57-hhvlw"]
Sep 11 16:46:14.798552 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:46:14.798527    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod498c0edc_1ecc_4ce0_ac61_67c43948ddc4.slice/crio-474249e12133bbf1594bf23f1fb252829dccceae755a62530b7d6e3d6bd10f0c WatchSource:0}: Error finding container 474249e12133bbf1594bf23f1fb252829dccceae755a62530b7d6e3d6bd10f0c: Status 404 returned error can't find the container with id 474249e12133bbf1594bf23f1fb252829dccceae755a62530b7d6e3d6bd10f0c
Sep 11 16:46:15.805619 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:15.805589    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccffdc57-hhvlw" event={"ID":"498c0edc-1ecc-4ce0-ac61-67c43948ddc4","Type":"ContainerStarted","Data":"9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896"}
Sep 11 16:46:15.806025 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:15.805636    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccffdc57-hhvlw" event={"ID":"498c0edc-1ecc-4ce0-ac61-67c43948ddc4","Type":"ContainerStarted","Data":"474249e12133bbf1594bf23f1fb252829dccceae755a62530b7d6e3d6bd10f0c"}
Sep 11 16:46:15.825519 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:15.825444    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54ccffdc57-hhvlw" podStartSLOduration=1.825425702 podStartE2EDuration="1.825425702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:46:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:46:15.825113364 +0000 UTC m=+186.384504754" watchObservedRunningTime="2026-09-11 16:46:15.825425702 +0000 UTC m=+186.384817092"
Sep 11 16:46:24.512839 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:24.512787    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:24.513299 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:24.512856    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:24.517541 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:24.517521    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:24.841432 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:24.841357    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:46:24.901633 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:24.901601    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5d7c68cc-8vs9f"]
Sep 11 16:46:35.002252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.002219    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"]
Sep 11 16:46:35.005526 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.005510    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.008601 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.008569    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c758j\""
Sep 11 16:46:35.008704 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.008609    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:46:35.009112 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.009098    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:46:35.015237 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.015205    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"]
Sep 11 16:46:35.049770 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.049744    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.049909 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.049862    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftt54\" (UniqueName: \"kubernetes.io/projected/a8705805-30e8-47cf-b7ae-bbde7121e45d-kube-api-access-ftt54\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.049996 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.049981    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.150544 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.150509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.150661 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.150554    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftt54\" (UniqueName: \"kubernetes.io/projected/a8705805-30e8-47cf-b7ae-bbde7121e45d-kube-api-access-ftt54\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.150661 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.150587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.150893 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.150875    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.150933 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.150903    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.159673 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.159654    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftt54\" (UniqueName: \"kubernetes.io/projected/a8705805-30e8-47cf-b7ae-bbde7121e45d-kube-api-access-ftt54\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.315632 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.315547    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:35.589228 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.589206    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"]
Sep 11 16:46:35.591099 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:46:35.591071    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8705805_30e8_47cf_b7ae_bbde7121e45d.slice/crio-97079e26c9e27235991b460cf25c6fedbaf8bdb4d2bbfdf362c77fb0ec189c8b WatchSource:0}: Error finding container 97079e26c9e27235991b460cf25c6fedbaf8bdb4d2bbfdf362c77fb0ec189c8b: Status 404 returned error can't find the container with id 97079e26c9e27235991b460cf25c6fedbaf8bdb4d2bbfdf362c77fb0ec189c8b
Sep 11 16:46:35.876377 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:35.876293    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl" event={"ID":"a8705805-30e8-47cf-b7ae-bbde7121e45d","Type":"ContainerStarted","Data":"97079e26c9e27235991b460cf25c6fedbaf8bdb4d2bbfdf362c77fb0ec189c8b"}
Sep 11 16:46:41.902583 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:41.902544    2569 generic.go:356] "Generic (PLEG): container finished" podID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerID="97afe2ba875df782666cad1bd60cf7545f8aa2747eff6889adf879775dce794f" exitCode=0
Sep 11 16:46:41.903029 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:41.902615    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl" event={"ID":"a8705805-30e8-47cf-b7ae-bbde7121e45d","Type":"ContainerDied","Data":"97afe2ba875df782666cad1bd60cf7545f8aa2747eff6889adf879775dce794f"}
Sep 11 16:46:44.916712 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:44.916682    2569 generic.go:356] "Generic (PLEG): container finished" podID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerID="a4fa257a9f515de5ded1eb81f065f20ae4a7c2254c9680450beffeab6428ee12" exitCode=0
Sep 11 16:46:44.917096 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:44.916744    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl" event={"ID":"a8705805-30e8-47cf-b7ae-bbde7121e45d","Type":"ContainerDied","Data":"a4fa257a9f515de5ded1eb81f065f20ae4a7c2254c9680450beffeab6428ee12"}
Sep 11 16:46:49.921314 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:49.921224    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b5d7c68cc-8vs9f" podUID="a4626bb7-3511-4908-8086-814391bedc1a" containerName="console" containerID="cri-o://30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39" gracePeriod=15
Sep 11 16:46:51.478999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.478970    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:46:51.595616 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.595590    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-trusted-ca-bundle\") pod \"a4626bb7-3511-4908-8086-814391bedc1a\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") "
Sep 11 16:46:51.595711 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.595629    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-service-ca\") pod \"a4626bb7-3511-4908-8086-814391bedc1a\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") "
Sep 11 16:46:51.595711 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.595677    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9qjp\" (UniqueName: \"kubernetes.io/projected/a4626bb7-3511-4908-8086-814391bedc1a-kube-api-access-r9qjp\") pod \"a4626bb7-3511-4908-8086-814391bedc1a\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") "
Sep 11 16:46:51.595790 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.595727    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-console-config\") pod \"a4626bb7-3511-4908-8086-814391bedc1a\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") "
Sep 11 16:46:51.595790 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.595760    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-oauth-config\") pod \"a4626bb7-3511-4908-8086-814391bedc1a\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") "
Sep 11 16:46:51.596316 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.596282    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a4626bb7-3511-4908-8086-814391bedc1a" (UID: "a4626bb7-3511-4908-8086-814391bedc1a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:46:51.596424 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.596354    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-serving-cert\") pod \"a4626bb7-3511-4908-8086-814391bedc1a\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") "
Sep 11 16:46:51.596424 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.596401    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-service-ca" (OuterVolumeSpecName: "service-ca") pod "a4626bb7-3511-4908-8086-814391bedc1a" (UID: "a4626bb7-3511-4908-8086-814391bedc1a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:46:51.596424 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.596406    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-oauth-serving-cert\") pod \"a4626bb7-3511-4908-8086-814391bedc1a\" (UID: \"a4626bb7-3511-4908-8086-814391bedc1a\") "
Sep 11 16:46:51.596593 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.596500    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-console-config" (OuterVolumeSpecName: "console-config") pod "a4626bb7-3511-4908-8086-814391bedc1a" (UID: "a4626bb7-3511-4908-8086-814391bedc1a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:46:51.596682 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.596651    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a4626bb7-3511-4908-8086-814391bedc1a" (UID: "a4626bb7-3511-4908-8086-814391bedc1a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:46:51.596989 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.596956    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-oauth-serving-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:51.597071 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.596989    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-trusted-ca-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:51.597071 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.597004    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:51.598383 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.598353    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4626bb7-3511-4908-8086-814391bedc1a-kube-api-access-r9qjp" (OuterVolumeSpecName: "kube-api-access-r9qjp") pod "a4626bb7-3511-4908-8086-814391bedc1a" (UID: "a4626bb7-3511-4908-8086-814391bedc1a"). InnerVolumeSpecName "kube-api-access-r9qjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:46:51.602849 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.602823    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a4626bb7-3511-4908-8086-814391bedc1a" (UID: "a4626bb7-3511-4908-8086-814391bedc1a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:46:51.602960 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.602858    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a4626bb7-3511-4908-8086-814391bedc1a" (UID: "a4626bb7-3511-4908-8086-814391bedc1a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:46:51.698336 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.698299    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9qjp\" (UniqueName: \"kubernetes.io/projected/a4626bb7-3511-4908-8086-814391bedc1a-kube-api-access-r9qjp\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:51.698336 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.698336    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a4626bb7-3511-4908-8086-814391bedc1a-console-config\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:51.698336 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.698346    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-oauth-config\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:51.698508 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.698355    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a4626bb7-3511-4908-8086-814391bedc1a-console-serving-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:51.948050 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.948024    2569 generic.go:356] "Generic (PLEG): container finished" podID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerID="b5986dbafd6b71c271d0e5f96f3a98afd2169bfcca465fdef10013cb5b339951" exitCode=0
Sep 11 16:46:51.948160 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.948092    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl" event={"ID":"a8705805-30e8-47cf-b7ae-bbde7121e45d","Type":"ContainerDied","Data":"b5986dbafd6b71c271d0e5f96f3a98afd2169bfcca465fdef10013cb5b339951"}
Sep 11 16:46:51.949371 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.949353    2569 generic.go:356] "Generic (PLEG): container finished" podID="a4626bb7-3511-4908-8086-814391bedc1a" containerID="30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39" exitCode=0
Sep 11 16:46:51.949443 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.949395    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5d7c68cc-8vs9f" event={"ID":"a4626bb7-3511-4908-8086-814391bedc1a","Type":"ContainerDied","Data":"30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39"}
Sep 11 16:46:51.949443 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.949401    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b5d7c68cc-8vs9f"
Sep 11 16:46:51.949443 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.949426    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b5d7c68cc-8vs9f" event={"ID":"a4626bb7-3511-4908-8086-814391bedc1a","Type":"ContainerDied","Data":"1454083f400f1836ed49d02b570b4354b7cb8ac93015a4f6f25c64fa085c5d6d"}
Sep 11 16:46:51.949533 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.949445    2569 scope.go:117] "RemoveContainer" containerID="30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39"
Sep 11 16:46:51.957282 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.957265    2569 scope.go:117] "RemoveContainer" containerID="30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39"
Sep 11 16:46:51.957546 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:46:51.957527    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39\": container with ID starting with 30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39 not found: ID does not exist" containerID="30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39"
Sep 11 16:46:51.957609 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.957552    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39"} err="failed to get container status \"30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39\": rpc error: code = NotFound desc = could not find container \"30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39\": container with ID starting with 30ec685e0a840fc188743ed3ce854258c4f6685e8656b05eac93de409c2f3c39 not found: ID does not exist"
Sep 11 16:46:51.983367 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.983346    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b5d7c68cc-8vs9f"]
Sep 11 16:46:51.990383 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:51.990363    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b5d7c68cc-8vs9f"]
Sep 11 16:46:53.074782 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.074755    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:53.211259 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.211191    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftt54\" (UniqueName: \"kubernetes.io/projected/a8705805-30e8-47cf-b7ae-bbde7121e45d-kube-api-access-ftt54\") pod \"a8705805-30e8-47cf-b7ae-bbde7121e45d\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") "
Sep 11 16:46:53.211259 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.211227    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-util\") pod \"a8705805-30e8-47cf-b7ae-bbde7121e45d\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") "
Sep 11 16:46:53.211434 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.211317    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-bundle\") pod \"a8705805-30e8-47cf-b7ae-bbde7121e45d\" (UID: \"a8705805-30e8-47cf-b7ae-bbde7121e45d\") "
Sep 11 16:46:53.211971 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.211939    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-bundle" (OuterVolumeSpecName: "bundle") pod "a8705805-30e8-47cf-b7ae-bbde7121e45d" (UID: "a8705805-30e8-47cf-b7ae-bbde7121e45d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:46:53.213529 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.213507    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8705805-30e8-47cf-b7ae-bbde7121e45d-kube-api-access-ftt54" (OuterVolumeSpecName: "kube-api-access-ftt54") pod "a8705805-30e8-47cf-b7ae-bbde7121e45d" (UID: "a8705805-30e8-47cf-b7ae-bbde7121e45d"). InnerVolumeSpecName "kube-api-access-ftt54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:46:53.216206 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.216184    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-util" (OuterVolumeSpecName: "util") pod "a8705805-30e8-47cf-b7ae-bbde7121e45d" (UID: "a8705805-30e8-47cf-b7ae-bbde7121e45d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:46:53.312679 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.312650    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:53.312679 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.312675    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftt54\" (UniqueName: \"kubernetes.io/projected/a8705805-30e8-47cf-b7ae-bbde7121e45d-kube-api-access-ftt54\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:53.312827 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.312689    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8705805-30e8-47cf-b7ae-bbde7121e45d-util\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:46:53.925499 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.925457    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4626bb7-3511-4908-8086-814391bedc1a" path="/var/lib/kubelet/pods/a4626bb7-3511-4908-8086-814391bedc1a/volumes"
Sep 11 16:46:53.959174 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.959142    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl" event={"ID":"a8705805-30e8-47cf-b7ae-bbde7121e45d","Type":"ContainerDied","Data":"97079e26c9e27235991b460cf25c6fedbaf8bdb4d2bbfdf362c77fb0ec189c8b"}
Sep 11 16:46:53.959174 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.959160    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405fmpl"
Sep 11 16:46:53.959327 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:53.959186    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="97079e26c9e27235991b460cf25c6fedbaf8bdb4d2bbfdf362c77fb0ec189c8b"
Sep 11 16:46:58.061675 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.061641    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"]
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.061947    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4626bb7-3511-4908-8086-814391bedc1a" containerName="console"
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.061959    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4626bb7-3511-4908-8086-814391bedc1a" containerName="console"
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.061973    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerName="util"
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.061978    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerName="util"
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.061985    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerName="pull"
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.061990    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerName="pull"
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.061997    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerName="extract"
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.062002    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerName="extract"
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.062040    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4626bb7-3511-4908-8086-814391bedc1a" containerName="console"
Sep 11 16:46:58.062102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.062047    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8705805-30e8-47cf-b7ae-bbde7121e45d" containerName="extract"
Sep 11 16:46:58.067009 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.066989    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"
Sep 11 16:46:58.071209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.071190    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hg6vx\""
Sep 11 16:46:58.071364 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.071348    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:46:58.071590 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.071578    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 16:46:58.079698 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.079672    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"]
Sep 11 16:46:58.254655 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.254617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d57f14-f181-43b9-951e-96309657b847-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sllzz\" (UID: \"48d57f14-f181-43b9-951e-96309657b847\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"
Sep 11 16:46:58.254831 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.254667    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmswz\" (UniqueName: \"kubernetes.io/projected/48d57f14-f181-43b9-951e-96309657b847-kube-api-access-lmswz\") pod \"cert-manager-operator-controller-manager-55c444bf86-sllzz\" (UID: \"48d57f14-f181-43b9-951e-96309657b847\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"
Sep 11 16:46:58.355216 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.355152    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d57f14-f181-43b9-951e-96309657b847-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sllzz\" (UID: \"48d57f14-f181-43b9-951e-96309657b847\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"
Sep 11 16:46:58.355216 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.355189    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmswz\" (UniqueName: \"kubernetes.io/projected/48d57f14-f181-43b9-951e-96309657b847-kube-api-access-lmswz\") pod \"cert-manager-operator-controller-manager-55c444bf86-sllzz\" (UID: \"48d57f14-f181-43b9-951e-96309657b847\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"
Sep 11 16:46:58.355580 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.355563    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d57f14-f181-43b9-951e-96309657b847-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-sllzz\" (UID: \"48d57f14-f181-43b9-951e-96309657b847\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"
Sep 11 16:46:58.364121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.364096    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmswz\" (UniqueName: \"kubernetes.io/projected/48d57f14-f181-43b9-951e-96309657b847-kube-api-access-lmswz\") pod \"cert-manager-operator-controller-manager-55c444bf86-sllzz\" (UID: \"48d57f14-f181-43b9-951e-96309657b847\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"
Sep 11 16:46:58.375343 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.375323    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"
Sep 11 16:46:58.656101 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.656012    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz"]
Sep 11 16:46:58.660097 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:46:58.660072    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d57f14_f181_43b9_951e_96309657b847.slice/crio-7baca7328a429bbd3e19f24b6b6fa6eab44f614f6e256bd20df2cf267ede730b WatchSource:0}: Error finding container 7baca7328a429bbd3e19f24b6b6fa6eab44f614f6e256bd20df2cf267ede730b: Status 404 returned error can't find the container with id 7baca7328a429bbd3e19f24b6b6fa6eab44f614f6e256bd20df2cf267ede730b
Sep 11 16:46:58.978919 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:46:58.978884    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz" event={"ID":"48d57f14-f181-43b9-951e-96309657b847","Type":"ContainerStarted","Data":"7baca7328a429bbd3e19f24b6b6fa6eab44f614f6e256bd20df2cf267ede730b"}
Sep 11 16:47:00.988949 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:00.988908    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz" event={"ID":"48d57f14-f181-43b9-951e-96309657b847","Type":"ContainerStarted","Data":"117943e1088534a40bf9edc53733d088edf01fb82cb98720aa5b4670c9fdfb06"}
Sep 11 16:47:01.021592 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:01.021538    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-sllzz" podStartSLOduration=1.391844326 podStartE2EDuration="3.021520614s" totalImagesPullingTime="1.629676288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:47:01.020015772 +0000 UTC m=+231.579407160" watchObservedRunningTime="2026-09-11 16:47:01.021520614 +0000 UTC m=+231.580912003"
Sep 11 16:47:02.250368 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.250335    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"]
Sep 11 16:47:02.253777 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.253754    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.255941 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.255909    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c758j\""
Sep 11 16:47:02.256570 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.256553    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:47:02.256677 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.256657    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:47:02.265128 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.265110    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"]
Sep 11 16:47:02.287895 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.287868    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.288014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.287937    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.288014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.287961    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqttf\" (UniqueName: \"kubernetes.io/projected/d6a0143b-8262-482b-8384-1682b00512a2-kube-api-access-rqttf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.388318 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.388292    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.388475 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.388330    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.388475 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.388352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqttf\" (UniqueName: \"kubernetes.io/projected/d6a0143b-8262-482b-8384-1682b00512a2-kube-api-access-rqttf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.388730 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.388711    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.388768 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.388750    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.399267 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.399237    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqttf\" (UniqueName: \"kubernetes.io/projected/d6a0143b-8262-482b-8384-1682b00512a2-kube-api-access-rqttf\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.563151 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.563068    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:02.840038 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.840015    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"]
Sep 11 16:47:02.842352 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:47:02.842326    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a0143b_8262_482b_8384_1682b00512a2.slice/crio-8b7ff79c73cd3399833302484026c5fa4d23f857aaadcbeb2cd2ace1135fced2 WatchSource:0}: Error finding container 8b7ff79c73cd3399833302484026c5fa4d23f857aaadcbeb2cd2ace1135fced2: Status 404 returned error can't find the container with id 8b7ff79c73cd3399833302484026c5fa4d23f857aaadcbeb2cd2ace1135fced2
Sep 11 16:47:02.998917 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.998887    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6a0143b-8262-482b-8384-1682b00512a2" containerID="9b59c6628fca3da0e513c502f2a950b5aeb52d5fcb9d050f3a44ab3d64ef4894" exitCode=0
Sep 11 16:47:02.999057 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.998925    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t" event={"ID":"d6a0143b-8262-482b-8384-1682b00512a2","Type":"ContainerDied","Data":"9b59c6628fca3da0e513c502f2a950b5aeb52d5fcb9d050f3a44ab3d64ef4894"}
Sep 11 16:47:02.999057 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:02.998962    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t" event={"ID":"d6a0143b-8262-482b-8384-1682b00512a2","Type":"ContainerStarted","Data":"8b7ff79c73cd3399833302484026c5fa4d23f857aaadcbeb2cd2ace1135fced2"}
Sep 11 16:47:04.145402 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.145361    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zmctl"]
Sep 11 16:47:04.148712 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.148694    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:04.151703 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.151680    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-dgcd6\""
Sep 11 16:47:04.152247 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.152222    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 16:47:04.152499 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.152482    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 16:47:04.163880 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.163855    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zmctl"]
Sep 11 16:47:04.199626 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.199595    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x54nf\" (UniqueName: \"kubernetes.io/projected/f6f2f325-98f3-4df8-940d-0094610d0332-kube-api-access-x54nf\") pod \"cert-manager-webhook-6486ffd997-zmctl\" (UID: \"f6f2f325-98f3-4df8-940d-0094610d0332\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:04.199767 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.199656    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6f2f325-98f3-4df8-940d-0094610d0332-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zmctl\" (UID: \"f6f2f325-98f3-4df8-940d-0094610d0332\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:04.300458 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.300418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x54nf\" (UniqueName: \"kubernetes.io/projected/f6f2f325-98f3-4df8-940d-0094610d0332-kube-api-access-x54nf\") pod \"cert-manager-webhook-6486ffd997-zmctl\" (UID: \"f6f2f325-98f3-4df8-940d-0094610d0332\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:04.300627 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.300476    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6f2f325-98f3-4df8-940d-0094610d0332-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zmctl\" (UID: \"f6f2f325-98f3-4df8-940d-0094610d0332\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:04.309519 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.309478    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x54nf\" (UniqueName: \"kubernetes.io/projected/f6f2f325-98f3-4df8-940d-0094610d0332-kube-api-access-x54nf\") pod \"cert-manager-webhook-6486ffd997-zmctl\" (UID: \"f6f2f325-98f3-4df8-940d-0094610d0332\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:04.309692 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.309663    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6f2f325-98f3-4df8-940d-0094610d0332-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zmctl\" (UID: \"f6f2f325-98f3-4df8-940d-0094610d0332\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:04.464083 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.464052    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:04.826207 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.826132    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"]
Sep 11 16:47:04.829568 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.829542    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"
Sep 11 16:47:04.844071 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.844050    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ttthn\""
Sep 11 16:47:04.857996 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.857970    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"]
Sep 11 16:47:04.904617 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.904593    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40345939-afc3-4f4b-812d-2cfe3aaabc86-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6zmq\" (UID: \"40345939-afc3-4f4b-812d-2cfe3aaabc86\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"
Sep 11 16:47:04.904707 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:04.904657    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm5fl\" (UniqueName: \"kubernetes.io/projected/40345939-afc3-4f4b-812d-2cfe3aaabc86-kube-api-access-cm5fl\") pod \"cert-manager-cainjector-559cdd8c87-m6zmq\" (UID: \"40345939-afc3-4f4b-812d-2cfe3aaabc86\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"
Sep 11 16:47:05.005412 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:05.005383    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm5fl\" (UniqueName: \"kubernetes.io/projected/40345939-afc3-4f4b-812d-2cfe3aaabc86-kube-api-access-cm5fl\") pod \"cert-manager-cainjector-559cdd8c87-m6zmq\" (UID: \"40345939-afc3-4f4b-812d-2cfe3aaabc86\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"
Sep 11 16:47:05.005592 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:05.005464    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40345939-afc3-4f4b-812d-2cfe3aaabc86-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6zmq\" (UID: \"40345939-afc3-4f4b-812d-2cfe3aaabc86\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"
Sep 11 16:47:05.010375 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:05.010347    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t" event={"ID":"d6a0143b-8262-482b-8384-1682b00512a2","Type":"ContainerStarted","Data":"5aaf97c7d4811fb965311ba02667feca654456764fde6a59c43a90d7e7017455"}
Sep 11 16:47:05.021760 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:05.021737    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40345939-afc3-4f4b-812d-2cfe3aaabc86-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-m6zmq\" (UID: \"40345939-afc3-4f4b-812d-2cfe3aaabc86\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"
Sep 11 16:47:05.022418 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:05.022397    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm5fl\" (UniqueName: \"kubernetes.io/projected/40345939-afc3-4f4b-812d-2cfe3aaabc86-kube-api-access-cm5fl\") pod \"cert-manager-cainjector-559cdd8c87-m6zmq\" (UID: \"40345939-afc3-4f4b-812d-2cfe3aaabc86\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"
Sep 11 16:47:05.139238 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:05.139178    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"
Sep 11 16:47:05.252634 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:05.252603    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zmctl"]
Sep 11 16:47:05.255910 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:47:05.255886    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6f2f325_98f3_4df8_940d_0094610d0332.slice/crio-ab2d3c480688b92fbc7484726b16ff5356ec69d198edf05cffe2c20edf3d096e WatchSource:0}: Error finding container ab2d3c480688b92fbc7484726b16ff5356ec69d198edf05cffe2c20edf3d096e: Status 404 returned error can't find the container with id ab2d3c480688b92fbc7484726b16ff5356ec69d198edf05cffe2c20edf3d096e
Sep 11 16:47:05.429418 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:05.429392    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq"]
Sep 11 16:47:05.429779 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:47:05.429754    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40345939_afc3_4f4b_812d_2cfe3aaabc86.slice/crio-790b49890f3884039ac02837181941debf08f826a659d8b31f243567f96dbbeb WatchSource:0}: Error finding container 790b49890f3884039ac02837181941debf08f826a659d8b31f243567f96dbbeb: Status 404 returned error can't find the container with id 790b49890f3884039ac02837181941debf08f826a659d8b31f243567f96dbbeb
Sep 11 16:47:06.017506 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:06.017471    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6a0143b-8262-482b-8384-1682b00512a2" containerID="5aaf97c7d4811fb965311ba02667feca654456764fde6a59c43a90d7e7017455" exitCode=0
Sep 11 16:47:06.017677 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:06.017557    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t" event={"ID":"d6a0143b-8262-482b-8384-1682b00512a2","Type":"ContainerDied","Data":"5aaf97c7d4811fb965311ba02667feca654456764fde6a59c43a90d7e7017455"}
Sep 11 16:47:06.019046 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:06.019018    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq" event={"ID":"40345939-afc3-4f4b-812d-2cfe3aaabc86","Type":"ContainerStarted","Data":"790b49890f3884039ac02837181941debf08f826a659d8b31f243567f96dbbeb"}
Sep 11 16:47:06.020456 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:06.020432    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl" event={"ID":"f6f2f325-98f3-4df8-940d-0094610d0332","Type":"ContainerStarted","Data":"ab2d3c480688b92fbc7484726b16ff5356ec69d198edf05cffe2c20edf3d096e"}
Sep 11 16:47:07.028474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:07.028427    2569 generic.go:356] "Generic (PLEG): container finished" podID="d6a0143b-8262-482b-8384-1682b00512a2" containerID="3e629ffef4ee1f2c108df047c094b0e5c7639b3fd7ebb11df8a164ac10a951d5" exitCode=0
Sep 11 16:47:07.028968 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:07.028487    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t" event={"ID":"d6a0143b-8262-482b-8384-1682b00512a2","Type":"ContainerDied","Data":"3e629ffef4ee1f2c108df047c094b0e5c7639b3fd7ebb11df8a164ac10a951d5"}
Sep 11 16:47:08.241982 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.241955    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:08.332641 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.332569    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-bundle\") pod \"d6a0143b-8262-482b-8384-1682b00512a2\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") "
Sep 11 16:47:08.332769 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.332643    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rqttf\" (UniqueName: \"kubernetes.io/projected/d6a0143b-8262-482b-8384-1682b00512a2-kube-api-access-rqttf\") pod \"d6a0143b-8262-482b-8384-1682b00512a2\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") "
Sep 11 16:47:08.332769 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.332662    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-util\") pod \"d6a0143b-8262-482b-8384-1682b00512a2\" (UID: \"d6a0143b-8262-482b-8384-1682b00512a2\") "
Sep 11 16:47:08.332979 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.332949    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-bundle" (OuterVolumeSpecName: "bundle") pod "d6a0143b-8262-482b-8384-1682b00512a2" (UID: "d6a0143b-8262-482b-8384-1682b00512a2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:08.334757 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.334732    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6a0143b-8262-482b-8384-1682b00512a2-kube-api-access-rqttf" (OuterVolumeSpecName: "kube-api-access-rqttf") pod "d6a0143b-8262-482b-8384-1682b00512a2" (UID: "d6a0143b-8262-482b-8384-1682b00512a2"). InnerVolumeSpecName "kube-api-access-rqttf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:08.337354 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.337334    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-util" (OuterVolumeSpecName: "util") pod "d6a0143b-8262-482b-8384-1682b00512a2" (UID: "d6a0143b-8262-482b-8384-1682b00512a2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:08.433444 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.433413    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rqttf\" (UniqueName: \"kubernetes.io/projected/d6a0143b-8262-482b-8384-1682b00512a2-kube-api-access-rqttf\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:47:08.433444 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.433439    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-util\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:47:08.433444 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:08.433448    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d6a0143b-8262-482b-8384-1682b00512a2-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:47:09.039981 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:09.039952    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t"
Sep 11 16:47:09.039981 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:09.039966    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8rt7t" event={"ID":"d6a0143b-8262-482b-8384-1682b00512a2","Type":"ContainerDied","Data":"8b7ff79c73cd3399833302484026c5fa4d23f857aaadcbeb2cd2ace1135fced2"}
Sep 11 16:47:09.040200 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:09.040014    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b7ff79c73cd3399833302484026c5fa4d23f857aaadcbeb2cd2ace1135fced2"
Sep 11 16:47:09.041582 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:09.041555    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq" event={"ID":"40345939-afc3-4f4b-812d-2cfe3aaabc86","Type":"ContainerStarted","Data":"10a74327e98683f15ba0b277a7d58efd5620d2047f6bafa002d608de47f102f1"}
Sep 11 16:47:09.043041 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:09.043023    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl" event={"ID":"f6f2f325-98f3-4df8-940d-0094610d0332","Type":"ContainerStarted","Data":"405b38207c579f7f4b535acd08f0f9c7df845168fefff415490fb8ad00acdbbc"}
Sep 11 16:47:09.043173 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:09.043157    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:09.093621 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:09.093571    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl" podStartSLOduration=2.23496534 podStartE2EDuration="5.09355731s" totalImagesPullingTime="2.85859197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:47:09.091521089 +0000 UTC m=+239.650912476" watchObservedRunningTime="2026-09-11 16:47:09.09355731 +0000 UTC m=+239.652948697"
Sep 11 16:47:09.093929 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:09.093904    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-m6zmq" podStartSLOduration=2.41502485 podStartE2EDuration="5.093898291s" totalImagesPullingTime="2.678873441s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:47:09.063325991 +0000 UTC m=+239.622717378" watchObservedRunningTime="2026-09-11 16:47:09.093898291 +0000 UTC m=+239.653289747"
Sep 11 16:47:13.424404 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.424372    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nb2hr"]
Sep 11 16:47:13.424887 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.424643    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a0143b-8262-482b-8384-1682b00512a2" containerName="util"
Sep 11 16:47:13.424887 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.424652    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a0143b-8262-482b-8384-1682b00512a2" containerName="util"
Sep 11 16:47:13.424887 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.424664    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a0143b-8262-482b-8384-1682b00512a2" containerName="extract"
Sep 11 16:47:13.424887 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.424670    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a0143b-8262-482b-8384-1682b00512a2" containerName="extract"
Sep 11 16:47:13.424887 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.424683    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6a0143b-8262-482b-8384-1682b00512a2" containerName="pull"
Sep 11 16:47:13.424887 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.424688    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6a0143b-8262-482b-8384-1682b00512a2" containerName="pull"
Sep 11 16:47:13.424887 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.424733    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6a0143b-8262-482b-8384-1682b00512a2" containerName="extract"
Sep 11 16:47:13.428979 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.428963    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nb2hr"
Sep 11 16:47:13.431576 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.431548    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v9hnd\""
Sep 11 16:47:13.442454 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.442429    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nb2hr"]
Sep 11 16:47:13.476630 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.476604    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c86b2\" (UniqueName: \"kubernetes.io/projected/563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b-kube-api-access-c86b2\") pod \"cert-manager-55b4d954d5-nb2hr\" (UID: \"563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b\") " pod="cert-manager/cert-manager-55b4d954d5-nb2hr"
Sep 11 16:47:13.476756 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.476645    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b-bound-sa-token\") pod \"cert-manager-55b4d954d5-nb2hr\" (UID: \"563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b\") " pod="cert-manager/cert-manager-55b4d954d5-nb2hr"
Sep 11 16:47:13.578029 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.577997    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c86b2\" (UniqueName: \"kubernetes.io/projected/563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b-kube-api-access-c86b2\") pod \"cert-manager-55b4d954d5-nb2hr\" (UID: \"563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b\") " pod="cert-manager/cert-manager-55b4d954d5-nb2hr"
Sep 11 16:47:13.578175 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.578044    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b-bound-sa-token\") pod \"cert-manager-55b4d954d5-nb2hr\" (UID: \"563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b\") " pod="cert-manager/cert-manager-55b4d954d5-nb2hr"
Sep 11 16:47:13.588414 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.588385    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c86b2\" (UniqueName: \"kubernetes.io/projected/563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b-kube-api-access-c86b2\") pod \"cert-manager-55b4d954d5-nb2hr\" (UID: \"563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b\") " pod="cert-manager/cert-manager-55b4d954d5-nb2hr"
Sep 11 16:47:13.589372 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.589352    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b-bound-sa-token\") pod \"cert-manager-55b4d954d5-nb2hr\" (UID: \"563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b\") " pod="cert-manager/cert-manager-55b4d954d5-nb2hr"
Sep 11 16:47:13.737628 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:13.737600    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nb2hr"
Sep 11 16:47:14.015514 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:14.015419    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nb2hr"]
Sep 11 16:47:14.019224 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:47:14.019191    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod563ffde0_b1b3_47bb_b1c9_6ee2ba78b96b.slice/crio-a8e4b4861b771ce0f42b779aa644e0c05bc2517030549730217fab7c67b581e8 WatchSource:0}: Error finding container a8e4b4861b771ce0f42b779aa644e0c05bc2517030549730217fab7c67b581e8: Status 404 returned error can't find the container with id a8e4b4861b771ce0f42b779aa644e0c05bc2517030549730217fab7c67b581e8
Sep 11 16:47:14.069859 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:14.069831    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nb2hr" event={"ID":"563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b","Type":"ContainerStarted","Data":"a8e4b4861b771ce0f42b779aa644e0c05bc2517030549730217fab7c67b581e8"}
Sep 11 16:47:15.053335 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:15.053307    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zmctl"
Sep 11 16:47:15.075442 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:15.075406    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nb2hr" event={"ID":"563ffde0-b1b3-47bb-b1c9-6ee2ba78b96b","Type":"ContainerStarted","Data":"45d1ce8879ca9800c44ee0b1143a0063d4f0feaf5d5524692baf27ad208c6cfb"}
Sep 11 16:47:15.097708 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:15.097644    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nb2hr" podStartSLOduration=2.0976239899999998 podStartE2EDuration="2.09762399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:47:15.096055876 +0000 UTC m=+245.655447262" watchObservedRunningTime="2026-09-11 16:47:15.09762399 +0000 UTC m=+245.657015378"
Sep 11 16:47:21.487735 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.487702    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"]
Sep 11 16:47:21.491179 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.491160    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.494110 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.494090    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c758j\""
Sep 11 16:47:21.494346 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.494330    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:47:21.494851 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.494834    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:47:21.502962 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.502937    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"]
Sep 11 16:47:21.540169 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.540140    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtplq\" (UniqueName: \"kubernetes.io/projected/96207f91-c3a2-42d2-8879-09b776b4abed-kube-api-access-vtplq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.540328 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.540181    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.540328 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.540209    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.641509 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.641480    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.641606 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.641535    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtplq\" (UniqueName: \"kubernetes.io/projected/96207f91-c3a2-42d2-8879-09b776b4abed-kube-api-access-vtplq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.641606 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.641556    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.641903 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.641884    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.641942 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.641907    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.651057 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.651039    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtplq\" (UniqueName: \"kubernetes.io/projected/96207f91-c3a2-42d2-8879-09b776b4abed-kube-api-access-vtplq\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:21.805817 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:21.805718    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:22.080663 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:22.080531    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"]
Sep 11 16:47:22.083375 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:47:22.083343    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96207f91_c3a2_42d2_8879_09b776b4abed.slice/crio-e8d1830538a3d06206c3f67413a0ff3c73f9b13aadadb297dd43362f541b8157 WatchSource:0}: Error finding container e8d1830538a3d06206c3f67413a0ff3c73f9b13aadadb297dd43362f541b8157: Status 404 returned error can't find the container with id e8d1830538a3d06206c3f67413a0ff3c73f9b13aadadb297dd43362f541b8157
Sep 11 16:47:22.106862 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:22.106836    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2" event={"ID":"96207f91-c3a2-42d2-8879-09b776b4abed","Type":"ContainerStarted","Data":"e8d1830538a3d06206c3f67413a0ff3c73f9b13aadadb297dd43362f541b8157"}
Sep 11 16:47:23.113266 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:23.113237    2569 generic.go:356] "Generic (PLEG): container finished" podID="96207f91-c3a2-42d2-8879-09b776b4abed" containerID="ce9dde8830c62d0be434a1ba13016f64ea5d5db13673b20f98d1708a636d0c2f" exitCode=0
Sep 11 16:47:23.113632 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:23.113291    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2" event={"ID":"96207f91-c3a2-42d2-8879-09b776b4abed","Type":"ContainerDied","Data":"ce9dde8830c62d0be434a1ba13016f64ea5d5db13673b20f98d1708a636d0c2f"}
Sep 11 16:47:24.119071 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:24.119041    2569 generic.go:356] "Generic (PLEG): container finished" podID="96207f91-c3a2-42d2-8879-09b776b4abed" containerID="87bf47f1e7bf2c6179fec513b9f30082e693ef9c4b538f9fb206ce596e14dfa8" exitCode=0
Sep 11 16:47:24.119376 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:24.119101    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2" event={"ID":"96207f91-c3a2-42d2-8879-09b776b4abed","Type":"ContainerDied","Data":"87bf47f1e7bf2c6179fec513b9f30082e693ef9c4b538f9fb206ce596e14dfa8"}
Sep 11 16:47:25.126094 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:25.126063    2569 generic.go:356] "Generic (PLEG): container finished" podID="96207f91-c3a2-42d2-8879-09b776b4abed" containerID="48b10aac591f77781e3bc63f77394d587616a19b836eacc8d2e80587bd093cad" exitCode=0
Sep 11 16:47:25.126524 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:25.126150    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2" event={"ID":"96207f91-c3a2-42d2-8879-09b776b4abed","Type":"ContainerDied","Data":"48b10aac591f77781e3bc63f77394d587616a19b836eacc8d2e80587bd093cad"}
Sep 11 16:47:26.253447 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.253421    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:26.380907 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.380832    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtplq\" (UniqueName: \"kubernetes.io/projected/96207f91-c3a2-42d2-8879-09b776b4abed-kube-api-access-vtplq\") pod \"96207f91-c3a2-42d2-8879-09b776b4abed\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") "
Sep 11 16:47:26.380907 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.380869    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-bundle\") pod \"96207f91-c3a2-42d2-8879-09b776b4abed\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") "
Sep 11 16:47:26.380907 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.380896    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-util\") pod \"96207f91-c3a2-42d2-8879-09b776b4abed\" (UID: \"96207f91-c3a2-42d2-8879-09b776b4abed\") "
Sep 11 16:47:26.381583 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.381496    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-bundle" (OuterVolumeSpecName: "bundle") pod "96207f91-c3a2-42d2-8879-09b776b4abed" (UID: "96207f91-c3a2-42d2-8879-09b776b4abed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:26.383020 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.382997    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96207f91-c3a2-42d2-8879-09b776b4abed-kube-api-access-vtplq" (OuterVolumeSpecName: "kube-api-access-vtplq") pod "96207f91-c3a2-42d2-8879-09b776b4abed" (UID: "96207f91-c3a2-42d2-8879-09b776b4abed"). InnerVolumeSpecName "kube-api-access-vtplq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:26.386785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.386765    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-util" (OuterVolumeSpecName: "util") pod "96207f91-c3a2-42d2-8879-09b776b4abed" (UID: "96207f91-c3a2-42d2-8879-09b776b4abed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:26.481990 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.481961    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtplq\" (UniqueName: \"kubernetes.io/projected/96207f91-c3a2-42d2-8879-09b776b4abed-kube-api-access-vtplq\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:47:26.481990 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.481985    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:47:26.481990 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:26.481994    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/96207f91-c3a2-42d2-8879-09b776b4abed-util\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:47:27.135816 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:27.135758    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2" event={"ID":"96207f91-c3a2-42d2-8879-09b776b4abed","Type":"ContainerDied","Data":"e8d1830538a3d06206c3f67413a0ff3c73f9b13aadadb297dd43362f541b8157"}
Sep 11 16:47:27.135955 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:27.135835    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8d1830538a3d06206c3f67413a0ff3c73f9b13aadadb297dd43362f541b8157"
Sep 11 16:47:27.135955 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:27.135775    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796aff5lb2"
Sep 11 16:47:34.905027 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.904949    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"]
Sep 11 16:47:34.905384 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.905230    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96207f91-c3a2-42d2-8879-09b776b4abed" containerName="extract"
Sep 11 16:47:34.905384 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.905240    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="96207f91-c3a2-42d2-8879-09b776b4abed" containerName="extract"
Sep 11 16:47:34.905384 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.905252    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96207f91-c3a2-42d2-8879-09b776b4abed" containerName="util"
Sep 11 16:47:34.905384 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.905258    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="96207f91-c3a2-42d2-8879-09b776b4abed" containerName="util"
Sep 11 16:47:34.905384 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.905271    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96207f91-c3a2-42d2-8879-09b776b4abed" containerName="pull"
Sep 11 16:47:34.905384 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.905277    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="96207f91-c3a2-42d2-8879-09b776b4abed" containerName="pull"
Sep 11 16:47:34.905384 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.905323    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="96207f91-c3a2-42d2-8879-09b776b4abed" containerName="extract"
Sep 11 16:47:34.909453 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.909425    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:34.911971 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.911946    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:47:34.912121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.912044    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c758j\""
Sep 11 16:47:34.912607 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.912560    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:47:34.920762 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:34.920737    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"]
Sep 11 16:47:35.055345 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.055314    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vrp9\" (UniqueName: \"kubernetes.io/projected/8f05260f-b07b-451f-800f-51a1d736db01-kube-api-access-6vrp9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.055527 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.055353    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.055527 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.055483    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.156341 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.156260    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.156341 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.156294    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vrp9\" (UniqueName: \"kubernetes.io/projected/8f05260f-b07b-451f-800f-51a1d736db01-kube-api-access-6vrp9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.156341 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.156314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.156650 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.156634    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.156707 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.156662    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.169999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.169971    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vrp9\" (UniqueName: \"kubernetes.io/projected/8f05260f-b07b-451f-800f-51a1d736db01-kube-api-access-6vrp9\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.220942 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.220909    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:35.505515 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:35.505493    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"]
Sep 11 16:47:35.507688 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:47:35.507656    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f05260f_b07b_451f_800f_51a1d736db01.slice/crio-6e2c7e7b66b9b4a5db6ba5bc2f8631c7f1efa326cf35739b866d34b334fc6aa1 WatchSource:0}: Error finding container 6e2c7e7b66b9b4a5db6ba5bc2f8631c7f1efa326cf35739b866d34b334fc6aa1: Status 404 returned error can't find the container with id 6e2c7e7b66b9b4a5db6ba5bc2f8631c7f1efa326cf35739b866d34b334fc6aa1
Sep 11 16:47:36.176509 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:36.176463    2569 generic.go:356] "Generic (PLEG): container finished" podID="8f05260f-b07b-451f-800f-51a1d736db01" containerID="ae93a4d4a0ca183450c252fe6656f623ac7712c45e54cd10c63f4184e4530ab1" exitCode=0
Sep 11 16:47:36.177132 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:36.176591    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd" event={"ID":"8f05260f-b07b-451f-800f-51a1d736db01","Type":"ContainerDied","Data":"ae93a4d4a0ca183450c252fe6656f623ac7712c45e54cd10c63f4184e4530ab1"}
Sep 11 16:47:36.177132 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:36.176667    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd" event={"ID":"8f05260f-b07b-451f-800f-51a1d736db01","Type":"ContainerStarted","Data":"6e2c7e7b66b9b4a5db6ba5bc2f8631c7f1efa326cf35739b866d34b334fc6aa1"}
Sep 11 16:47:37.182537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.182444    2569 generic.go:356] "Generic (PLEG): container finished" podID="8f05260f-b07b-451f-800f-51a1d736db01" containerID="71dd0775edf5531b9660eed2b2d30d07e65dbfdce2e398df874320c946746b97" exitCode=0
Sep 11 16:47:37.182537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.182488    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd" event={"ID":"8f05260f-b07b-451f-800f-51a1d736db01","Type":"ContainerDied","Data":"71dd0775edf5531b9660eed2b2d30d07e65dbfdce2e398df874320c946746b97"}
Sep 11 16:47:37.286292 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.286260    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"]
Sep 11 16:47:37.290126 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.290103    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.293433 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.293322    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 16:47:37.293433 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.293403    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 16:47:37.293632 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.293440    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-5x2wg\""
Sep 11 16:47:37.293632 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.293403    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 16:47:37.293632 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.293445    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 16:47:37.305578 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.305549    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"]
Sep 11 16:47:37.376152 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.376120    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ed7d727-98f0-41b3-a4e4-66cd0591d617-tmp\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.376152 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.376153    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ed7d727-98f0-41b3-a4e4-66cd0591d617-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.376329 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.376179    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ed7d727-98f0-41b3-a4e4-66cd0591d617-manifests\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.376329 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.376246    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p54k9\" (UniqueName: \"kubernetes.io/projected/7ed7d727-98f0-41b3-a4e4-66cd0591d617-kube-api-access-p54k9\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.376329 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.376277    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ed7d727-98f0-41b3-a4e4-66cd0591d617-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.477641 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.477603    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p54k9\" (UniqueName: \"kubernetes.io/projected/7ed7d727-98f0-41b3-a4e4-66cd0591d617-kube-api-access-p54k9\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.477873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.477662    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ed7d727-98f0-41b3-a4e4-66cd0591d617-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.477873 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.477852    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ed7d727-98f0-41b3-a4e4-66cd0591d617-tmp\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.477995 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.477891    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ed7d727-98f0-41b3-a4e4-66cd0591d617-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.477995 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.477924    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ed7d727-98f0-41b3-a4e4-66cd0591d617-manifests\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.478277 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.478253    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7ed7d727-98f0-41b3-a4e4-66cd0591d617-manifests\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.480187 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.480165    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7ed7d727-98f0-41b3-a4e4-66cd0591d617-tmp\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.480392 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.480376    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ed7d727-98f0-41b3-a4e4-66cd0591d617-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.480536 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.480513    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7ed7d727-98f0-41b3-a4e4-66cd0591d617-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.486000 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.485983    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p54k9\" (UniqueName: \"kubernetes.io/projected/7ed7d727-98f0-41b3-a4e4-66cd0591d617-kube-api-access-p54k9\") pod \"opendatahub-operator-controller-manager-7d67cb4f96-jdqj2\" (UID: \"7ed7d727-98f0-41b3-a4e4-66cd0591d617\") " pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.602464 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.602431    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:37.912078 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:37.911997    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"]
Sep 11 16:47:38.191217 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:38.191190    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2" event={"ID":"7ed7d727-98f0-41b3-a4e4-66cd0591d617","Type":"ContainerStarted","Data":"e5074daf9af7cbd3a2ba32a5ef79cda32994fed1bbb582da6ce19aaf0d30937c"}
Sep 11 16:47:38.193654 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:38.193627    2569 generic.go:356] "Generic (PLEG): container finished" podID="8f05260f-b07b-451f-800f-51a1d736db01" containerID="835a8331f2183d64c67cad0d2e2dabb4e6f13d50163f7067d508cd33ab48a4f8" exitCode=0
Sep 11 16:47:38.193828 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:38.193727    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd" event={"ID":"8f05260f-b07b-451f-800f-51a1d736db01","Type":"ContainerDied","Data":"835a8331f2183d64c67cad0d2e2dabb4e6f13d50163f7067d508cd33ab48a4f8"}
Sep 11 16:47:40.703520 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.703494    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:40.805420 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.805398    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6vrp9\" (UniqueName: \"kubernetes.io/projected/8f05260f-b07b-451f-800f-51a1d736db01-kube-api-access-6vrp9\") pod \"8f05260f-b07b-451f-800f-51a1d736db01\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") "
Sep 11 16:47:40.805531 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.805428    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-util\") pod \"8f05260f-b07b-451f-800f-51a1d736db01\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") "
Sep 11 16:47:40.805599 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.805537    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-bundle\") pod \"8f05260f-b07b-451f-800f-51a1d736db01\" (UID: \"8f05260f-b07b-451f-800f-51a1d736db01\") "
Sep 11 16:47:40.806380 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.806344    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-bundle" (OuterVolumeSpecName: "bundle") pod "8f05260f-b07b-451f-800f-51a1d736db01" (UID: "8f05260f-b07b-451f-800f-51a1d736db01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:40.807640 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.807611    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f05260f-b07b-451f-800f-51a1d736db01-kube-api-access-6vrp9" (OuterVolumeSpecName: "kube-api-access-6vrp9") pod "8f05260f-b07b-451f-800f-51a1d736db01" (UID: "8f05260f-b07b-451f-800f-51a1d736db01"). InnerVolumeSpecName "kube-api-access-6vrp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:47:40.810526 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.810503    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-util" (OuterVolumeSpecName: "util") pod "8f05260f-b07b-451f-800f-51a1d736db01" (UID: "8f05260f-b07b-451f-800f-51a1d736db01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:47:40.906961 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.906929    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:47:40.907097 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.906977    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6vrp9\" (UniqueName: \"kubernetes.io/projected/8f05260f-b07b-451f-800f-51a1d736db01-kube-api-access-6vrp9\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:47:40.907097 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:40.906988    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8f05260f-b07b-451f-800f-51a1d736db01-util\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:47:41.210844 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:41.210816    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd"
Sep 11 16:47:41.210844 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:41.210831    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0zdrrd" event={"ID":"8f05260f-b07b-451f-800f-51a1d736db01","Type":"ContainerDied","Data":"6e2c7e7b66b9b4a5db6ba5bc2f8631c7f1efa326cf35739b866d34b334fc6aa1"}
Sep 11 16:47:41.211074 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:41.210882    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e2c7e7b66b9b4a5db6ba5bc2f8631c7f1efa326cf35739b866d34b334fc6aa1"
Sep 11 16:47:41.212500 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:41.212475    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2" event={"ID":"7ed7d727-98f0-41b3-a4e4-66cd0591d617","Type":"ContainerStarted","Data":"3e7514e593eae217c10f54bb39649f94a00e0bac14b92572397137a5fe09fae2"}
Sep 11 16:47:42.218970 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:42.218939    2569 generic.go:356] "Generic (PLEG): container finished" podID="7ed7d727-98f0-41b3-a4e4-66cd0591d617" containerID="3e7514e593eae217c10f54bb39649f94a00e0bac14b92572397137a5fe09fae2" exitCode=0
Sep 11 16:47:42.219335 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:42.218982    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2" event={"ID":"7ed7d727-98f0-41b3-a4e4-66cd0591d617","Type":"ContainerDied","Data":"3e7514e593eae217c10f54bb39649f94a00e0bac14b92572397137a5fe09fae2"}
Sep 11 16:47:43.226212 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:43.226171    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2" event={"ID":"7ed7d727-98f0-41b3-a4e4-66cd0591d617","Type":"ContainerStarted","Data":"152d399ef49daa2985728faee88d51696579c77b1ad39c501cc48d4aaddeda27"}
Sep 11 16:47:43.226589 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:43.226255    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:54.233239 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.233209    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2"
Sep 11 16:47:54.255702 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.255651    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d67cb4f96-jdqj2" podStartSLOduration=12.886711916 podStartE2EDuration="17.255616576s" totalImagesPullingTime="3.295063677s" totalInitContainerRuntime="1.073840983s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:47:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:47:43.263916077 +0000 UTC m=+273.823307467" watchObservedRunningTime="2026-09-11 16:47:54.255616576 +0000 UTC m=+284.815007962"
Sep 11 16:47:54.493629 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.493552    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"]
Sep 11 16:47:54.493976 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.493958    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f05260f-b07b-451f-800f-51a1d736db01" containerName="pull"
Sep 11 16:47:54.493976 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.493978    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f05260f-b07b-451f-800f-51a1d736db01" containerName="pull"
Sep 11 16:47:54.494137 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.493994    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f05260f-b07b-451f-800f-51a1d736db01" containerName="extract"
Sep 11 16:47:54.494137 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.494001    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f05260f-b07b-451f-800f-51a1d736db01" containerName="extract"
Sep 11 16:47:54.494137 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.494022    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f05260f-b07b-451f-800f-51a1d736db01" containerName="util"
Sep 11 16:47:54.494137 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.494029    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f05260f-b07b-451f-800f-51a1d736db01" containerName="util"
Sep 11 16:47:54.494137 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.494102    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f05260f-b07b-451f-800f-51a1d736db01" containerName="extract"
Sep 11 16:47:54.501999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.501978    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.504930 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.504900    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 11 16:47:54.505159 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.505060    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 11 16:47:54.505255 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.505185    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 11 16:47:54.505331 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.505305    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nv6xb\""
Sep 11 16:47:54.505393 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.505318    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 11 16:47:54.505645 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.505627    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 11 16:47:54.507363 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.507340    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"]
Sep 11 16:47:54.620917 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.620884    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-manager-config\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.620917 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.620917    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wkkj\" (UniqueName: \"kubernetes.io/projected/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-kube-api-access-8wkkj\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.621112 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.620951    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-metrics-cert\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.621112 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.621003    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-cert\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.722205 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.722175    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-metrics-cert\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.722292 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.722218    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-cert\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.722363 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.722344    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-manager-config\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.722397 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.722373    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wkkj\" (UniqueName: \"kubernetes.io/projected/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-kube-api-access-8wkkj\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.723042 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.723020    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-manager-config\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.724871 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.724842    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-cert\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.724971 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.724906    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-metrics-cert\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.731500 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.731481    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wkkj\" (UniqueName: \"kubernetes.io/projected/5b6f717a-5cf1-4b95-b84d-444dca5f36ac-kube-api-access-8wkkj\") pod \"lws-controller-manager-67c876df9b-rtdxw\" (UID: \"5b6f717a-5cf1-4b95-b84d-444dca5f36ac\") " pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:54.812700 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:54.812640    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:55.088133 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:55.088108    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"]
Sep 11 16:47:55.090211 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:47:55.090175    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b6f717a_5cf1_4b95_b84d_444dca5f36ac.slice/crio-86d8b18e5a6310be7f590ff424c4ec16b9442fd556f64e42f34aa7572a8eb299 WatchSource:0}: Error finding container 86d8b18e5a6310be7f590ff424c4ec16b9442fd556f64e42f34aa7572a8eb299: Status 404 returned error can't find the container with id 86d8b18e5a6310be7f590ff424c4ec16b9442fd556f64e42f34aa7572a8eb299
Sep 11 16:47:55.282415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:55.282383    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw" event={"ID":"5b6f717a-5cf1-4b95-b84d-444dca5f36ac","Type":"ContainerStarted","Data":"86d8b18e5a6310be7f590ff424c4ec16b9442fd556f64e42f34aa7572a8eb299"}
Sep 11 16:47:56.722729 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.722696    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"]
Sep 11 16:47:56.726043 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.726027    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:56.734291 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.734267    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 16:47:56.734416 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.734307    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 16:47:56.734416 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.734312    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 16:47:56.734839 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.734817    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 16:47:56.735044 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.735029    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6gs4n\""
Sep 11 16:47:56.744828 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.744782    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"]
Sep 11 16:47:56.840486 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.840458    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd3eed86-d6d9-4fac-9a91-993a06d2c0c1-tmp\") pod \"kube-auth-proxy-75dc676c8d-f6b82\" (UID: \"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1\") " pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:56.840677 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.840497    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5xb2\" (UniqueName: \"kubernetes.io/projected/fd3eed86-d6d9-4fac-9a91-993a06d2c0c1-kube-api-access-l5xb2\") pod \"kube-auth-proxy-75dc676c8d-f6b82\" (UID: \"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1\") " pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:56.840677 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.840623    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd3eed86-d6d9-4fac-9a91-993a06d2c0c1-tls-certs\") pod \"kube-auth-proxy-75dc676c8d-f6b82\" (UID: \"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1\") " pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:56.942013 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.941983    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd3eed86-d6d9-4fac-9a91-993a06d2c0c1-tmp\") pod \"kube-auth-proxy-75dc676c8d-f6b82\" (UID: \"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1\") " pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:56.942195 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.942029    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5xb2\" (UniqueName: \"kubernetes.io/projected/fd3eed86-d6d9-4fac-9a91-993a06d2c0c1-kube-api-access-l5xb2\") pod \"kube-auth-proxy-75dc676c8d-f6b82\" (UID: \"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1\") " pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:56.942195 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.942085    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd3eed86-d6d9-4fac-9a91-993a06d2c0c1-tls-certs\") pod \"kube-auth-proxy-75dc676c8d-f6b82\" (UID: \"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1\") " pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:56.944334 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.944309    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd3eed86-d6d9-4fac-9a91-993a06d2c0c1-tmp\") pod \"kube-auth-proxy-75dc676c8d-f6b82\" (UID: \"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1\") " pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:56.944532 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.944447    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd3eed86-d6d9-4fac-9a91-993a06d2c0c1-tls-certs\") pod \"kube-auth-proxy-75dc676c8d-f6b82\" (UID: \"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1\") " pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:56.951633 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:56.951612    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5xb2\" (UniqueName: \"kubernetes.io/projected/fd3eed86-d6d9-4fac-9a91-993a06d2c0c1-kube-api-access-l5xb2\") pod \"kube-auth-proxy-75dc676c8d-f6b82\" (UID: \"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1\") " pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:57.037170 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:57.037139    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"
Sep 11 16:47:57.294662 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:57.294584    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw" event={"ID":"5b6f717a-5cf1-4b95-b84d-444dca5f36ac","Type":"ContainerStarted","Data":"b70209d16213271992d6660d5a98719c8262b410f596602886278ab5813cec7a"}
Sep 11 16:47:57.294812 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:57.294678    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:47:57.319508 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:57.319452    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82"]
Sep 11 16:47:57.320741 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:57.320706    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw" podStartSLOduration=1.775938047 podStartE2EDuration="3.320694401s" totalImagesPullingTime="1.544756354s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:47:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:47:57.317926892 +0000 UTC m=+287.877318281" watchObservedRunningTime="2026-09-11 16:47:57.320694401 +0000 UTC m=+287.880085788"
Sep 11 16:47:57.322995 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:47:57.322972    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd3eed86_d6d9_4fac_9a91_993a06d2c0c1.slice/crio-1710ea8fede379ba3406f25aa4363cf7949cb4909934b1cade91839de6353b25 WatchSource:0}: Error finding container 1710ea8fede379ba3406f25aa4363cf7949cb4909934b1cade91839de6353b25: Status 404 returned error can't find the container with id 1710ea8fede379ba3406f25aa4363cf7949cb4909934b1cade91839de6353b25
Sep 11 16:47:58.301351 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:47:58.301312    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82" event={"ID":"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1","Type":"ContainerStarted","Data":"1710ea8fede379ba3406f25aa4363cf7949cb4909934b1cade91839de6353b25"}
Sep 11 16:48:00.312919 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:48:00.312864    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82" event={"ID":"fd3eed86-d6d9-4fac-9a91-993a06d2c0c1","Type":"ContainerStarted","Data":"d1de6a7fbeaec5ae257487a294a75f15a568bc20b5228261a8c5c0ce4b3e37cd"}
Sep 11 16:48:00.344869 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:48:00.344825    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75dc676c8d-f6b82" podStartSLOduration=1.7472155539999998 podStartE2EDuration="4.344809243s" totalImagesPullingTime="2.597593689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:47:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:48:00.343602907 +0000 UTC m=+290.902994293" watchObservedRunningTime="2026-09-11 16:48:00.344809243 +0000 UTC m=+290.904200621"
Sep 11 16:48:08.304001 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:48:08.303971    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67c876df9b-rtdxw"
Sep 11 16:48:09.897788 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:48:09.897762    2569 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 16:49:11.828766 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.828736    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"]
Sep 11 16:49:11.832499 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.832481    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:11.837500 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.837483    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 16:49:11.838276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.838261    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 16:49:11.838569 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.838550    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-c758j\""
Sep 11 16:49:11.846398 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.846379    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"]
Sep 11 16:49:11.936851 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.936825    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"]
Sep 11 16:49:11.940192 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.940178    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:11.981112 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.981083    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:11.981228 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.981138    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p9ph\" (UniqueName: \"kubernetes.io/projected/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-kube-api-access-5p9ph\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:11.981228 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:11.981206    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:12.009029 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.008990    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"]
Sep 11 16:49:12.062777 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.062745    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"]
Sep 11 16:49:12.066186 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.066166    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.082016 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.081959    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p9ph\" (UniqueName: \"kubernetes.io/projected/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-kube-api-access-5p9ph\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:12.082016 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.082002    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.082135 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.082053    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:12.082135 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.082079    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sc98\" (UniqueName: \"kubernetes.io/projected/ea43833a-09f5-4121-9f31-cf2352689408-kube-api-access-9sc98\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.082135 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.082128    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.082278 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.082159    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:12.082392 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.082373    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:12.082445 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.082425    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:12.082849 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.082828    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"]
Sep 11 16:49:12.101037 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.101008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p9ph\" (UniqueName: \"kubernetes.io/projected/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-kube-api-access-5p9ph\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:12.141741 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.141713    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:12.162654 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.162630    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"]
Sep 11 16:49:12.166594 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.166573    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.181982 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.181957    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"]
Sep 11 16:49:12.183333 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.183308    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.183465 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.183344    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sc98\" (UniqueName: \"kubernetes.io/projected/ea43833a-09f5-4121-9f31-cf2352689408-kube-api-access-9sc98\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.183465 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.183370    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.183465 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.183439    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.183626 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.183501    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mmwb\" (UniqueName: \"kubernetes.io/projected/58da52bc-48db-4847-aef4-8ffcb16e5dce-kube-api-access-8mmwb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.183732 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.183629    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.183836 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.183792    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.183943 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.183928    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.208084 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.208027    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sc98\" (UniqueName: \"kubernetes.io/projected/ea43833a-09f5-4121-9f31-cf2352689408-kube-api-access-9sc98\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.249236 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.249203    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:12.284381 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.284349    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mmwb\" (UniqueName: \"kubernetes.io/projected/58da52bc-48db-4847-aef4-8ffcb16e5dce-kube-api-access-8mmwb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.284537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.284395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.284537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.284414    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.284537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.284464    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdsh8\" (UniqueName: \"kubernetes.io/projected/196e9706-d755-4b70-85ea-ab0b865d8243-kube-api-access-rdsh8\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.284668 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.284552    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.284668 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.284611    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.284923 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.284908    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.285000 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.284982    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.302947 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.301649    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mmwb\" (UniqueName: \"kubernetes.io/projected/58da52bc-48db-4847-aef4-8ffcb16e5dce-kube-api-access-8mmwb\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.375389 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.375312    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:12.385494 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.385466    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.385598 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.385502    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.385598 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.385578    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdsh8\" (UniqueName: \"kubernetes.io/projected/196e9706-d755-4b70-85ea-ab0b865d8243-kube-api-access-rdsh8\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.385946 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.385928    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.385997 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.385965    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.395974 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.395948    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdsh8\" (UniqueName: \"kubernetes.io/projected/196e9706-d755-4b70-85ea-ab0b865d8243-kube-api-access-rdsh8\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.433776 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.433748    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"]
Sep 11 16:49:12.437722 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:49:12.437681    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ef9832_f4dd_4437_97c4_4a0ef2795b46.slice/crio-915455f7446b7322c4402ac4f2abf16df2079fa78bc9aa7295e785d4814c4485 WatchSource:0}: Error finding container 915455f7446b7322c4402ac4f2abf16df2079fa78bc9aa7295e785d4814c4485: Status 404 returned error can't find the container with id 915455f7446b7322c4402ac4f2abf16df2079fa78bc9aa7295e785d4814c4485
Sep 11 16:49:12.476539 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.476518    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:12.535125 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.534902    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"]
Sep 11 16:49:12.539301 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:49:12.539272    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea43833a_09f5_4121_9f31_cf2352689408.slice/crio-9bdfbf1b06a37efb5c4b3247030c11a2c97173633cc0c475a775f6be5f8c217c WatchSource:0}: Error finding container 9bdfbf1b06a37efb5c4b3247030c11a2c97173633cc0c475a775f6be5f8c217c: Status 404 returned error can't find the container with id 9bdfbf1b06a37efb5c4b3247030c11a2c97173633cc0c475a775f6be5f8c217c
Sep 11 16:49:12.644709 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.644639    2569 generic.go:356] "Generic (PLEG): container finished" podID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerID="f6915ac2a0e1dbef525f5b41f03bb2733d755771992f12a09a633206d8a02078" exitCode=0
Sep 11 16:49:12.644900 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.644736    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg" event={"ID":"a5ef9832-f4dd-4437-97c4-4a0ef2795b46","Type":"ContainerDied","Data":"f6915ac2a0e1dbef525f5b41f03bb2733d755771992f12a09a633206d8a02078"}
Sep 11 16:49:12.644900 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.644792    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg" event={"ID":"a5ef9832-f4dd-4437-97c4-4a0ef2795b46","Type":"ContainerStarted","Data":"915455f7446b7322c4402ac4f2abf16df2079fa78bc9aa7295e785d4814c4485"}
Sep 11 16:49:12.646159 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.645960    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:49:12.646640 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.646607    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv" event={"ID":"ea43833a-09f5-4121-9f31-cf2352689408","Type":"ContainerStarted","Data":"23e7a03c65c49794a12393c7d9bed00febbbe9989fff29d3b028bef3a69b0b56"}
Sep 11 16:49:12.646716 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.646650    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv" event={"ID":"ea43833a-09f5-4121-9f31-cf2352689408","Type":"ContainerStarted","Data":"9bdfbf1b06a37efb5c4b3247030c11a2c97173633cc0c475a775f6be5f8c217c"}
Sep 11 16:49:12.656544 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.656515    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"]
Sep 11 16:49:12.658024 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:49:12.657998    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58da52bc_48db_4847_aef4_8ffcb16e5dce.slice/crio-2c719c10d80d3f2140edbd812ef159b3df5ab50ce70f8a3b59632ba1decba74f WatchSource:0}: Error finding container 2c719c10d80d3f2140edbd812ef159b3df5ab50ce70f8a3b59632ba1decba74f: Status 404 returned error can't find the container with id 2c719c10d80d3f2140edbd812ef159b3df5ab50ce70f8a3b59632ba1decba74f
Sep 11 16:49:12.755068 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:12.755030    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"]
Sep 11 16:49:12.756687 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:49:12.756661    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196e9706_d755_4b70_85ea_ab0b865d8243.slice/crio-d9da94550a20591a526ae74be900930db43ee26082f735cd32b2612a938e18f6 WatchSource:0}: Error finding container d9da94550a20591a526ae74be900930db43ee26082f735cd32b2612a938e18f6: Status 404 returned error can't find the container with id d9da94550a20591a526ae74be900930db43ee26082f735cd32b2612a938e18f6
Sep 11 16:49:13.654114 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.654087    2569 generic.go:356] "Generic (PLEG): container finished" podID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerID="1d3d37d2d7ad56aad84b2659ed3af7e66117f82f186f41819ecf65e9332783f2" exitCode=0
Sep 11 16:49:13.654503 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.654159    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg" event={"ID":"a5ef9832-f4dd-4437-97c4-4a0ef2795b46","Type":"ContainerDied","Data":"1d3d37d2d7ad56aad84b2659ed3af7e66117f82f186f41819ecf65e9332783f2"}
Sep 11 16:49:13.656158 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.655787    2569 generic.go:356] "Generic (PLEG): container finished" podID="ea43833a-09f5-4121-9f31-cf2352689408" containerID="23e7a03c65c49794a12393c7d9bed00febbbe9989fff29d3b028bef3a69b0b56" exitCode=0
Sep 11 16:49:13.656158 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.655888    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv" event={"ID":"ea43833a-09f5-4121-9f31-cf2352689408","Type":"ContainerDied","Data":"23e7a03c65c49794a12393c7d9bed00febbbe9989fff29d3b028bef3a69b0b56"}
Sep 11 16:49:13.657327 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.657300    2569 generic.go:356] "Generic (PLEG): container finished" podID="196e9706-d755-4b70-85ea-ab0b865d8243" containerID="4289c64accbb2c27153b307c06314b31f86fa61c758268f9dad62231a07ceb10" exitCode=0
Sep 11 16:49:13.657397 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.657376    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82" event={"ID":"196e9706-d755-4b70-85ea-ab0b865d8243","Type":"ContainerDied","Data":"4289c64accbb2c27153b307c06314b31f86fa61c758268f9dad62231a07ceb10"}
Sep 11 16:49:13.657464 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.657430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82" event={"ID":"196e9706-d755-4b70-85ea-ab0b865d8243","Type":"ContainerStarted","Data":"d9da94550a20591a526ae74be900930db43ee26082f735cd32b2612a938e18f6"}
Sep 11 16:49:13.666069 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.666044    2569 generic.go:356] "Generic (PLEG): container finished" podID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerID="9f28ca646348523d15c132f1ac1adcf3077c9b575984e5b2d1c0151c697f198b" exitCode=0
Sep 11 16:49:13.666145 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.666101    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs" event={"ID":"58da52bc-48db-4847-aef4-8ffcb16e5dce","Type":"ContainerDied","Data":"9f28ca646348523d15c132f1ac1adcf3077c9b575984e5b2d1c0151c697f198b"}
Sep 11 16:49:13.666185 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:13.666170    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs" event={"ID":"58da52bc-48db-4847-aef4-8ffcb16e5dce","Type":"ContainerStarted","Data":"2c719c10d80d3f2140edbd812ef159b3df5ab50ce70f8a3b59632ba1decba74f"}
Sep 11 16:49:14.674536 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:14.674501    2569 generic.go:356] "Generic (PLEG): container finished" podID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerID="021d641cf2657c91495e5c857e9dc2a4270d46b6e71ba869bcc1bbd0e03f3ddd" exitCode=0
Sep 11 16:49:14.674898 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:14.674580    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg" event={"ID":"a5ef9832-f4dd-4437-97c4-4a0ef2795b46","Type":"ContainerDied","Data":"021d641cf2657c91495e5c857e9dc2a4270d46b6e71ba869bcc1bbd0e03f3ddd"}
Sep 11 16:49:14.676290 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:14.676270    2569 generic.go:356] "Generic (PLEG): container finished" podID="ea43833a-09f5-4121-9f31-cf2352689408" containerID="bfdd4998f05dc87a98f758400753da3d6f6266a01f499e53c4ab6a73652e9783" exitCode=0
Sep 11 16:49:14.676381 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:14.676351    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv" event={"ID":"ea43833a-09f5-4121-9f31-cf2352689408","Type":"ContainerDied","Data":"bfdd4998f05dc87a98f758400753da3d6f6266a01f499e53c4ab6a73652e9783"}
Sep 11 16:49:15.683142 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.683113    2569 generic.go:356] "Generic (PLEG): container finished" podID="ea43833a-09f5-4121-9f31-cf2352689408" containerID="97a45073eff61ead3ce66d7b0ce0bf1ba9c2ebebbb13ad6076a7307bc8bf1982" exitCode=0
Sep 11 16:49:15.683544 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.683186    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv" event={"ID":"ea43833a-09f5-4121-9f31-cf2352689408","Type":"ContainerDied","Data":"97a45073eff61ead3ce66d7b0ce0bf1ba9c2ebebbb13ad6076a7307bc8bf1982"}
Sep 11 16:49:15.684995 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.684972    2569 generic.go:356] "Generic (PLEG): container finished" podID="196e9706-d755-4b70-85ea-ab0b865d8243" containerID="b38b660c1bddc7240f8f1dc921210b2c0640726129c05846c3f279660b5782a5" exitCode=0
Sep 11 16:49:15.685095 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.685038    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82" event={"ID":"196e9706-d755-4b70-85ea-ab0b865d8243","Type":"ContainerDied","Data":"b38b660c1bddc7240f8f1dc921210b2c0640726129c05846c3f279660b5782a5"}
Sep 11 16:49:15.687106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.687086    2569 generic.go:356] "Generic (PLEG): container finished" podID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerID="b3eb450c137879654d066d1e548c472e7dca64a4f81f69ce7e50be1f80158188" exitCode=0
Sep 11 16:49:15.687288 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.687181    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs" event={"ID":"58da52bc-48db-4847-aef4-8ffcb16e5dce","Type":"ContainerDied","Data":"b3eb450c137879654d066d1e548c472e7dca64a4f81f69ce7e50be1f80158188"}
Sep 11 16:49:15.833474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.833220    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:15.917842 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.917793    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-util\") pod \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") "
Sep 11 16:49:15.917966 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.917899    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5p9ph\" (UniqueName: \"kubernetes.io/projected/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-kube-api-access-5p9ph\") pod \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") "
Sep 11 16:49:15.918004 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.917965    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-bundle\") pod \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\" (UID: \"a5ef9832-f4dd-4437-97c4-4a0ef2795b46\") "
Sep 11 16:49:15.918407 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.918381    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-bundle" (OuterVolumeSpecName: "bundle") pod "a5ef9832-f4dd-4437-97c4-4a0ef2795b46" (UID: "a5ef9832-f4dd-4437-97c4-4a0ef2795b46"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:49:15.920046 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.920020    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-kube-api-access-5p9ph" (OuterVolumeSpecName: "kube-api-access-5p9ph") pod "a5ef9832-f4dd-4437-97c4-4a0ef2795b46" (UID: "a5ef9832-f4dd-4437-97c4-4a0ef2795b46"). InnerVolumeSpecName "kube-api-access-5p9ph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:49:15.922521 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:15.922501    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-util" (OuterVolumeSpecName: "util") pod "a5ef9832-f4dd-4437-97c4-4a0ef2795b46" (UID: "a5ef9832-f4dd-4437-97c4-4a0ef2795b46"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:49:16.019224 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.019194    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:16.019224 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.019219    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-util\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:16.019224 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.019229    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p9ph\" (UniqueName: \"kubernetes.io/projected/a5ef9832-f4dd-4437-97c4-4a0ef2795b46-kube-api-access-5p9ph\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:16.694841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.694788    2569 generic.go:356] "Generic (PLEG): container finished" podID="196e9706-d755-4b70-85ea-ab0b865d8243" containerID="ca669b90f5301fc37561d9727b5e4db53e03506f21eeb94be8f59b7ef597e166" exitCode=0
Sep 11 16:49:16.694841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.694835    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82" event={"ID":"196e9706-d755-4b70-85ea-ab0b865d8243","Type":"ContainerDied","Data":"ca669b90f5301fc37561d9727b5e4db53e03506f21eeb94be8f59b7ef597e166"}
Sep 11 16:49:16.696957 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.696936    2569 generic.go:356] "Generic (PLEG): container finished" podID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerID="b325fa4bf9f777690400a2e9f5b99524901f4150db45159ad546f60513b640dd" exitCode=0
Sep 11 16:49:16.697086 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.697011    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs" event={"ID":"58da52bc-48db-4847-aef4-8ffcb16e5dce","Type":"ContainerDied","Data":"b325fa4bf9f777690400a2e9f5b99524901f4150db45159ad546f60513b640dd"}
Sep 11 16:49:16.698912 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.698894    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg"
Sep 11 16:49:16.699041 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.698924    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d72swjg" event={"ID":"a5ef9832-f4dd-4437-97c4-4a0ef2795b46","Type":"ContainerDied","Data":"915455f7446b7322c4402ac4f2abf16df2079fa78bc9aa7295e785d4814c4485"}
Sep 11 16:49:16.699041 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.698953    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="915455f7446b7322c4402ac4f2abf16df2079fa78bc9aa7295e785d4814c4485"
Sep 11 16:49:16.832029 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.832005    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:16.926707 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.926683    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-util\") pod \"ea43833a-09f5-4121-9f31-cf2352689408\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") "
Sep 11 16:49:16.926923 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.926757    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-bundle\") pod \"ea43833a-09f5-4121-9f31-cf2352689408\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") "
Sep 11 16:49:16.926923 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.926789    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9sc98\" (UniqueName: \"kubernetes.io/projected/ea43833a-09f5-4121-9f31-cf2352689408-kube-api-access-9sc98\") pod \"ea43833a-09f5-4121-9f31-cf2352689408\" (UID: \"ea43833a-09f5-4121-9f31-cf2352689408\") "
Sep 11 16:49:16.927184 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.927158    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-bundle" (OuterVolumeSpecName: "bundle") pod "ea43833a-09f5-4121-9f31-cf2352689408" (UID: "ea43833a-09f5-4121-9f31-cf2352689408"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:49:16.929069 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.929038    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea43833a-09f5-4121-9f31-cf2352689408-kube-api-access-9sc98" (OuterVolumeSpecName: "kube-api-access-9sc98") pod "ea43833a-09f5-4121-9f31-cf2352689408" (UID: "ea43833a-09f5-4121-9f31-cf2352689408"). InnerVolumeSpecName "kube-api-access-9sc98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:49:16.931764 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:16.931730    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-util" (OuterVolumeSpecName: "util") pod "ea43833a-09f5-4121-9f31-cf2352689408" (UID: "ea43833a-09f5-4121-9f31-cf2352689408"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:49:17.028158 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.028130    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-util\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:17.028325 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.028173    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ea43833a-09f5-4121-9f31-cf2352689408-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:17.028325 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.028184    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9sc98\" (UniqueName: \"kubernetes.io/projected/ea43833a-09f5-4121-9f31-cf2352689408-kube-api-access-9sc98\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:17.705324 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.705293    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv"
Sep 11 16:49:17.705324 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.705316    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gvftv" event={"ID":"ea43833a-09f5-4121-9f31-cf2352689408","Type":"ContainerDied","Data":"9bdfbf1b06a37efb5c4b3247030c11a2c97173633cc0c475a775f6be5f8c217c"}
Sep 11 16:49:17.705733 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.705358    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9bdfbf1b06a37efb5c4b3247030c11a2c97173633cc0c475a775f6be5f8c217c"
Sep 11 16:49:17.839296 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.839273    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:17.853510 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.853492    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:17.932733 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.932710    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-util\") pod \"58da52bc-48db-4847-aef4-8ffcb16e5dce\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") "
Sep 11 16:49:17.932927 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.932743    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-bundle\") pod \"58da52bc-48db-4847-aef4-8ffcb16e5dce\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") "
Sep 11 16:49:17.932927 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.932761    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mmwb\" (UniqueName: \"kubernetes.io/projected/58da52bc-48db-4847-aef4-8ffcb16e5dce-kube-api-access-8mmwb\") pod \"58da52bc-48db-4847-aef4-8ffcb16e5dce\" (UID: \"58da52bc-48db-4847-aef4-8ffcb16e5dce\") "
Sep 11 16:49:17.932927 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.932780    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-util\") pod \"196e9706-d755-4b70-85ea-ab0b865d8243\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") "
Sep 11 16:49:17.932927 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.932832    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdsh8\" (UniqueName: \"kubernetes.io/projected/196e9706-d755-4b70-85ea-ab0b865d8243-kube-api-access-rdsh8\") pod \"196e9706-d755-4b70-85ea-ab0b865d8243\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") "
Sep 11 16:49:17.932927 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.932884    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-bundle\") pod \"196e9706-d755-4b70-85ea-ab0b865d8243\" (UID: \"196e9706-d755-4b70-85ea-ab0b865d8243\") "
Sep 11 16:49:17.933407 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.933380    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-bundle" (OuterVolumeSpecName: "bundle") pod "58da52bc-48db-4847-aef4-8ffcb16e5dce" (UID: "58da52bc-48db-4847-aef4-8ffcb16e5dce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:49:17.933517 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.933472    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-bundle" (OuterVolumeSpecName: "bundle") pod "196e9706-d755-4b70-85ea-ab0b865d8243" (UID: "196e9706-d755-4b70-85ea-ab0b865d8243"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:49:17.935022 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.934994    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/196e9706-d755-4b70-85ea-ab0b865d8243-kube-api-access-rdsh8" (OuterVolumeSpecName: "kube-api-access-rdsh8") pod "196e9706-d755-4b70-85ea-ab0b865d8243" (UID: "196e9706-d755-4b70-85ea-ab0b865d8243"). InnerVolumeSpecName "kube-api-access-rdsh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:49:17.935112 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:17.935043    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58da52bc-48db-4847-aef4-8ffcb16e5dce-kube-api-access-8mmwb" (OuterVolumeSpecName: "kube-api-access-8mmwb") pod "58da52bc-48db-4847-aef4-8ffcb16e5dce" (UID: "58da52bc-48db-4847-aef4-8ffcb16e5dce"). InnerVolumeSpecName "kube-api-access-8mmwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:49:18.033932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.033870    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:18.033932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.033896    2569 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:18.033932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.033906    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mmwb\" (UniqueName: \"kubernetes.io/projected/58da52bc-48db-4847-aef4-8ffcb16e5dce-kube-api-access-8mmwb\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:18.033932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.033915    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdsh8\" (UniqueName: \"kubernetes.io/projected/196e9706-d755-4b70-85ea-ab0b865d8243-kube-api-access-rdsh8\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:18.124233 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.124193    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-util" (OuterVolumeSpecName: "util") pod "58da52bc-48db-4847-aef4-8ffcb16e5dce" (UID: "58da52bc-48db-4847-aef4-8ffcb16e5dce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:49:18.125273 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.125251    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-util" (OuterVolumeSpecName: "util") pod "196e9706-d755-4b70-85ea-ab0b865d8243" (UID: "196e9706-d755-4b70-85ea-ab0b865d8243"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 16:49:18.135161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.135145    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/58da52bc-48db-4847-aef4-8ffcb16e5dce-util\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:18.135161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.135161    2569 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/196e9706-d755-4b70-85ea-ab0b865d8243-util\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:49:18.711692 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.711656    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82" event={"ID":"196e9706-d755-4b70-85ea-ab0b865d8243","Type":"ContainerDied","Data":"d9da94550a20591a526ae74be900930db43ee26082f735cd32b2612a938e18f6"}
Sep 11 16:49:18.711692 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.711683    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cc2c82"
Sep 11 16:49:18.712220 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.711708    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9da94550a20591a526ae74be900930db43ee26082f735cd32b2612a938e18f6"
Sep 11 16:49:18.713561 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.713546    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs"
Sep 11 16:49:18.713659 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.713560    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847aqmnhs" event={"ID":"58da52bc-48db-4847-aef4-8ffcb16e5dce","Type":"ContainerDied","Data":"2c719c10d80d3f2140edbd812ef159b3df5ab50ce70f8a3b59632ba1decba74f"}
Sep 11 16:49:18.713659 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:18.713599    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c719c10d80d3f2140edbd812ef159b3df5ab50ce70f8a3b59632ba1decba74f"
Sep 11 16:49:26.977889 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.977859    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-568bd898f4-ls4m7"]
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978152    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerName="util"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978162    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerName="util"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978173    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196e9706-d755-4b70-85ea-ab0b865d8243" containerName="util"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978178    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="196e9706-d755-4b70-85ea-ab0b865d8243" containerName="util"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978184    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerName="util"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978189    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerName="util"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978197    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerName="pull"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978201    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerName="pull"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978210    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea43833a-09f5-4121-9f31-cf2352689408" containerName="pull"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978216    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea43833a-09f5-4121-9f31-cf2352689408" containerName="pull"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978223    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerName="extract"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978227    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerName="extract"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978233    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea43833a-09f5-4121-9f31-cf2352689408" containerName="extract"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978239    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea43833a-09f5-4121-9f31-cf2352689408" containerName="extract"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978247    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerName="extract"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978252    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerName="extract"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978258    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerName="pull"
Sep 11 16:49:26.978252 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978263    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerName="pull"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978271    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea43833a-09f5-4121-9f31-cf2352689408" containerName="util"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978276    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea43833a-09f5-4121-9f31-cf2352689408" containerName="util"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978282    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196e9706-d755-4b70-85ea-ab0b865d8243" containerName="pull"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978286    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="196e9706-d755-4b70-85ea-ab0b865d8243" containerName="pull"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978291    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="196e9706-d755-4b70-85ea-ab0b865d8243" containerName="extract"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978295    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="196e9706-d755-4b70-85ea-ab0b865d8243" containerName="extract"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978343    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea43833a-09f5-4121-9f31-cf2352689408" containerName="extract"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978350    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="196e9706-d755-4b70-85ea-ab0b865d8243" containerName="extract"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978357    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5ef9832-f4dd-4437-97c4-4a0ef2795b46" containerName="extract"
Sep 11 16:49:26.978785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.978361    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="58da52bc-48db-4847-aef4-8ffcb16e5dce" containerName="extract"
Sep 11 16:49:26.983443 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:26.983423    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.000862 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.000840    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568bd898f4-ls4m7"]
Sep 11 16:49:27.109013 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.108979    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-service-ca\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.109013 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.109015    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6a7466a-4802-4788-94be-247ec53abb6a-console-serving-cert\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.109229 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.109035    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6a7466a-4802-4788-94be-247ec53abb6a-console-oauth-config\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.109229 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.109093    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-trusted-ca-bundle\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.109229 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.109132    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtcr\" (UniqueName: \"kubernetes.io/projected/f6a7466a-4802-4788-94be-247ec53abb6a-kube-api-access-tjtcr\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.109229 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.109204    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-console-config\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.109369 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.109241    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-oauth-serving-cert\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.210167 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.210129    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-service-ca\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.210167 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.210168    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6a7466a-4802-4788-94be-247ec53abb6a-console-serving-cert\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.210410 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.210185    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6a7466a-4802-4788-94be-247ec53abb6a-console-oauth-config\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.210410 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.210202    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-trusted-ca-bundle\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.210410 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.210217    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtcr\" (UniqueName: \"kubernetes.io/projected/f6a7466a-4802-4788-94be-247ec53abb6a-kube-api-access-tjtcr\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.210410 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.210272    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-console-config\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.210410 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.210332    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-oauth-serving-cert\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.211113 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.211090    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-console-config\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.211237 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.211151    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-oauth-serving-cert\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.211237 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.211163    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-trusted-ca-bundle\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.211237 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.211225    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6a7466a-4802-4788-94be-247ec53abb6a-service-ca\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.212864 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.212840    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6a7466a-4802-4788-94be-247ec53abb6a-console-oauth-config\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.212958 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.212885    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6a7466a-4802-4788-94be-247ec53abb6a-console-serving-cert\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.232609 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.232554    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtcr\" (UniqueName: \"kubernetes.io/projected/f6a7466a-4802-4788-94be-247ec53abb6a-kube-api-access-tjtcr\") pod \"console-568bd898f4-ls4m7\" (UID: \"f6a7466a-4802-4788-94be-247ec53abb6a\") " pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.292172 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.292144    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:27.580027 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.579946    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-568bd898f4-ls4m7"]
Sep 11 16:49:27.583274 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:49:27.583249    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a7466a_4802_4788_94be_247ec53abb6a.slice/crio-1226e85cca246a5b82dcd16e50d4934285fe912f0ce4b011bb0a5d08559e2afd WatchSource:0}: Error finding container 1226e85cca246a5b82dcd16e50d4934285fe912f0ce4b011bb0a5d08559e2afd: Status 404 returned error can't find the container with id 1226e85cca246a5b82dcd16e50d4934285fe912f0ce4b011bb0a5d08559e2afd
Sep 11 16:49:27.761604 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.761569    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bd898f4-ls4m7" event={"ID":"f6a7466a-4802-4788-94be-247ec53abb6a","Type":"ContainerStarted","Data":"7e0b8fbd778dc7059321b58af110f85893956eaeec8202cc926db0cf145243c1"}
Sep 11 16:49:27.761791 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.761615    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-568bd898f4-ls4m7" event={"ID":"f6a7466a-4802-4788-94be-247ec53abb6a","Type":"ContainerStarted","Data":"1226e85cca246a5b82dcd16e50d4934285fe912f0ce4b011bb0a5d08559e2afd"}
Sep 11 16:49:27.789358 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:27.789312    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-568bd898f4-ls4m7" podStartSLOduration=1.7892968919999999 podStartE2EDuration="1.789296892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:27.788052435 +0000 UTC m=+378.347443822" watchObservedRunningTime="2026-09-11 16:49:27.789296892 +0000 UTC m=+378.348688278"
Sep 11 16:49:30.055707 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.055675    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"]
Sep 11 16:49:30.059371 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.059356    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"
Sep 11 16:49:30.061938 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.061915    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 16:49:30.062384 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.062364    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 16:49:30.062478 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.062371    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 16:49:30.062672 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.062656    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-65djx\""
Sep 11 16:49:30.070611 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.070589    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"]
Sep 11 16:49:30.233848 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.233786    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s27mh\" (UniqueName: \"kubernetes.io/projected/f0ab266b-6798-4080-ab76-d8e111848b37-kube-api-access-s27mh\") pod \"dns-operator-controller-manager-7b84cd7c9c-xzf47\" (UID: \"f0ab266b-6798-4080-ab76-d8e111848b37\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"
Sep 11 16:49:30.335305 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.335205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s27mh\" (UniqueName: \"kubernetes.io/projected/f0ab266b-6798-4080-ab76-d8e111848b37-kube-api-access-s27mh\") pod \"dns-operator-controller-manager-7b84cd7c9c-xzf47\" (UID: \"f0ab266b-6798-4080-ab76-d8e111848b37\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"
Sep 11 16:49:30.345535 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.345504    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s27mh\" (UniqueName: \"kubernetes.io/projected/f0ab266b-6798-4080-ab76-d8e111848b37-kube-api-access-s27mh\") pod \"dns-operator-controller-manager-7b84cd7c9c-xzf47\" (UID: \"f0ab266b-6798-4080-ab76-d8e111848b37\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"
Sep 11 16:49:30.370867 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.370843    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"
Sep 11 16:49:30.650672 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.650647    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"]
Sep 11 16:49:30.652173 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:49:30.652147    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ab266b_6798_4080_ab76_d8e111848b37.slice/crio-72c16e8bdd84952506e11c4cfbef1fe832f3dd586033ea5938a77c7b87bb6a5a WatchSource:0}: Error finding container 72c16e8bdd84952506e11c4cfbef1fe832f3dd586033ea5938a77c7b87bb6a5a: Status 404 returned error can't find the container with id 72c16e8bdd84952506e11c4cfbef1fe832f3dd586033ea5938a77c7b87bb6a5a
Sep 11 16:49:30.779568 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:30.779535    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47" event={"ID":"f0ab266b-6798-4080-ab76-d8e111848b37","Type":"ContainerStarted","Data":"72c16e8bdd84952506e11c4cfbef1fe832f3dd586033ea5938a77c7b87bb6a5a"}
Sep 11 16:49:33.799668 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:33.799628    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47" event={"ID":"f0ab266b-6798-4080-ab76-d8e111848b37","Type":"ContainerStarted","Data":"a87cfe4eb8eb14aaa5d624b5b1076a55637c2faaf85551bb0ef86f18f12a3cfb"}
Sep 11 16:49:33.800084 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:33.799741    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"
Sep 11 16:49:33.821250 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:33.821206    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47" podStartSLOduration=1.0813220590000001 podStartE2EDuration="3.821191954s" totalImagesPullingTime="2.739869895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:33.818346094 +0000 UTC m=+384.377737481" watchObservedRunningTime="2026-09-11 16:49:33.821191954 +0000 UTC m=+384.380583340"
Sep 11 16:49:37.293125 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:37.293079    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:37.293520 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:37.293157    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:37.297899 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:37.297880    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:37.823210 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:37.823185    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-568bd898f4-ls4m7"
Sep 11 16:49:37.903929 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:37.903788    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ccffdc57-hhvlw"]
Sep 11 16:49:42.180315 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.180282    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"]
Sep 11 16:49:42.183740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.183723    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.189869 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.189844    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 16:49:42.190005 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.189851    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 16:49:42.190005 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.189928    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2xd5d\""
Sep 11 16:49:42.198521 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.198493    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"]
Sep 11 16:49:42.234372 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.234342    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d421d759-1129-4a5d-8cff-1a64870c963c-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-zvbkg\" (UID: \"d421d759-1129-4a5d-8cff-1a64870c963c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.234527 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.234413    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqcrj\" (UniqueName: \"kubernetes.io/projected/d421d759-1129-4a5d-8cff-1a64870c963c-kube-api-access-dqcrj\") pod \"kuadrant-console-plugin-fbdd4f445-zvbkg\" (UID: \"d421d759-1129-4a5d-8cff-1a64870c963c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.234527 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.234434    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d421d759-1129-4a5d-8cff-1a64870c963c-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-zvbkg\" (UID: \"d421d759-1129-4a5d-8cff-1a64870c963c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.335690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.335657    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqcrj\" (UniqueName: \"kubernetes.io/projected/d421d759-1129-4a5d-8cff-1a64870c963c-kube-api-access-dqcrj\") pod \"kuadrant-console-plugin-fbdd4f445-zvbkg\" (UID: \"d421d759-1129-4a5d-8cff-1a64870c963c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.335899 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.335699    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d421d759-1129-4a5d-8cff-1a64870c963c-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-zvbkg\" (UID: \"d421d759-1129-4a5d-8cff-1a64870c963c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.335899 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.335849    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d421d759-1129-4a5d-8cff-1a64870c963c-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-zvbkg\" (UID: \"d421d759-1129-4a5d-8cff-1a64870c963c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.336349 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.336326    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d421d759-1129-4a5d-8cff-1a64870c963c-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-zvbkg\" (UID: \"d421d759-1129-4a5d-8cff-1a64870c963c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.338372 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.338351    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/d421d759-1129-4a5d-8cff-1a64870c963c-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-zvbkg\" (UID: \"d421d759-1129-4a5d-8cff-1a64870c963c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.348326 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.348309    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqcrj\" (UniqueName: \"kubernetes.io/projected/d421d759-1129-4a5d-8cff-1a64870c963c-kube-api-access-dqcrj\") pod \"kuadrant-console-plugin-fbdd4f445-zvbkg\" (UID: \"d421d759-1129-4a5d-8cff-1a64870c963c\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.493556 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.493529    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"
Sep 11 16:49:42.776429 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.776401    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg"]
Sep 11 16:49:42.778946 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:49:42.778920    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd421d759_1129_4a5d_8cff_1a64870c963c.slice/crio-f80ee2734805459bb66d4fcc5c7fa574f57fed3fa682b980fc768b6d904b02ea WatchSource:0}: Error finding container f80ee2734805459bb66d4fcc5c7fa574f57fed3fa682b980fc768b6d904b02ea: Status 404 returned error can't find the container with id f80ee2734805459bb66d4fcc5c7fa574f57fed3fa682b980fc768b6d904b02ea
Sep 11 16:49:42.845677 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:42.845648    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg" event={"ID":"d421d759-1129-4a5d-8cff-1a64870c963c","Type":"ContainerStarted","Data":"f80ee2734805459bb66d4fcc5c7fa574f57fed3fa682b980fc768b6d904b02ea"}
Sep 11 16:49:44.806781 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:44.806755    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-xzf47"
Sep 11 16:49:47.882957 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:47.882924    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg" event={"ID":"d421d759-1129-4a5d-8cff-1a64870c963c","Type":"ContainerStarted","Data":"d46b55e1606904fe2366845a8a43aa659ed64f8cb44659059fbf1cefe2f3dcc7"}
Sep 11 16:49:47.899014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:49:47.898966    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-zvbkg" podStartSLOduration=1.408867162 podStartE2EDuration="5.898952312s" totalImagesPullingTime="4.49008515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:49:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:49:47.89788824 +0000 UTC m=+398.457279639" watchObservedRunningTime="2026-09-11 16:49:47.898952312 +0000 UTC m=+398.458343699"
Sep 11 16:50:02.924170 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:02.924112    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54ccffdc57-hhvlw" podUID="498c0edc-1ecc-4ce0-ac61-67c43948ddc4" containerName="console" containerID="cri-o://9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896" gracePeriod=15
Sep 11 16:50:03.173158 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.173129    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:50:03.308276 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308242    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-service-ca\") pod \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") "
Sep 11 16:50:03.308437 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308288    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-oauth-serving-cert\") pod \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") "
Sep 11 16:50:03.308437 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308322    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-trusted-ca-bundle\") pod \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") "
Sep 11 16:50:03.308437 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308376    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9qq9\" (UniqueName: \"kubernetes.io/projected/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-kube-api-access-s9qq9\") pod \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") "
Sep 11 16:50:03.308437 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308402    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-serving-cert\") pod \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") "
Sep 11 16:50:03.308437 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308424    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-oauth-config\") pod \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") "
Sep 11 16:50:03.308695 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308470    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-config\") pod \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\" (UID: \"498c0edc-1ecc-4ce0-ac61-67c43948ddc4\") "
Sep 11 16:50:03.308750 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308730    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-service-ca" (OuterVolumeSpecName: "service-ca") pod "498c0edc-1ecc-4ce0-ac61-67c43948ddc4" (UID: "498c0edc-1ecc-4ce0-ac61-67c43948ddc4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:50:03.308832 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308755    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "498c0edc-1ecc-4ce0-ac61-67c43948ddc4" (UID: "498c0edc-1ecc-4ce0-ac61-67c43948ddc4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:50:03.308954 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.308930    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "498c0edc-1ecc-4ce0-ac61-67c43948ddc4" (UID: "498c0edc-1ecc-4ce0-ac61-67c43948ddc4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:50:03.309054 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.309033    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-config" (OuterVolumeSpecName: "console-config") pod "498c0edc-1ecc-4ce0-ac61-67c43948ddc4" (UID: "498c0edc-1ecc-4ce0-ac61-67c43948ddc4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:50:03.310692 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.310666    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "498c0edc-1ecc-4ce0-ac61-67c43948ddc4" (UID: "498c0edc-1ecc-4ce0-ac61-67c43948ddc4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:50:03.310937 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.310913    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-kube-api-access-s9qq9" (OuterVolumeSpecName: "kube-api-access-s9qq9") pod "498c0edc-1ecc-4ce0-ac61-67c43948ddc4" (UID: "498c0edc-1ecc-4ce0-ac61-67c43948ddc4"). InnerVolumeSpecName "kube-api-access-s9qq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:50:03.311032 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.310954    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "498c0edc-1ecc-4ce0-ac61-67c43948ddc4" (UID: "498c0edc-1ecc-4ce0-ac61-67c43948ddc4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:50:03.409406 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.409377    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9qq9\" (UniqueName: \"kubernetes.io/projected/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-kube-api-access-s9qq9\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:03.409406 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.409401    2569 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-serving-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:03.409406 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.409410    2569 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-oauth-config\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:03.409590 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.409419    2569 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-console-config\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:03.409590 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.409428    2569 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:03.409590 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.409435    2569 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-oauth-serving-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:03.409590 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.409443    2569 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/498c0edc-1ecc-4ce0-ac61-67c43948ddc4-trusted-ca-bundle\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:03.966933 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.966900    2569 generic.go:356] "Generic (PLEG): container finished" podID="498c0edc-1ecc-4ce0-ac61-67c43948ddc4" containerID="9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896" exitCode=0
Sep 11 16:50:03.967380 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.966951    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54ccffdc57-hhvlw"
Sep 11 16:50:03.967380 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.966990    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccffdc57-hhvlw" event={"ID":"498c0edc-1ecc-4ce0-ac61-67c43948ddc4","Type":"ContainerDied","Data":"9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896"}
Sep 11 16:50:03.967380 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.967039    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54ccffdc57-hhvlw" event={"ID":"498c0edc-1ecc-4ce0-ac61-67c43948ddc4","Type":"ContainerDied","Data":"474249e12133bbf1594bf23f1fb252829dccceae755a62530b7d6e3d6bd10f0c"}
Sep 11 16:50:03.967380 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.967058    2569 scope.go:117] "RemoveContainer" containerID="9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896"
Sep 11 16:50:03.975901 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.975883    2569 scope.go:117] "RemoveContainer" containerID="9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896"
Sep 11 16:50:03.976173 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:50:03.976155    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896\": container with ID starting with 9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896 not found: ID does not exist" containerID="9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896"
Sep 11 16:50:03.976223 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.976181    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896"} err="failed to get container status \"9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896\": rpc error: code = NotFound desc = could not find container \"9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896\": container with ID starting with 9897c10130b81f56f395c9b380788e1e1742644500e490cd9ba28cefd6b16896 not found: ID does not exist"
Sep 11 16:50:03.988968 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.988936    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54ccffdc57-hhvlw"]
Sep 11 16:50:03.999402 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:03.999380    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54ccffdc57-hhvlw"]
Sep 11 16:50:05.926540 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:05.926510    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="498c0edc-1ecc-4ce0-ac61-67c43948ddc4" path="/var/lib/kubelet/pods/498c0edc-1ecc-4ce0-ac61-67c43948ddc4/volumes"
Sep 11 16:50:40.082749 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.082677    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4srjz"]
Sep 11 16:50:40.083245 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.083039    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="498c0edc-1ecc-4ce0-ac61-67c43948ddc4" containerName="console"
Sep 11 16:50:40.083245 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.083056    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="498c0edc-1ecc-4ce0-ac61-67c43948ddc4" containerName="console"
Sep 11 16:50:40.083245 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.083131    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="498c0edc-1ecc-4ce0-ac61-67c43948ddc4" containerName="console"
Sep 11 16:50:40.086004 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.085985    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:40.088164 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.088135    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 16:50:40.095341 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.095320    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4srjz"]
Sep 11 16:50:40.119150 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.119118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdch7\" (UniqueName: \"kubernetes.io/projected/8c59171e-959d-42e7-858f-e8492bbf31e9-kube-api-access-rdch7\") pod \"limitador-limitador-8588749977-4srjz\" (UID: \"8c59171e-959d-42e7-858f-e8492bbf31e9\") " pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:40.119295 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.119165    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c59171e-959d-42e7-858f-e8492bbf31e9-config-file\") pod \"limitador-limitador-8588749977-4srjz\" (UID: \"8c59171e-959d-42e7-858f-e8492bbf31e9\") " pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:40.177018 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.176987    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4srjz"]
Sep 11 16:50:40.220123 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.220089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c59171e-959d-42e7-858f-e8492bbf31e9-config-file\") pod \"limitador-limitador-8588749977-4srjz\" (UID: \"8c59171e-959d-42e7-858f-e8492bbf31e9\") " pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:40.220287 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.220169    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdch7\" (UniqueName: \"kubernetes.io/projected/8c59171e-959d-42e7-858f-e8492bbf31e9-kube-api-access-rdch7\") pod \"limitador-limitador-8588749977-4srjz\" (UID: \"8c59171e-959d-42e7-858f-e8492bbf31e9\") " pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:40.220691 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.220673    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c59171e-959d-42e7-858f-e8492bbf31e9-config-file\") pod \"limitador-limitador-8588749977-4srjz\" (UID: \"8c59171e-959d-42e7-858f-e8492bbf31e9\") " pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:40.238748 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.238728    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdch7\" (UniqueName: \"kubernetes.io/projected/8c59171e-959d-42e7-858f-e8492bbf31e9-kube-api-access-rdch7\") pod \"limitador-limitador-8588749977-4srjz\" (UID: \"8c59171e-959d-42e7-858f-e8492bbf31e9\") " pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:40.396702 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.396611    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:40.671227 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:40.671198    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4srjz"]
Sep 11 16:50:40.672596 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:50:40.672571    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c59171e_959d_42e7_858f_e8492bbf31e9.slice/crio-566f5b9facce5ca2fec0dfcfdc04e9b7ae57852f2b90c5e4ac0f44f3145f6807 WatchSource:0}: Error finding container 566f5b9facce5ca2fec0dfcfdc04e9b7ae57852f2b90c5e4ac0f44f3145f6807: Status 404 returned error can't find the container with id 566f5b9facce5ca2fec0dfcfdc04e9b7ae57852f2b90c5e4ac0f44f3145f6807
Sep 11 16:50:41.037150 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.037119    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w6stm"]
Sep 11 16:50:41.041342 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.041322    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm"
Sep 11 16:50:41.043926 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.043896    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rdt2v\""
Sep 11 16:50:41.050266 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.050244    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w6stm"]
Sep 11 16:50:41.129708 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.129677    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb5z2\" (UniqueName: \"kubernetes.io/projected/1f0d45ea-d4c5-40a7-81d7-942e1818b4d2-kube-api-access-hb5z2\") pod \"authorino-7bcfd8f9cd-w6stm\" (UID: \"1f0d45ea-d4c5-40a7-81d7-942e1818b4d2\") " pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm"
Sep 11 16:50:41.155371 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.155333    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4srjz" event={"ID":"8c59171e-959d-42e7-858f-e8492bbf31e9","Type":"ContainerStarted","Data":"566f5b9facce5ca2fec0dfcfdc04e9b7ae57852f2b90c5e4ac0f44f3145f6807"}
Sep 11 16:50:41.230373 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.230343    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb5z2\" (UniqueName: \"kubernetes.io/projected/1f0d45ea-d4c5-40a7-81d7-942e1818b4d2-kube-api-access-hb5z2\") pod \"authorino-7bcfd8f9cd-w6stm\" (UID: \"1f0d45ea-d4c5-40a7-81d7-942e1818b4d2\") " pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm"
Sep 11 16:50:41.246141 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.246108    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb5z2\" (UniqueName: \"kubernetes.io/projected/1f0d45ea-d4c5-40a7-81d7-942e1818b4d2-kube-api-access-hb5z2\") pod \"authorino-7bcfd8f9cd-w6stm\" (UID: \"1f0d45ea-d4c5-40a7-81d7-942e1818b4d2\") " pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm"
Sep 11 16:50:41.350785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.350713    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm"
Sep 11 16:50:41.364370 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.364347    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-dsbt4"]
Sep 11 16:50:41.367955 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.367933    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-dsbt4"
Sep 11 16:50:41.378357 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.378334    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-dsbt4"]
Sep 11 16:50:41.432575 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.432549    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w47k6\" (UniqueName: \"kubernetes.io/projected/e69e09d3-9166-460a-b86b-a82d9ae441a6-kube-api-access-w47k6\") pod \"authorino-59c974bd48-dsbt4\" (UID: \"e69e09d3-9166-460a-b86b-a82d9ae441a6\") " pod="kuadrant-system/authorino-59c974bd48-dsbt4"
Sep 11 16:50:41.534006 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.533973    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w47k6\" (UniqueName: \"kubernetes.io/projected/e69e09d3-9166-460a-b86b-a82d9ae441a6-kube-api-access-w47k6\") pod \"authorino-59c974bd48-dsbt4\" (UID: \"e69e09d3-9166-460a-b86b-a82d9ae441a6\") " pod="kuadrant-system/authorino-59c974bd48-dsbt4"
Sep 11 16:50:41.542838 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.542787    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w47k6\" (UniqueName: \"kubernetes.io/projected/e69e09d3-9166-460a-b86b-a82d9ae441a6-kube-api-access-w47k6\") pod \"authorino-59c974bd48-dsbt4\" (UID: \"e69e09d3-9166-460a-b86b-a82d9ae441a6\") " pod="kuadrant-system/authorino-59c974bd48-dsbt4"
Sep 11 16:50:41.629456 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.629433    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w6stm"]
Sep 11 16:50:41.631684 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:50:41.631661    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f0d45ea_d4c5_40a7_81d7_942e1818b4d2.slice/crio-277f01d71ea6b4a14eb6e21e71e6bf2ab4007b3c97cdf12422cfbbc16bbfe709 WatchSource:0}: Error finding container 277f01d71ea6b4a14eb6e21e71e6bf2ab4007b3c97cdf12422cfbbc16bbfe709: Status 404 returned error can't find the container with id 277f01d71ea6b4a14eb6e21e71e6bf2ab4007b3c97cdf12422cfbbc16bbfe709
Sep 11 16:50:41.683762 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.683739    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-dsbt4"
Sep 11 16:50:41.965634 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:41.965603    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-dsbt4"]
Sep 11 16:50:41.997826 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:50:41.997765    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode69e09d3_9166_460a_b86b_a82d9ae441a6.slice/crio-9463d1f7d674863c499c1dcdf96a7847a1230ee10d8ca8a581f0874952bee36b WatchSource:0}: Error finding container 9463d1f7d674863c499c1dcdf96a7847a1230ee10d8ca8a581f0874952bee36b: Status 404 returned error can't find the container with id 9463d1f7d674863c499c1dcdf96a7847a1230ee10d8ca8a581f0874952bee36b
Sep 11 16:50:42.165231 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:42.165196    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm" event={"ID":"1f0d45ea-d4c5-40a7-81d7-942e1818b4d2","Type":"ContainerStarted","Data":"277f01d71ea6b4a14eb6e21e71e6bf2ab4007b3c97cdf12422cfbbc16bbfe709"}
Sep 11 16:50:42.167071 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:42.167046    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4srjz" event={"ID":"8c59171e-959d-42e7-858f-e8492bbf31e9","Type":"ContainerStarted","Data":"48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911"}
Sep 11 16:50:42.167219 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:42.167141    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:42.168317 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:42.168296    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-dsbt4" event={"ID":"e69e09d3-9166-460a-b86b-a82d9ae441a6","Type":"ContainerStarted","Data":"9463d1f7d674863c499c1dcdf96a7847a1230ee10d8ca8a581f0874952bee36b"}
Sep 11 16:50:42.186273 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:42.186225    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-4srjz" podStartSLOduration=0.807253825 podStartE2EDuration="2.186210975s" totalImagesPullingTime="1.37895715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:50:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:50:42.186087636 +0000 UTC m=+452.745479023" watchObservedRunningTime="2026-09-11 16:50:42.186210975 +0000 UTC m=+452.745602362"
Sep 11 16:50:44.180854 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:44.180822    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-dsbt4" event={"ID":"e69e09d3-9166-460a-b86b-a82d9ae441a6","Type":"ContainerStarted","Data":"9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24"}
Sep 11 16:50:44.182404 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:44.182376    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm" event={"ID":"1f0d45ea-d4c5-40a7-81d7-942e1818b4d2","Type":"ContainerStarted","Data":"1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458"}
Sep 11 16:50:44.198608 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:44.198561    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-dsbt4" podStartSLOduration=1.800346179 podStartE2EDuration="3.198548268s" totalImagesPullingTime="1.398202089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:50:44.196292109 +0000 UTC m=+454.755683490" watchObservedRunningTime="2026-09-11 16:50:44.198548268 +0000 UTC m=+454.757939655"
Sep 11 16:50:44.211404 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:44.211355    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm" podStartSLOduration=1.451520886 podStartE2EDuration="3.211337723s" totalImagesPullingTime="1.759816837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:50:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:50:44.209440496 +0000 UTC m=+454.768831885" watchObservedRunningTime="2026-09-11 16:50:44.211337723 +0000 UTC m=+454.770729279"
Sep 11 16:50:44.244614 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:44.244579    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w6stm"]
Sep 11 16:50:46.192651 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:46.192613    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm" podUID="1f0d45ea-d4c5-40a7-81d7-942e1818b4d2" containerName="authorino" containerID="cri-o://1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458" gracePeriod=30
Sep 11 16:50:46.428283 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:46.428261    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm"
Sep 11 16:50:46.478670 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:46.478600    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb5z2\" (UniqueName: \"kubernetes.io/projected/1f0d45ea-d4c5-40a7-81d7-942e1818b4d2-kube-api-access-hb5z2\") pod \"1f0d45ea-d4c5-40a7-81d7-942e1818b4d2\" (UID: \"1f0d45ea-d4c5-40a7-81d7-942e1818b4d2\") "
Sep 11 16:50:46.480791 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:46.480767    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f0d45ea-d4c5-40a7-81d7-942e1818b4d2-kube-api-access-hb5z2" (OuterVolumeSpecName: "kube-api-access-hb5z2") pod "1f0d45ea-d4c5-40a7-81d7-942e1818b4d2" (UID: "1f0d45ea-d4c5-40a7-81d7-942e1818b4d2"). InnerVolumeSpecName "kube-api-access-hb5z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:50:46.579841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:46.579788    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb5z2\" (UniqueName: \"kubernetes.io/projected/1f0d45ea-d4c5-40a7-81d7-942e1818b4d2-kube-api-access-hb5z2\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:47.199621 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.199590    2569 generic.go:356] "Generic (PLEG): container finished" podID="1f0d45ea-d4c5-40a7-81d7-942e1818b4d2" containerID="1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458" exitCode=0
Sep 11 16:50:47.200053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.199634    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm" event={"ID":"1f0d45ea-d4c5-40a7-81d7-942e1818b4d2","Type":"ContainerDied","Data":"1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458"}
Sep 11 16:50:47.200053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.199643    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm"
Sep 11 16:50:47.200053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.199662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-w6stm" event={"ID":"1f0d45ea-d4c5-40a7-81d7-942e1818b4d2","Type":"ContainerDied","Data":"277f01d71ea6b4a14eb6e21e71e6bf2ab4007b3c97cdf12422cfbbc16bbfe709"}
Sep 11 16:50:47.200053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.199677    2569 scope.go:117] "RemoveContainer" containerID="1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458"
Sep 11 16:50:47.212023 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.212004    2569 scope.go:117] "RemoveContainer" containerID="1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458"
Sep 11 16:50:47.212379 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:50:47.212348    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458\": container with ID starting with 1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458 not found: ID does not exist" containerID="1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458"
Sep 11 16:50:47.212472 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.212388    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458"} err="failed to get container status \"1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458\": rpc error: code = NotFound desc = could not find container \"1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458\": container with ID starting with 1c9aaac27819e9219229e61a3abc165b29cd80abd7c397aad369ba7f0f871458 not found: ID does not exist"
Sep 11 16:50:47.232088 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.232063    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w6stm"]
Sep 11 16:50:47.235335 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.235314    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-w6stm"]
Sep 11 16:50:47.926648 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:47.926613    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f0d45ea-d4c5-40a7-81d7-942e1818b4d2" path="/var/lib/kubelet/pods/1f0d45ea-d4c5-40a7-81d7-942e1818b4d2/volumes"
Sep 11 16:50:53.174885 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:53.174857    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:53.351958 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:53.351924    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4srjz"]
Sep 11 16:50:53.352161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:53.352134    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-4srjz" podUID="8c59171e-959d-42e7-858f-e8492bbf31e9" containerName="limitador" containerID="cri-o://48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911" gracePeriod=30
Sep 11 16:50:53.894290 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:53.894267    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:54.040564 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.040535    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c59171e-959d-42e7-858f-e8492bbf31e9-config-file\") pod \"8c59171e-959d-42e7-858f-e8492bbf31e9\" (UID: \"8c59171e-959d-42e7-858f-e8492bbf31e9\") "
Sep 11 16:50:54.040758 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.040637    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdch7\" (UniqueName: \"kubernetes.io/projected/8c59171e-959d-42e7-858f-e8492bbf31e9-kube-api-access-rdch7\") pod \"8c59171e-959d-42e7-858f-e8492bbf31e9\" (UID: \"8c59171e-959d-42e7-858f-e8492bbf31e9\") "
Sep 11 16:50:54.040921 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.040896    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c59171e-959d-42e7-858f-e8492bbf31e9-config-file" (OuterVolumeSpecName: "config-file") pod "8c59171e-959d-42e7-858f-e8492bbf31e9" (UID: "8c59171e-959d-42e7-858f-e8492bbf31e9"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:50:54.042791 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.042772    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c59171e-959d-42e7-858f-e8492bbf31e9-kube-api-access-rdch7" (OuterVolumeSpecName: "kube-api-access-rdch7") pod "8c59171e-959d-42e7-858f-e8492bbf31e9" (UID: "8c59171e-959d-42e7-858f-e8492bbf31e9"). InnerVolumeSpecName "kube-api-access-rdch7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:50:54.142202 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.142164    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdch7\" (UniqueName: \"kubernetes.io/projected/8c59171e-959d-42e7-858f-e8492bbf31e9-kube-api-access-rdch7\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:54.142202 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.142193    2569 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8c59171e-959d-42e7-858f-e8492bbf31e9-config-file\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:50:54.236411 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.236381    2569 generic.go:356] "Generic (PLEG): container finished" podID="8c59171e-959d-42e7-858f-e8492bbf31e9" containerID="48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911" exitCode=0
Sep 11 16:50:54.236750 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.236424    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-4srjz"
Sep 11 16:50:54.236750 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.236465    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4srjz" event={"ID":"8c59171e-959d-42e7-858f-e8492bbf31e9","Type":"ContainerDied","Data":"48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911"}
Sep 11 16:50:54.236750 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.236523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-4srjz" event={"ID":"8c59171e-959d-42e7-858f-e8492bbf31e9","Type":"ContainerDied","Data":"566f5b9facce5ca2fec0dfcfdc04e9b7ae57852f2b90c5e4ac0f44f3145f6807"}
Sep 11 16:50:54.236750 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.236550    2569 scope.go:117] "RemoveContainer" containerID="48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911"
Sep 11 16:50:54.245274 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.245258    2569 scope.go:117] "RemoveContainer" containerID="48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911"
Sep 11 16:50:54.245546 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:50:54.245527    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911\": container with ID starting with 48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911 not found: ID does not exist" containerID="48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911"
Sep 11 16:50:54.245598 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.245555    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911"} err="failed to get container status \"48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911\": rpc error: code = NotFound desc = could not find container \"48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911\": container with ID starting with 48bcec0084eecf047f5876b2b7b61fd407f7e22778b3dff90725f52b34a2f911 not found: ID does not exist"
Sep 11 16:50:54.258936 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.258914    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4srjz"]
Sep 11 16:50:54.261483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:54.261462    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-4srjz"]
Sep 11 16:50:55.926584 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:55.926551    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c59171e-959d-42e7-858f-e8492bbf31e9" path="/var/lib/kubelet/pods/8c59171e-959d-42e7-858f-e8492bbf31e9/volumes"
Sep 11 16:50:59.331054 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.331018    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"]
Sep 11 16:50:59.331406 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.331326    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c59171e-959d-42e7-858f-e8492bbf31e9" containerName="limitador"
Sep 11 16:50:59.331406 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.331336    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c59171e-959d-42e7-858f-e8492bbf31e9" containerName="limitador"
Sep 11 16:50:59.331406 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.331346    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f0d45ea-d4c5-40a7-81d7-942e1818b4d2" containerName="authorino"
Sep 11 16:50:59.331406 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.331351    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f0d45ea-d4c5-40a7-81d7-942e1818b4d2" containerName="authorino"
Sep 11 16:50:59.331537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.331415    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f0d45ea-d4c5-40a7-81d7-942e1818b4d2" containerName="authorino"
Sep 11 16:50:59.331537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.331424    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c59171e-959d-42e7-858f-e8492bbf31e9" containerName="limitador"
Sep 11 16:50:59.335650 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.335634    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:50:59.338187 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.338162    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 16:50:59.338312 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.338202    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 16:50:59.338374 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.338307    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-wldds\""
Sep 11 16:50:59.338820 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.338789    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 16:50:59.354125 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.354102    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"]
Sep 11 16:50:59.484179 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.484140    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcs6z\" (UniqueName: \"kubernetes.io/projected/b3210624-30e9-4186-9bca-d66bf46caa71-kube-api-access-gcs6z\") pod \"postgres-69fb4594cf-7f9kc\" (UID: \"b3210624-30e9-4186-9bca-d66bf46caa71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:50:59.484339 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.484189    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b3210624-30e9-4186-9bca-d66bf46caa71-data\") pod \"postgres-69fb4594cf-7f9kc\" (UID: \"b3210624-30e9-4186-9bca-d66bf46caa71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:50:59.584929 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.584850    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b3210624-30e9-4186-9bca-d66bf46caa71-data\") pod \"postgres-69fb4594cf-7f9kc\" (UID: \"b3210624-30e9-4186-9bca-d66bf46caa71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:50:59.585057 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.584937    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcs6z\" (UniqueName: \"kubernetes.io/projected/b3210624-30e9-4186-9bca-d66bf46caa71-kube-api-access-gcs6z\") pod \"postgres-69fb4594cf-7f9kc\" (UID: \"b3210624-30e9-4186-9bca-d66bf46caa71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:50:59.585208 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.585190    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b3210624-30e9-4186-9bca-d66bf46caa71-data\") pod \"postgres-69fb4594cf-7f9kc\" (UID: \"b3210624-30e9-4186-9bca-d66bf46caa71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:50:59.594138 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.594108    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcs6z\" (UniqueName: \"kubernetes.io/projected/b3210624-30e9-4186-9bca-d66bf46caa71-kube-api-access-gcs6z\") pod \"postgres-69fb4594cf-7f9kc\" (UID: \"b3210624-30e9-4186-9bca-d66bf46caa71\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:50:59.645106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.645070    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:50:59.920185 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:50:59.920159    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"]
Sep 11 16:50:59.922019 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:50:59.921991    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3210624_30e9_4186_9bca_d66bf46caa71.slice/crio-4993b4f045a9d138bbf596d55f8ab65f3e4aaab94988ef99dc22799aba151d5e WatchSource:0}: Error finding container 4993b4f045a9d138bbf596d55f8ab65f3e4aaab94988ef99dc22799aba151d5e: Status 404 returned error can't find the container with id 4993b4f045a9d138bbf596d55f8ab65f3e4aaab94988ef99dc22799aba151d5e
Sep 11 16:51:00.268974 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:00.268940    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc" event={"ID":"b3210624-30e9-4186-9bca-d66bf46caa71","Type":"ContainerStarted","Data":"4993b4f045a9d138bbf596d55f8ab65f3e4aaab94988ef99dc22799aba151d5e"}
Sep 11 16:51:02.280470 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:02.280377    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc" event={"ID":"b3210624-30e9-4186-9bca-d66bf46caa71","Type":"ContainerStarted","Data":"e3fa329388fe6eb6402d9dd970d9a66c46f583975ba956a1780ee040d88f7088"}
Sep 11 16:51:02.280470 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:02.280449    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:51:02.300088 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:02.300038    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc" podStartSLOduration=1.2367152909999999 podStartE2EDuration="3.300024578s" totalImagesPullingTime="2.063309287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:50:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:51:02.298957013 +0000 UTC m=+472.858348402" watchObservedRunningTime="2026-09-11 16:51:02.300024578 +0000 UTC m=+472.859415965"
Sep 11 16:51:08.315957 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:08.315929    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7f9kc"
Sep 11 16:51:08.866845 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:08.866793    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-zg446"]
Sep 11 16:51:08.872944 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:08.872903    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-zg446"
Sep 11 16:51:08.883726 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:08.883700    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-zg446"]
Sep 11 16:51:08.970602 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:08.970569    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8qfn\" (UniqueName: \"kubernetes.io/projected/750dd896-054f-4a15-b2ab-bdf80fbad2c9-kube-api-access-l8qfn\") pod \"authorino-557f876f69-zg446\" (UID: \"750dd896-054f-4a15-b2ab-bdf80fbad2c9\") " pod="kuadrant-system/authorino-557f876f69-zg446"
Sep 11 16:51:09.072004 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:09.071967    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8qfn\" (UniqueName: \"kubernetes.io/projected/750dd896-054f-4a15-b2ab-bdf80fbad2c9-kube-api-access-l8qfn\") pod \"authorino-557f876f69-zg446\" (UID: \"750dd896-054f-4a15-b2ab-bdf80fbad2c9\") " pod="kuadrant-system/authorino-557f876f69-zg446"
Sep 11 16:51:09.092966 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:09.092932    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8qfn\" (UniqueName: \"kubernetes.io/projected/750dd896-054f-4a15-b2ab-bdf80fbad2c9-kube-api-access-l8qfn\") pod \"authorino-557f876f69-zg446\" (UID: \"750dd896-054f-4a15-b2ab-bdf80fbad2c9\") " pod="kuadrant-system/authorino-557f876f69-zg446"
Sep 11 16:51:09.128833 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:09.128735    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-zg446"]
Sep 11 16:51:09.129055 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:09.129043    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-zg446"
Sep 11 16:51:09.407195 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:09.407167    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-zg446"]
Sep 11 16:51:09.408843 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:51:09.408782    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod750dd896_054f_4a15_b2ab_bdf80fbad2c9.slice/crio-288b86feaa8e6fa62da274a40abb7e48540d4d66899dfa55db80a3120ee76156 WatchSource:0}: Error finding container 288b86feaa8e6fa62da274a40abb7e48540d4d66899dfa55db80a3120ee76156: Status 404 returned error can't find the container with id 288b86feaa8e6fa62da274a40abb7e48540d4d66899dfa55db80a3120ee76156
Sep 11 16:51:10.324469 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:10.324422    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-zg446" event={"ID":"750dd896-054f-4a15-b2ab-bdf80fbad2c9","Type":"ContainerStarted","Data":"7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088"}
Sep 11 16:51:10.324469 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:10.324444    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-zg446" podUID="750dd896-054f-4a15-b2ab-bdf80fbad2c9" containerName="authorino" containerID="cri-o://7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088" gracePeriod=30
Sep 11 16:51:10.324681 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:10.324474    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-zg446" event={"ID":"750dd896-054f-4a15-b2ab-bdf80fbad2c9","Type":"ContainerStarted","Data":"288b86feaa8e6fa62da274a40abb7e48540d4d66899dfa55db80a3120ee76156"}
Sep 11 16:51:10.345905 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:10.345859    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-zg446" podStartSLOduration=1.642452539 podStartE2EDuration="2.345842942s" totalImagesPullingTime="703.390403ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:51:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:51:10.344130668 +0000 UTC m=+480.903522053" watchObservedRunningTime="2026-09-11 16:51:10.345842942 +0000 UTC m=+480.905234330"
Sep 11 16:51:10.565131 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:10.565106    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-zg446"
Sep 11 16:51:10.687225 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:10.687144    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8qfn\" (UniqueName: \"kubernetes.io/projected/750dd896-054f-4a15-b2ab-bdf80fbad2c9-kube-api-access-l8qfn\") pod \"750dd896-054f-4a15-b2ab-bdf80fbad2c9\" (UID: \"750dd896-054f-4a15-b2ab-bdf80fbad2c9\") "
Sep 11 16:51:10.689300 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:10.689273    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/750dd896-054f-4a15-b2ab-bdf80fbad2c9-kube-api-access-l8qfn" (OuterVolumeSpecName: "kube-api-access-l8qfn") pod "750dd896-054f-4a15-b2ab-bdf80fbad2c9" (UID: "750dd896-054f-4a15-b2ab-bdf80fbad2c9"). InnerVolumeSpecName "kube-api-access-l8qfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:51:10.788133 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:10.788100    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8qfn\" (UniqueName: \"kubernetes.io/projected/750dd896-054f-4a15-b2ab-bdf80fbad2c9-kube-api-access-l8qfn\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:51:11.331010 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.330977    2569 generic.go:356] "Generic (PLEG): container finished" podID="750dd896-054f-4a15-b2ab-bdf80fbad2c9" containerID="7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088" exitCode=0
Sep 11 16:51:11.331010 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.331013    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-zg446"
Sep 11 16:51:11.331326 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.331028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-zg446" event={"ID":"750dd896-054f-4a15-b2ab-bdf80fbad2c9","Type":"ContainerDied","Data":"7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088"}
Sep 11 16:51:11.331326 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.331067    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-zg446" event={"ID":"750dd896-054f-4a15-b2ab-bdf80fbad2c9","Type":"ContainerDied","Data":"288b86feaa8e6fa62da274a40abb7e48540d4d66899dfa55db80a3120ee76156"}
Sep 11 16:51:11.331326 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.331084    2569 scope.go:117] "RemoveContainer" containerID="7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088"
Sep 11 16:51:11.340189 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.340175    2569 scope.go:117] "RemoveContainer" containerID="7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088"
Sep 11 16:51:11.340458 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:51:11.340441    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088\": container with ID starting with 7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088 not found: ID does not exist" containerID="7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088"
Sep 11 16:51:11.340522 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.340471    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088"} err="failed to get container status \"7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088\": rpc error: code = NotFound desc = could not find container \"7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088\": container with ID starting with 7c5cc87a3be7e8d748d7f190a1119dc9bf3ac24efabce1ad813ca0d7df567088 not found: ID does not exist"
Sep 11 16:51:11.361473 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.361447    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-zg446"]
Sep 11 16:51:11.368855 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.368835    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-zg446"]
Sep 11 16:51:11.479980 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.479949    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-dsbt4"]
Sep 11 16:51:11.480131 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.480112    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-dsbt4" podUID="e69e09d3-9166-460a-b86b-a82d9ae441a6" containerName="authorino" containerID="cri-o://9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24" gracePeriod=30
Sep 11 16:51:11.734313 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.734290    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-dsbt4"
Sep 11 16:51:11.898086 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.897995    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w47k6\" (UniqueName: \"kubernetes.io/projected/e69e09d3-9166-460a-b86b-a82d9ae441a6-kube-api-access-w47k6\") pod \"e69e09d3-9166-460a-b86b-a82d9ae441a6\" (UID: \"e69e09d3-9166-460a-b86b-a82d9ae441a6\") "
Sep 11 16:51:11.900168 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.900146    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e69e09d3-9166-460a-b86b-a82d9ae441a6-kube-api-access-w47k6" (OuterVolumeSpecName: "kube-api-access-w47k6") pod "e69e09d3-9166-460a-b86b-a82d9ae441a6" (UID: "e69e09d3-9166-460a-b86b-a82d9ae441a6"). InnerVolumeSpecName "kube-api-access-w47k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:51:11.932488 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.932455    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="750dd896-054f-4a15-b2ab-bdf80fbad2c9" path="/var/lib/kubelet/pods/750dd896-054f-4a15-b2ab-bdf80fbad2c9/volumes"
Sep 11 16:51:11.998893 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:11.998854    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w47k6\" (UniqueName: \"kubernetes.io/projected/e69e09d3-9166-460a-b86b-a82d9ae441a6-kube-api-access-w47k6\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:51:12.338109 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:12.338069    2569 generic.go:356] "Generic (PLEG): container finished" podID="e69e09d3-9166-460a-b86b-a82d9ae441a6" containerID="9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24" exitCode=0
Sep 11 16:51:12.338290 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:12.338123    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-dsbt4" event={"ID":"e69e09d3-9166-460a-b86b-a82d9ae441a6","Type":"ContainerDied","Data":"9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24"}
Sep 11 16:51:12.338290 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:12.338131    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-dsbt4"
Sep 11 16:51:12.338290 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:12.338164    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-dsbt4" event={"ID":"e69e09d3-9166-460a-b86b-a82d9ae441a6","Type":"ContainerDied","Data":"9463d1f7d674863c499c1dcdf96a7847a1230ee10d8ca8a581f0874952bee36b"}
Sep 11 16:51:12.338290 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:12.338185    2569 scope.go:117] "RemoveContainer" containerID="9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24"
Sep 11 16:51:12.346721 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:12.346688    2569 scope.go:117] "RemoveContainer" containerID="9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24"
Sep 11 16:51:12.347016 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:51:12.346990    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24\": container with ID starting with 9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24 not found: ID does not exist" containerID="9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24"
Sep 11 16:51:12.347113 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:12.347024    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24"} err="failed to get container status \"9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24\": rpc error: code = NotFound desc = could not find container \"9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24\": container with ID starting with 9e56365a5556eaebcc013d31f5e1276ff50368a7f5fdc9d28083fd547b7dfd24 not found: ID does not exist"
Sep 11 16:51:12.357188 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:12.357163    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-dsbt4"]
Sep 11 16:51:12.361272 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:12.361250    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-dsbt4"]
Sep 11 16:51:13.929010 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:13.928968    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e69e09d3-9166-460a-b86b-a82d9ae441a6" path="/var/lib/kubelet/pods/e69e09d3-9166-460a-b86b-a82d9ae441a6/volumes"
Sep 11 16:51:16.693554 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.693526    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76848564f6-hps52"]
Sep 11 16:51:16.693956 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.693870    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="750dd896-054f-4a15-b2ab-bdf80fbad2c9" containerName="authorino"
Sep 11 16:51:16.693956 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.693881    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="750dd896-054f-4a15-b2ab-bdf80fbad2c9" containerName="authorino"
Sep 11 16:51:16.693956 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.693901    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e69e09d3-9166-460a-b86b-a82d9ae441a6" containerName="authorino"
Sep 11 16:51:16.693956 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.693906    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e69e09d3-9166-460a-b86b-a82d9ae441a6" containerName="authorino"
Sep 11 16:51:16.694086 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.693966    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="750dd896-054f-4a15-b2ab-bdf80fbad2c9" containerName="authorino"
Sep 11 16:51:16.694086 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.693977    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e69e09d3-9166-460a-b86b-a82d9ae441a6" containerName="authorino"
Sep 11 16:51:16.702757 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.702739    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:16.705646 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.705613    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-67lb8\""
Sep 11 16:51:16.706267 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.706249    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 16:51:16.706383 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.706286    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 16:51:16.706383 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.706249    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 16:51:16.707591 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.707571    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76848564f6-hps52"]
Sep 11 16:51:16.742614 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.742591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-webhook-cert\") pod \"maas-controller-76848564f6-hps52\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") " pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:16.742724 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.742622    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m59pw\" (UniqueName: \"kubernetes.io/projected/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-kube-api-access-m59pw\") pod \"maas-controller-76848564f6-hps52\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") " pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:16.742724 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.742710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-metrics-certs\") pod \"maas-controller-76848564f6-hps52\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") " pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:16.843121 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.843085    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-webhook-cert\") pod \"maas-controller-76848564f6-hps52\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") " pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:16.843263 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.843130    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m59pw\" (UniqueName: \"kubernetes.io/projected/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-kube-api-access-m59pw\") pod \"maas-controller-76848564f6-hps52\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") " pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:16.843263 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.843205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-metrics-certs\") pod \"maas-controller-76848564f6-hps52\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") " pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:16.845817 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.845782    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-webhook-cert\") pod \"maas-controller-76848564f6-hps52\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") " pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:16.845921 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.845862    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-metrics-certs\") pod \"maas-controller-76848564f6-hps52\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") " pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:16.855827 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:16.855774    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m59pw\" (UniqueName: \"kubernetes.io/projected/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-kube-api-access-m59pw\") pod \"maas-controller-76848564f6-hps52\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") " pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:17.015066 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:17.014985    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:17.301384 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:51:17.301353    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccdea22a_6b42_45cb_a78e_9a00bc89f6d9.slice/crio-586add84aedc2f8429b3ab51597179ece5eb1313b1e4daefcf035c518f93dc8d WatchSource:0}: Error finding container 586add84aedc2f8429b3ab51597179ece5eb1313b1e4daefcf035c518f93dc8d: Status 404 returned error can't find the container with id 586add84aedc2f8429b3ab51597179ece5eb1313b1e4daefcf035c518f93dc8d
Sep 11 16:51:17.304791 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:17.304769    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76848564f6-hps52"]
Sep 11 16:51:17.365053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:17.365022    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76848564f6-hps52" event={"ID":"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9","Type":"ContainerStarted","Data":"586add84aedc2f8429b3ab51597179ece5eb1313b1e4daefcf035c518f93dc8d"}
Sep 11 16:51:20.383268 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:20.383236    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76848564f6-hps52" event={"ID":"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9","Type":"ContainerStarted","Data":"aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109"}
Sep 11 16:51:20.383655 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:20.383337    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:20.408905 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:20.408856    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76848564f6-hps52" podStartSLOduration=2.15184218 podStartE2EDuration="4.408841129s" totalImagesPullingTime="2.256998949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:51:20.407669674 +0000 UTC m=+490.967061061" watchObservedRunningTime="2026-09-11 16:51:20.408841129 +0000 UTC m=+490.968232515"
Sep 11 16:51:31.390990 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:31.390956    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 16:51:54.941392 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:54.941359    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"]
Sep 11 16:51:54.948026 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:54.948002    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:54.953915 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:54.953890    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 16:51:54.954055 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:54.953891    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 16:51:54.954055 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:54.953934    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-8lxr4\""
Sep 11 16:51:54.979145 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:54.979120    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"]
Sep 11 16:51:55.075770 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.075737    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-maas-api-tls\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.075971 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.075872    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-metrics-certs\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.075971 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.075893    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a72f0-96f1-4402-ac4d-a7d24c5285fe-openshift-service-ca\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.075971 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.075942    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5rrk\" (UniqueName: \"kubernetes.io/projected/446a72f0-96f1-4402-ac4d-a7d24c5285fe-kube-api-access-l5rrk\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.176769 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.176735    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-metrics-certs\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.176961 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.176787    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a72f0-96f1-4402-ac4d-a7d24c5285fe-openshift-service-ca\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.176961 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.176848    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5rrk\" (UniqueName: \"kubernetes.io/projected/446a72f0-96f1-4402-ac4d-a7d24c5285fe-kube-api-access-l5rrk\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.176961 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.176876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-maas-api-tls\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.177610 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.177582    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a72f0-96f1-4402-ac4d-a7d24c5285fe-openshift-service-ca\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.179420 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.179391    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-metrics-certs\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.179527 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.179461    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-maas-api-tls\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.185336 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.185315    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5rrk\" (UniqueName: \"kubernetes.io/projected/446a72f0-96f1-4402-ac4d-a7d24c5285fe-kube-api-access-l5rrk\") pod \"maas-api-67d5b455cb-tfj4g\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") " pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.258056 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.257983    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:55.498220 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.498190    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"]
Sep 11 16:51:55.501584 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.501569    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:51:55.504075 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.504055    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-nsckj\""
Sep 11 16:51:55.504191 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.504174    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 16:51:55.515151 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.515032    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"]
Sep 11 16:51:55.549043 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:51:55.549017    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod446a72f0_96f1_4402_ac4d_a7d24c5285fe.slice/crio-d6fde2fa7873a64587c8a27a1579a6e944c88b1dbd2dc41a0a3d7edfbf49dcc2 WatchSource:0}: Error finding container d6fde2fa7873a64587c8a27a1579a6e944c88b1dbd2dc41a0a3d7edfbf49dcc2: Status 404 returned error can't find the container with id d6fde2fa7873a64587c8a27a1579a6e944c88b1dbd2dc41a0a3d7edfbf49dcc2
Sep 11 16:51:55.550405 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.550387    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"]
Sep 11 16:51:55.564319 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.564286    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g" event={"ID":"446a72f0-96f1-4402-ac4d-a7d24c5285fe","Type":"ContainerStarted","Data":"d6fde2fa7873a64587c8a27a1579a6e944c88b1dbd2dc41a0a3d7edfbf49dcc2"}
Sep 11 16:51:55.681494 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.681452    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kksrg\" (UniqueName: \"kubernetes.io/projected/4e2c7d46-084b-47f8-af94-a6f60302f4ab-kube-api-access-kksrg\") pod \"payload-processing-5b54b7fbb7-d5s4b\" (UID: \"4e2c7d46-084b-47f8-af94-a6f60302f4ab\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:51:55.681684 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.681618    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e2c7d46-084b-47f8-af94-a6f60302f4ab-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d5s4b\" (UID: \"4e2c7d46-084b-47f8-af94-a6f60302f4ab\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:51:55.782558 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.782480    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e2c7d46-084b-47f8-af94-a6f60302f4ab-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d5s4b\" (UID: \"4e2c7d46-084b-47f8-af94-a6f60302f4ab\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:51:55.782558 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.782516    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kksrg\" (UniqueName: \"kubernetes.io/projected/4e2c7d46-084b-47f8-af94-a6f60302f4ab-kube-api-access-kksrg\") pod \"payload-processing-5b54b7fbb7-d5s4b\" (UID: \"4e2c7d46-084b-47f8-af94-a6f60302f4ab\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:51:55.783239 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.783219    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e2c7d46-084b-47f8-af94-a6f60302f4ab-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-d5s4b\" (UID: \"4e2c7d46-084b-47f8-af94-a6f60302f4ab\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:51:55.795772 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.795749    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kksrg\" (UniqueName: \"kubernetes.io/projected/4e2c7d46-084b-47f8-af94-a6f60302f4ab-kube-api-access-kksrg\") pod \"payload-processing-5b54b7fbb7-d5s4b\" (UID: \"4e2c7d46-084b-47f8-af94-a6f60302f4ab\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:51:55.813545 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:55.813521    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:51:56.090436 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:56.090407    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"]
Sep 11 16:51:56.091565 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:51:56.091539    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e2c7d46_084b_47f8_af94_a6f60302f4ab.slice/crio-dc91a84c10e2c215004b1e358c73e1e480f5948c6909a9fbb5264816173674b3 WatchSource:0}: Error finding container dc91a84c10e2c215004b1e358c73e1e480f5948c6909a9fbb5264816173674b3: Status 404 returned error can't find the container with id dc91a84c10e2c215004b1e358c73e1e480f5948c6909a9fbb5264816173674b3
Sep 11 16:51:56.571588 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:56.571551    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b" event={"ID":"4e2c7d46-084b-47f8-af94-a6f60302f4ab","Type":"ContainerStarted","Data":"dc91a84c10e2c215004b1e358c73e1e480f5948c6909a9fbb5264816173674b3"}
Sep 11 16:51:57.578141 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:57.578107    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g" event={"ID":"446a72f0-96f1-4402-ac4d-a7d24c5285fe","Type":"ContainerStarted","Data":"e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0"}
Sep 11 16:51:57.578542 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:57.578271    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:51:57.599451 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:57.599398    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g" podStartSLOduration=1.7602389440000001 podStartE2EDuration="3.599382116s" totalImagesPullingTime="1.839143172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:51:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:51:57.598202028 +0000 UTC m=+528.157593440" watchObservedRunningTime="2026-09-11 16:51:57.599382116 +0000 UTC m=+528.158773517"
Sep 11 16:51:58.586348 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:58.586312    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b" event={"ID":"4e2c7d46-084b-47f8-af94-a6f60302f4ab","Type":"ContainerStarted","Data":"7265b9de6bda10b4ece0ddb16db1e849dc8f35fb17689dfd8d2232bfcb7d7ddf"}
Sep 11 16:51:58.586844 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:58.586568    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:51:58.608398 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:51:58.608353    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b" podStartSLOduration=1.7759801560000001 podStartE2EDuration="3.608338397s" totalImagesPullingTime="1.832358241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:51:58.606397503 +0000 UTC m=+529.165788890" watchObservedRunningTime="2026-09-11 16:51:58.608338397 +0000 UTC m=+529.167729783"
Sep 11 16:52:03.592004 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:03.591976    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 16:52:09.594202 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:09.594171    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-d5s4b"
Sep 11 16:52:15.931471 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:15.931436    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"]
Sep 11 16:52:15.936716 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:15.936695    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:15.940098 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:15.940074    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 16:52:15.940388 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:15.940370    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vkjjm\""
Sep 11 16:52:15.941471 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:15.941445    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 16:52:15.942104 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:15.942083    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"]
Sep 11 16:52:15.945261 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:15.945243    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 16:52:16.047337 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.047308    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.047337 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.047344    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af98d97a-7eef-4a98-9750-87d3de761e87-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.047550 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.047362    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.047550 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.047388    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.047550 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.047423    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjrrc\" (UniqueName: \"kubernetes.io/projected/af98d97a-7eef-4a98-9750-87d3de761e87-kube-api-access-wjrrc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.047550 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.047491    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.148807 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.148774    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.148980 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.148837    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af98d97a-7eef-4a98-9750-87d3de761e87-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.148980 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.148856    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.148980 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.148876    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.148980 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.148893    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjrrc\" (UniqueName: \"kubernetes.io/projected/af98d97a-7eef-4a98-9750-87d3de761e87-kube-api-access-wjrrc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.148980 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.148936    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.149278 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.149253    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.149343 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.149312    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.149382 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.149353    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.151930 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.151907    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af98d97a-7eef-4a98-9750-87d3de761e87-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.152053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.152009    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af98d97a-7eef-4a98-9750-87d3de761e87-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.157515 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.157497    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjrrc\" (UniqueName: \"kubernetes.io/projected/af98d97a-7eef-4a98-9750-87d3de761e87-kube-api-access-wjrrc\") pod \"e2e-distinct-simulated-kserve-59975d69f9-cld26\" (UID: \"af98d97a-7eef-4a98-9750-87d3de761e87\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.249605 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.249572    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:16.530737 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.530634    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"]
Sep 11 16:52:16.533878 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:52:16.533852    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf98d97a_7eef_4a98_9750_87d3de761e87.slice/crio-d568da34b54e407ee4e97d2478c63360443e47ea532f617fb92616a1a3fdaeaf WatchSource:0}: Error finding container d568da34b54e407ee4e97d2478c63360443e47ea532f617fb92616a1a3fdaeaf: Status 404 returned error can't find the container with id d568da34b54e407ee4e97d2478c63360443e47ea532f617fb92616a1a3fdaeaf
Sep 11 16:52:16.684859 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:16.684825    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26" event={"ID":"af98d97a-7eef-4a98-9750-87d3de761e87","Type":"ContainerStarted","Data":"d568da34b54e407ee4e97d2478c63360443e47ea532f617fb92616a1a3fdaeaf"}
Sep 11 16:52:17.692262 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:17.692231    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26" event={"ID":"af98d97a-7eef-4a98-9750-87d3de761e87","Type":"ContainerStarted","Data":"91fb58d098e0399acd8fa35a043303e81e434d92a22ec9938ac1be722010d279"}
Sep 11 16:52:17.713615 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:17.713565    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26" podStartSLOduration=1.676806747 podStartE2EDuration="2.713549027s" totalImagesPullingTime="1.03674228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:52:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:52:17.712067653 +0000 UTC m=+548.271459053" watchObservedRunningTime="2026-09-11 16:52:17.713549027 +0000 UTC m=+548.272940414"
Sep 11 16:52:26.250191 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:26.250151    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:26.250734 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:26.250223    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:26.262673 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:26.262647    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:52:26.752694 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:52:26.752667    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-cld26"
Sep 11 16:53:20.702930 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.702897    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"]
Sep 11 16:53:20.706437 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.706417    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.709135 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.709114    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 11 16:53:20.719372 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.719348    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"]
Sep 11 16:53:20.822690 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.822655    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5p55\" (UniqueName: \"kubernetes.io/projected/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-kube-api-access-t5p55\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.822859 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.822710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.822859 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.822790    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.822859 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.822830    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.822859 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.822849    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.823007 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.822876    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.923914 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.923881    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.924065 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.923923    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.924065 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.923964    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5p55\" (UniqueName: \"kubernetes.io/projected/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-kube-api-access-t5p55\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.924065 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.923999    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.924177 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.924070    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.924177 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.924094    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.924405 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.924380    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.924494 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.924403    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.924494 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.924432    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.926273 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.926249    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.926632 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.926608    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:20.933114 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:20.933089    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5p55\" (UniqueName: \"kubernetes.io/projected/0d8a93a2-693a-4b64-9509-d1fbaf4bff1b-kube-api-access-t5p55\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl\" (UID: \"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:21.015583 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:21.015507    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:21.291742 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:21.291720    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"]
Sep 11 16:53:21.293421 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:53:21.293390    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d8a93a2_693a_4b64_9509_d1fbaf4bff1b.slice/crio-07ab519ec70fb3eb9d3bff585ed604fc5e336e63394aa79a811bcec33cdde174 WatchSource:0}: Error finding container 07ab519ec70fb3eb9d3bff585ed604fc5e336e63394aa79a811bcec33cdde174: Status 404 returned error can't find the container with id 07ab519ec70fb3eb9d3bff585ed604fc5e336e63394aa79a811bcec33cdde174
Sep 11 16:53:22.028038 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:22.028009    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl" event={"ID":"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b","Type":"ContainerStarted","Data":"c7c53ca5886d2503156785af7ab49f48f41cc429a0ebea6ca425f6d971a67986"}
Sep 11 16:53:22.028396 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:22.028043    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl" event={"ID":"0d8a93a2-693a-4b64-9509-d1fbaf4bff1b","Type":"ContainerStarted","Data":"07ab519ec70fb3eb9d3bff585ed604fc5e336e63394aa79a811bcec33cdde174"}
Sep 11 16:53:22.050208 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:22.050160    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl" podStartSLOduration=1.875306906 podStartE2EDuration="2.050145498s" totalImagesPullingTime="174.838592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:53:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:53:22.048136373 +0000 UTC m=+612.607527760" watchObservedRunningTime="2026-09-11 16:53:22.050145498 +0000 UTC m=+612.609536884"
Sep 11 16:53:31.016628 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:31.016581    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:31.017267 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:31.016643    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:31.029318 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:31.029293    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:53:31.088727 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:53:31.088699    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl"
Sep 11 16:55:11.122324 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.122292    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f75f57858-8gjcs"]
Sep 11 16:55:11.125640 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.125625    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f75f57858-8gjcs"
Sep 11 16:55:11.128284 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.128261    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 16:55:11.129050 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.129032    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rdt2v\""
Sep 11 16:55:11.148357 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.148326    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f75f57858-8gjcs"]
Sep 11 16:55:11.190501 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.190477    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqs2z\" (UniqueName: \"kubernetes.io/projected/5959daf5-9528-47b1-bfd6-ff0c87958429-kube-api-access-cqs2z\") pod \"authorino-6f75f57858-8gjcs\" (UID: \"5959daf5-9528-47b1-bfd6-ff0c87958429\") " pod="kuadrant-system/authorino-6f75f57858-8gjcs"
Sep 11 16:55:11.190632 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.190515    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5959daf5-9528-47b1-bfd6-ff0c87958429-tls-cert\") pod \"authorino-6f75f57858-8gjcs\" (UID: \"5959daf5-9528-47b1-bfd6-ff0c87958429\") " pod="kuadrant-system/authorino-6f75f57858-8gjcs"
Sep 11 16:55:11.291134 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.291106    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqs2z\" (UniqueName: \"kubernetes.io/projected/5959daf5-9528-47b1-bfd6-ff0c87958429-kube-api-access-cqs2z\") pod \"authorino-6f75f57858-8gjcs\" (UID: \"5959daf5-9528-47b1-bfd6-ff0c87958429\") " pod="kuadrant-system/authorino-6f75f57858-8gjcs"
Sep 11 16:55:11.291273 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.291145    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5959daf5-9528-47b1-bfd6-ff0c87958429-tls-cert\") pod \"authorino-6f75f57858-8gjcs\" (UID: \"5959daf5-9528-47b1-bfd6-ff0c87958429\") " pod="kuadrant-system/authorino-6f75f57858-8gjcs"
Sep 11 16:55:11.293514 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.293496    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5959daf5-9528-47b1-bfd6-ff0c87958429-tls-cert\") pod \"authorino-6f75f57858-8gjcs\" (UID: \"5959daf5-9528-47b1-bfd6-ff0c87958429\") " pod="kuadrant-system/authorino-6f75f57858-8gjcs"
Sep 11 16:55:11.349925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.349901    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqs2z\" (UniqueName: \"kubernetes.io/projected/5959daf5-9528-47b1-bfd6-ff0c87958429-kube-api-access-cqs2z\") pod \"authorino-6f75f57858-8gjcs\" (UID: \"5959daf5-9528-47b1-bfd6-ff0c87958429\") " pod="kuadrant-system/authorino-6f75f57858-8gjcs"
Sep 11 16:55:11.434175 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.434110    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f75f57858-8gjcs"
Sep 11 16:55:11.723976 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.723945    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f75f57858-8gjcs"]
Sep 11 16:55:11.728502 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:11.728478    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5959daf5_9528_47b1_bfd6_ff0c87958429.slice/crio-360d298d88a2b919bf25122307dcea874ec0aad51c1deb3d7db4ce113e14570a WatchSource:0}: Error finding container 360d298d88a2b919bf25122307dcea874ec0aad51c1deb3d7db4ce113e14570a: Status 404 returned error can't find the container with id 360d298d88a2b919bf25122307dcea874ec0aad51c1deb3d7db4ce113e14570a
Sep 11 16:55:11.730001 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:11.729984    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 16:55:12.618960 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:12.618925    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f75f57858-8gjcs" event={"ID":"5959daf5-9528-47b1-bfd6-ff0c87958429","Type":"ContainerStarted","Data":"16560dccafee084b6dadfa1b6dd7ecb014fbe40d276d5cc408e1072d43329480"}
Sep 11 16:55:12.619361 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:12.618969    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f75f57858-8gjcs" event={"ID":"5959daf5-9528-47b1-bfd6-ff0c87958429","Type":"ContainerStarted","Data":"360d298d88a2b919bf25122307dcea874ec0aad51c1deb3d7db4ce113e14570a"}
Sep 11 16:55:12.661141 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:12.661084    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6f75f57858-8gjcs" podStartSLOduration=0.924743405 podStartE2EDuration="1.661064762s" totalImagesPullingTime="736.321357ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:12.66013944 +0000 UTC m=+723.219530833" watchObservedRunningTime="2026-09-11 16:55:12.661064762 +0000 UTC m=+723.220456151"
Sep 11 16:55:33.058274 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.058236    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7960-c97d51"]
Sep 11 16:55:33.062080 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.062057    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7960-c97d51"
Sep 11 16:55:33.064483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.064465    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t2nxk\""
Sep 11 16:55:33.070924 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.070899    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7960-c97d51"]
Sep 11 16:55:33.195064 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.195026    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bffbs\" (UniqueName: \"kubernetes.io/projected/ded73982-6ace-4d3d-b4f8-ee730f965883-kube-api-access-bffbs\") pod \"test-curl-7960-c97d51\" (UID: \"ded73982-6ace-4d3d-b4f8-ee730f965883\") " pod="opendatahub/test-curl-7960-c97d51"
Sep 11 16:55:33.295988 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.295951    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bffbs\" (UniqueName: \"kubernetes.io/projected/ded73982-6ace-4d3d-b4f8-ee730f965883-kube-api-access-bffbs\") pod \"test-curl-7960-c97d51\" (UID: \"ded73982-6ace-4d3d-b4f8-ee730f965883\") " pod="opendatahub/test-curl-7960-c97d51"
Sep 11 16:55:33.306491 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.306469    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bffbs\" (UniqueName: \"kubernetes.io/projected/ded73982-6ace-4d3d-b4f8-ee730f965883-kube-api-access-bffbs\") pod \"test-curl-7960-c97d51\" (UID: \"ded73982-6ace-4d3d-b4f8-ee730f965883\") " pod="opendatahub/test-curl-7960-c97d51"
Sep 11 16:55:33.371528 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.371466    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7960-c97d51"
Sep 11 16:55:33.647118 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.647094    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7960-c97d51"]
Sep 11 16:55:33.648752 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:33.648729    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podded73982_6ace_4d3d_b4f8_ee730f965883.slice/crio-17ceec58a80a091aa2904031836fff05d7b09b6ccc308744faaaf75351e20417 WatchSource:0}: Error finding container 17ceec58a80a091aa2904031836fff05d7b09b6ccc308744faaaf75351e20417: Status 404 returned error can't find the container with id 17ceec58a80a091aa2904031836fff05d7b09b6ccc308744faaaf75351e20417
Sep 11 16:55:33.733572 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:33.733541    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7960-c97d51" event={"ID":"ded73982-6ace-4d3d-b4f8-ee730f965883","Type":"ContainerStarted","Data":"17ceec58a80a091aa2904031836fff05d7b09b6ccc308744faaaf75351e20417"}
Sep 11 16:55:36.570335 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.570298    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"]
Sep 11 16:55:36.574235 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.574210    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.576618 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.576596    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-2dc95c-serving-cert\""
Sep 11 16:55:36.585328 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.585307    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"]
Sep 11 16:55:36.744012 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.743976    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-metrics-certs\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.744191 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.744043    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.744191 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.744068    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c92104e-e85f-44ca-8456-ca0d8d16e00f-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.744191 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.744169    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4r6v\" (UniqueName: \"kubernetes.io/projected/0c92104e-e85f-44ca-8456-ca0d8d16e00f-kube-api-access-v4r6v\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.755039 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.755008    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7960-c97d51" event={"ID":"ded73982-6ace-4d3d-b4f8-ee730f965883","Type":"ContainerStarted","Data":"ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac"}
Sep 11 16:55:36.772324 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.772246    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7960-c97d51" podStartSLOduration=1.300708705 podStartE2EDuration="3.772228785s" totalImagesPullingTime="2.47152008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:36.7717656 +0000 UTC m=+747.331156987" watchObservedRunningTime="2026-09-11 16:55:36.772228785 +0000 UTC m=+747.331620173"
Sep 11 16:55:36.845525 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.845444    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.845525 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.845487    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c92104e-e85f-44ca-8456-ca0d8d16e00f-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.845774 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.845540    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4r6v\" (UniqueName: \"kubernetes.io/projected/0c92104e-e85f-44ca-8456-ca0d8d16e00f-kube-api-access-v4r6v\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.845774 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.845574    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-metrics-certs\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.846311 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.846281    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c92104e-e85f-44ca-8456-ca0d8d16e00f-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.848012 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.847989    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-metrics-certs\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.848086 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.848054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-maas-api-tls\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.857891 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.857874    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4r6v\" (UniqueName: \"kubernetes.io/projected/0c92104e-e85f-44ca-8456-ca0d8d16e00f-kube-api-access-v4r6v\") pod \"maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:36.886972 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:36.886937    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:37.179784 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.179707    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"]
Sep 11 16:55:37.441648 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.441621    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7960-c97d51"]
Sep 11 16:55:37.447334 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.447295    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7960-c97d51"]
Sep 11 16:55:37.580012 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.579976    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7960-79f60b"]
Sep 11 16:55:37.580411 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.580379    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ded73982-6ace-4d3d-b4f8-ee730f965883" containerName="test-curl-7960-c97d51"
Sep 11 16:55:37.580411 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.580393    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ded73982-6ace-4d3d-b4f8-ee730f965883" containerName="test-curl-7960-c97d51"
Sep 11 16:55:37.580498 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.580466    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ded73982-6ace-4d3d-b4f8-ee730f965883" containerName="test-curl-7960-c97d51"
Sep 11 16:55:37.584719 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.584704    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7960-79f60b"
Sep 11 16:55:37.593587 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.593563    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7960-79f60b"]
Sep 11 16:55:37.754636 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.754542    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf658\" (UniqueName: \"kubernetes.io/projected/d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4-kube-api-access-mf658\") pod \"test-curl-7960-79f60b\" (UID: \"d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4\") " pod="opendatahub/test-curl-7960-79f60b"
Sep 11 16:55:37.761571 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.761542    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww" event={"ID":"0c92104e-e85f-44ca-8456-ca0d8d16e00f","Type":"ContainerStarted","Data":"be139ad71fdc42cd4fd9c03ae3c624779eacf8bf51b3b2a48ff946469898f612"}
Sep 11 16:55:37.761769 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:37.761715    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7960-c97d51" container="test-curl-7960-c97d51"
Sep 11 16:55:37.855721 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.855689    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf658\" (UniqueName: \"kubernetes.io/projected/d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4-kube-api-access-mf658\") pod \"test-curl-7960-79f60b\" (UID: \"d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4\") " pod="opendatahub/test-curl-7960-79f60b"
Sep 11 16:55:37.864367 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.864336    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf658\" (UniqueName: \"kubernetes.io/projected/d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4-kube-api-access-mf658\") pod \"test-curl-7960-79f60b\" (UID: \"d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4\") " pod="opendatahub/test-curl-7960-79f60b"
Sep 11 16:55:37.870044 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.870015    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"]
Sep 11 16:55:37.874209 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.874188    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:37.876164 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.876146    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-4268e3-serving-cert\""
Sep 11 16:55:37.886304 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.886280    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"]
Sep 11 16:55:37.894473 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.894444    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7960-79f60b"
Sep 11 16:55:37.957686 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.957539    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-maas-api-tls\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:37.957686 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.957585    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st4vk\" (UniqueName: \"kubernetes.io/projected/2fb47338-46db-491b-ad0c-fd9847768b90-kube-api-access-st4vk\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:37.957686 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.957654    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb47338-46db-491b-ad0c-fd9847768b90-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:37.957992 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:37.957710    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-metrics-certs\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.058817 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.058768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb47338-46db-491b-ad0c-fd9847768b90-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.058937 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.058915    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-metrics-certs\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.059037 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.059021    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-maas-api-tls\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.059122 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.059048    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st4vk\" (UniqueName: \"kubernetes.io/projected/2fb47338-46db-491b-ad0c-fd9847768b90-kube-api-access-st4vk\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.059246 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:38.059229    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-serving-cert: secret "maas-api-e2e-inf-a-4268e3-serving-cert" not found
Sep 11 16:55:38.059330 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:38.059290    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-maas-api-tls podName:2fb47338-46db-491b-ad0c-fd9847768b90 nodeName:}" failed. No retries permitted until 2026-09-11 16:55:38.559271599 +0000 UTC m=+749.118662965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-maas-api-tls") pod "maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6" (UID: "2fb47338-46db-491b-ad0c-fd9847768b90") : secret "maas-api-e2e-inf-a-4268e3-serving-cert" not found
Sep 11 16:55:38.059444 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.059426    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb47338-46db-491b-ad0c-fd9847768b90-openshift-service-ca\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.061418 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.061400    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-metrics-certs\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.067620 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.067593    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st4vk\" (UniqueName: \"kubernetes.io/projected/2fb47338-46db-491b-ad0c-fd9847768b90-kube-api-access-st4vk\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.178078 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.178048    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7960-79f60b"]
Sep 11 16:55:38.179658 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:38.179636    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd547f1a5_1fc5_4fc0_a400_9e5ce3dc20f4.slice/crio-13f60c1e3e5df018cbfb523be4862bc4ea47bdc930d6cb1aa2f8ab4bf223c22d WatchSource:0}: Error finding container 13f60c1e3e5df018cbfb523be4862bc4ea47bdc930d6cb1aa2f8ab4bf223c22d: Status 404 returned error can't find the container with id 13f60c1e3e5df018cbfb523be4862bc4ea47bdc930d6cb1aa2f8ab4bf223c22d
Sep 11 16:55:38.564629 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.564601    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-maas-api-tls\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.567149 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.567129    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-maas-api-tls\") pod \"maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.768723 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.768673    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7960-79f60b" event={"ID":"d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4","Type":"ContainerStarted","Data":"247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722"}
Sep 11 16:55:38.769184 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.768767    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7960-79f60b" event={"ID":"d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4","Type":"ContainerStarted","Data":"13f60c1e3e5df018cbfb523be4862bc4ea47bdc930d6cb1aa2f8ab4bf223c22d"}
Sep 11 16:55:38.770565 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.770540    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww" event={"ID":"0c92104e-e85f-44ca-8456-ca0d8d16e00f","Type":"ContainerStarted","Data":"7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e"}
Sep 11 16:55:38.770718 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.770581    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7960-c97d51" podUID="ded73982-6ace-4d3d-b4f8-ee730f965883" containerName="test-curl-7960-c97d51" containerID="cri-o://ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac" gracePeriod=2
Sep 11 16:55:38.787722 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.787700    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:38.790968 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.790928    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7960-79f60b" podStartSLOduration=1.790909572 podStartE2EDuration="1.790909572s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:38.788112846 +0000 UTC m=+749.347504234" watchObservedRunningTime="2026-09-11 16:55:38.790909572 +0000 UTC m=+749.350300959"
Sep 11 16:55:38.811959 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.811902    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww" podStartSLOduration=1.963497668 podStartE2EDuration="2.811880641s" totalImagesPullingTime="848.382973ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:38.807498262 +0000 UTC m=+749.366889643" watchObservedRunningTime="2026-09-11 16:55:38.811880641 +0000 UTC m=+749.371272028"
Sep 11 16:55:38.884161 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.884128    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"]
Sep 11 16:55:38.888773 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.888752    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:38.890853 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.890831    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-52b0af-serving-cert\""
Sep 11 16:55:38.956595 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:38.956564    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"]
Sep 11 16:55:39.068423 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.068386    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-maas-api-tls\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.068586 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.068433    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw8x9\" (UniqueName: \"kubernetes.io/projected/18055e96-446a-4706-92e6-f97ddfeed865-kube-api-access-bw8x9\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.068586 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.068459    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-metrics-certs\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.068671 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.068602    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18055e96-446a-4706-92e6-f97ddfeed865-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.072939 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.072913    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"]
Sep 11 16:55:39.075467 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:39.075447    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fb47338_46db_491b_ad0c_fd9847768b90.slice/crio-46a0475127875defeeacda202d16041766ac0fa8aaf14e875fe2ea07b86936ca WatchSource:0}: Error finding container 46a0475127875defeeacda202d16041766ac0fa8aaf14e875fe2ea07b86936ca: Status 404 returned error can't find the container with id 46a0475127875defeeacda202d16041766ac0fa8aaf14e875fe2ea07b86936ca
Sep 11 16:55:39.169766 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.169684    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-metrics-certs\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.169924 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.169768    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18055e96-446a-4706-92e6-f97ddfeed865-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.169924 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.169825    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-maas-api-tls\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.169924 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.169856    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw8x9\" (UniqueName: \"kubernetes.io/projected/18055e96-446a-4706-92e6-f97ddfeed865-kube-api-access-bw8x9\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.170528 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.170494    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18055e96-446a-4706-92e6-f97ddfeed865-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.172465 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.172438    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-metrics-certs\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.172465 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.172463    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-maas-api-tls\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.178587 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.178557    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw8x9\" (UniqueName: \"kubernetes.io/projected/18055e96-446a-4706-92e6-f97ddfeed865-kube-api-access-bw8x9\") pod \"maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.201739 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.201722    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:39.445037 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.445014    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7960-79f60b"]
Sep 11 16:55:39.452167 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.452143    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7960-79f60b"]
Sep 11 16:55:39.495698 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.495677    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"]
Sep 11 16:55:39.497110 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:39.497081    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18055e96_446a_4706_92e6_f97ddfeed865.slice/crio-d443043cdaae7aa1391e1521c3d658a8b1e5d1e446e079e845ec80c8c12743a1 WatchSource:0}: Error finding container d443043cdaae7aa1391e1521c3d658a8b1e5d1e446e079e845ec80c8c12743a1: Status 404 returned error can't find the container with id d443043cdaae7aa1391e1521c3d658a8b1e5d1e446e079e845ec80c8c12743a1
Sep 11 16:55:39.778839 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.778774    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9" event={"ID":"18055e96-446a-4706-92e6-f97ddfeed865","Type":"ContainerStarted","Data":"d443043cdaae7aa1391e1521c3d658a8b1e5d1e446e079e845ec80c8c12743a1"}
Sep 11 16:55:39.780547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.780523    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6" event={"ID":"2fb47338-46db-491b-ad0c-fd9847768b90","Type":"ContainerStarted","Data":"5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54"}
Sep 11 16:55:39.780695 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.780568    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6" event={"ID":"2fb47338-46db-491b-ad0c-fd9847768b90","Type":"ContainerStarted","Data":"46a0475127875defeeacda202d16041766ac0fa8aaf14e875fe2ea07b86936ca"}
Sep 11 16:55:39.780695 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.780602    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:39.780829 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.780816    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:39.781012 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:39.780998    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7960-79f60b" container="test-curl-7960-79f60b"
Sep 11 16:55:39.807128 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.807106    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"]
Sep 11 16:55:39.807742 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.807720    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4" containerName="test-curl-7960-79f60b"
Sep 11 16:55:39.807867 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.807744    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4" containerName="test-curl-7960-79f60b"
Sep 11 16:55:39.807920 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.807873    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4" containerName="test-curl-7960-79f60b"
Sep 11 16:55:39.809493 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.809451    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6" podStartSLOduration=2.4793375 podStartE2EDuration="2.809437821s" totalImagesPullingTime="330.100321ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:39.804697128 +0000 UTC m=+750.364088516" watchObservedRunningTime="2026-09-11 16:55:39.809437821 +0000 UTC m=+750.368829208"
Sep 11 16:55:39.811431 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.811355    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:39.813613 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.813591    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-52b0af-dockercfg-2mwck\""
Sep 11 16:55:39.813835 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.813818    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-52b0af\""
Sep 11 16:55:39.822321 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.822295    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"]
Sep 11 16:55:39.977743 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.977705    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkpl5\" (UniqueName: \"kubernetes.io/projected/9367e177-a531-4bbd-a838-7692e23ad5d7-kube-api-access-pkpl5\") pod \"payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq\" (UID: \"9367e177-a531-4bbd-a838-7692e23ad5d7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:39.977945 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:39.977869    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9367e177-a531-4bbd-a838-7692e23ad5d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq\" (UID: \"9367e177-a531-4bbd-a838-7692e23ad5d7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:40.078600 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.078509    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9367e177-a531-4bbd-a838-7692e23ad5d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq\" (UID: \"9367e177-a531-4bbd-a838-7692e23ad5d7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:40.078600 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.078595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkpl5\" (UniqueName: \"kubernetes.io/projected/9367e177-a531-4bbd-a838-7692e23ad5d7-kube-api-access-pkpl5\") pod \"payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq\" (UID: \"9367e177-a531-4bbd-a838-7692e23ad5d7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:40.079249 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.079231    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9367e177-a531-4bbd-a838-7692e23ad5d7-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq\" (UID: \"9367e177-a531-4bbd-a838-7692e23ad5d7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:40.087996 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.087970    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkpl5\" (UniqueName: \"kubernetes.io/projected/9367e177-a531-4bbd-a838-7692e23ad5d7-kube-api-access-pkpl5\") pod \"payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq\" (UID: \"9367e177-a531-4bbd-a838-7692e23ad5d7\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:40.124736 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.124704    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:40.415151 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.415109    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"]
Sep 11 16:55:40.417791 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:40.417769    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9367e177_a531_4bbd_a838_7692e23ad5d7.slice/crio-16f9edbc7b5cad78b0403e5403fdfa2f2b9c36b988a5dd347dcb7c5e8f294784 WatchSource:0}: Error finding container 16f9edbc7b5cad78b0403e5403fdfa2f2b9c36b988a5dd347dcb7c5e8f294784: Status 404 returned error can't find the container with id 16f9edbc7b5cad78b0403e5403fdfa2f2b9c36b988a5dd347dcb7c5e8f294784
Sep 11 16:55:40.792139 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.792109    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq" event={"ID":"9367e177-a531-4bbd-a838-7692e23ad5d7","Type":"ContainerStarted","Data":"20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0"}
Sep 11 16:55:40.792496 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.792310    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:40.792496 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.792349    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq" event={"ID":"9367e177-a531-4bbd-a838-7692e23ad5d7","Type":"ContainerStarted","Data":"16f9edbc7b5cad78b0403e5403fdfa2f2b9c36b988a5dd347dcb7c5e8f294784"}
Sep 11 16:55:40.794025 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.793996    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9" event={"ID":"18055e96-446a-4706-92e6-f97ddfeed865","Type":"ContainerStarted","Data":"1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400"}
Sep 11 16:55:40.794434 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.794413    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:40.794551 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.794416    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7960-79f60b" podUID="d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4" containerName="test-curl-7960-79f60b" containerID="cri-o://247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722" gracePeriod=2
Sep 11 16:55:40.815038 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.814407    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq" podStartSLOduration=1.814386411 podStartE2EDuration="1.814386411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:40.813879736 +0000 UTC m=+751.373271122" watchObservedRunningTime="2026-09-11 16:55:40.814386411 +0000 UTC m=+751.373777801"
Sep 11 16:55:40.835120 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.835082    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9" podStartSLOduration=2.52645798 podStartE2EDuration="2.835056363s" totalImagesPullingTime="308.598383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:40.833528673 +0000 UTC m=+751.392920059" watchObservedRunningTime="2026-09-11 16:55:40.835056363 +0000 UTC m=+751.394447749"
Sep 11 16:55:40.930565 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:40.930543    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7960-c97d51"
Sep 11 16:55:41.086890 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:41.086790    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bffbs\" (UniqueName: \"kubernetes.io/projected/ded73982-6ace-4d3d-b4f8-ee730f965883-kube-api-access-bffbs\") pod \"ded73982-6ace-4d3d-b4f8-ee730f965883\" (UID: \"ded73982-6ace-4d3d-b4f8-ee730f965883\") "
Sep 11 16:55:41.089200 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:41.089172    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ded73982-6ace-4d3d-b4f8-ee730f965883-kube-api-access-bffbs" (OuterVolumeSpecName: "kube-api-access-bffbs") pod "ded73982-6ace-4d3d-b4f8-ee730f965883" (UID: "ded73982-6ace-4d3d-b4f8-ee730f965883"). InnerVolumeSpecName "kube-api-access-bffbs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:55:41.188388 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:41.188355    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bffbs\" (UniqueName: \"kubernetes.io/projected/ded73982-6ace-4d3d-b4f8-ee730f965883-kube-api-access-bffbs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:55:41.804333 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:41.804296    2569 generic.go:356] "Generic (PLEG): container finished" podID="ded73982-6ace-4d3d-b4f8-ee730f965883" containerID="ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac" exitCode=137
Sep 11 16:55:41.804333 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:41.804338    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7960-c97d51"
Sep 11 16:55:41.804880 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:41.804400    2569 scope.go:117] "RemoveContainer" containerID="ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac"
Sep 11 16:55:41.818397 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:41.818380    2569 scope.go:117] "RemoveContainer" containerID="ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac"
Sep 11 16:55:41.818733 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:41.818708    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac\": container with ID starting with ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac not found: ID does not exist" containerID="ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac"
Sep 11 16:55:41.818868 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:41.818739    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac"} err="failed to get container status \"ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac\": rpc error: code = NotFound desc = could not find container \"ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac\": container with ID starting with ebe0fa95712b56dbc247c07b3b9414bbffbe6453c57c65ad1c5277284783f1ac not found: ID does not exist"
Sep 11 16:55:41.819685 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:41.819660    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7960-c97d51\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="ded73982-6ace-4d3d-b4f8-ee730f965883" pod="opendatahub/test-curl-7960-c97d51"
Sep 11 16:55:41.928522 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:41.928493    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ded73982-6ace-4d3d-b4f8-ee730f965883" path="/var/lib/kubelet/pods/ded73982-6ace-4d3d-b4f8-ee730f965883/volumes"
Sep 11 16:55:42.968331 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:42.968302    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7960-79f60b"
Sep 11 16:55:43.108257 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:43.108167    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf658\" (UniqueName: \"kubernetes.io/projected/d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4-kube-api-access-mf658\") pod \"d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4\" (UID: \"d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4\") "
Sep 11 16:55:43.111195 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:43.111155    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4-kube-api-access-mf658" (OuterVolumeSpecName: "kube-api-access-mf658") pod "d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4" (UID: "d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4"). InnerVolumeSpecName "kube-api-access-mf658". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:55:43.209094 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:43.209059    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf658\" (UniqueName: \"kubernetes.io/projected/d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4-kube-api-access-mf658\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:55:43.823809 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:43.823756    2569 generic.go:356] "Generic (PLEG): container finished" podID="d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4" containerID="247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722" exitCode=137
Sep 11 16:55:43.824006 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:43.823829    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7960-79f60b"
Sep 11 16:55:43.824006 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:43.823847    2569 scope.go:117] "RemoveContainer" containerID="247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722"
Sep 11 16:55:43.834134 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:43.834114    2569 scope.go:117] "RemoveContainer" containerID="247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722"
Sep 11 16:55:43.834495 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:43.834475    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722\": container with ID starting with 247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722 not found: ID does not exist" containerID="247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722"
Sep 11 16:55:43.834575 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:43.834505    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722"} err="failed to get container status \"247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722\": rpc error: code = NotFound desc = could not find container \"247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722\": container with ID starting with 247956b6ec28d48919179ac7d283d35e9081a40e699666007d1bcfb4fef45722 not found: ID does not exist"
Sep 11 16:55:43.835140 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:43.835120    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7960-79f60b\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4" pod="opendatahub/test-curl-7960-79f60b"
Sep 11 16:55:43.929974 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:43.929731    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4" path="/var/lib/kubelet/pods/d547f1a5-1fc5-4fc0-a400-9e5ce3dc20f4/volumes"
Sep 11 16:55:45.799703 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:45.799676    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 16:55:45.800347 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:45.800173    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 16:55:47.821823 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:47.821771    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 16:55:48.268837 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.268782    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"]
Sep 11 16:55:48.273712 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.273690    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.276729 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.276682    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-8b1a16-serving-cert\""
Sep 11 16:55:48.284785 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.283546    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"]
Sep 11 16:55:48.357725 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.357693    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-maas-api-tls\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.357934 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.357733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-metrics-certs\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.357934 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.357763    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz9r7\" (UniqueName: \"kubernetes.io/projected/9369547f-a18c-40f7-87f8-f96235955ef0-kube-api-access-gz9r7\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.357934 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.357782    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9369547f-a18c-40f7-87f8-f96235955ef0-openshift-service-ca\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.458501 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.458464    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-maas-api-tls\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.458501 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.458500    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-metrics-certs\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.458748 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.458646    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz9r7\" (UniqueName: \"kubernetes.io/projected/9369547f-a18c-40f7-87f8-f96235955ef0-kube-api-access-gz9r7\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.458748 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.458689    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9369547f-a18c-40f7-87f8-f96235955ef0-openshift-service-ca\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.459361 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.459269    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9369547f-a18c-40f7-87f8-f96235955ef0-openshift-service-ca\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.461106 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.461087    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-maas-api-tls\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.461203 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.461138    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-metrics-certs\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.466833 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.466784    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz9r7\" (UniqueName: \"kubernetes.io/projected/9369547f-a18c-40f7-87f8-f96235955ef0-kube-api-access-gz9r7\") pod \"maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.587004 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.586925    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:48.865511 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:48.865485    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"]
Sep 11 16:55:48.867153 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:48.867129    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9369547f_a18c_40f7_87f8_f96235955ef0.slice/crio-26628f18894447dcdd0048b3354b063852bfcac00ed5c01fa898cd3ed6482a51 WatchSource:0}: Error finding container 26628f18894447dcdd0048b3354b063852bfcac00ed5c01fa898cd3ed6482a51: Status 404 returned error can't find the container with id 26628f18894447dcdd0048b3354b063852bfcac00ed5c01fa898cd3ed6482a51
Sep 11 16:55:49.363857 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.363824    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"]
Sep 11 16:55:49.367680 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.367659    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.369895 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.369870    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-ab1ade68-serving-cert\""
Sep 11 16:55:49.381438 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.381419    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"]
Sep 11 16:55:49.467040 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.467009    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdlnv\" (UniqueName: \"kubernetes.io/projected/b8c32240-1ace-40cd-bada-58709c5713a4-kube-api-access-sdlnv\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.467040 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.467042    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-metrics-certs\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.467225 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.467074    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c32240-1ace-40cd-bada-58709c5713a4-openshift-service-ca\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.467225 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.467163    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-maas-api-tls\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.568372 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.568341    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c32240-1ace-40cd-bada-58709c5713a4-openshift-service-ca\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.568547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.568404    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-maas-api-tls\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.568547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.568450    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdlnv\" (UniqueName: \"kubernetes.io/projected/b8c32240-1ace-40cd-bada-58709c5713a4-kube-api-access-sdlnv\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.568547 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.568468    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-metrics-certs\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.568729 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:49.568570    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-serving-cert: secret "maas-api-e2e-ait-ab1ade68-serving-cert" not found
Sep 11 16:55:49.568729 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:49.568644    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-maas-api-tls podName:b8c32240-1ace-40cd-bada-58709c5713a4 nodeName:}" failed. No retries permitted until 2026-09-11 16:55:50.068624091 +0000 UTC m=+760.628015456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-maas-api-tls") pod "maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww" (UID: "b8c32240-1ace-40cd-bada-58709c5713a4") : secret "maas-api-e2e-ait-ab1ade68-serving-cert" not found
Sep 11 16:55:49.569113 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.569092    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c32240-1ace-40cd-bada-58709c5713a4-openshift-service-ca\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.571021 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.571003    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-metrics-certs\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.576783 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.576762    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdlnv\" (UniqueName: \"kubernetes.io/projected/b8c32240-1ace-40cd-bada-58709c5713a4-kube-api-access-sdlnv\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:49.863870 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.863770    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs" event={"ID":"9369547f-a18c-40f7-87f8-f96235955ef0","Type":"ContainerStarted","Data":"7591a4a79c93e7a6fa316fa898b9101c29a465bdb0222844f49404f543ed8f5e"}
Sep 11 16:55:49.863870 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.863858    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:49.864048 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.863878    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs" event={"ID":"9369547f-a18c-40f7-87f8-f96235955ef0","Type":"ContainerStarted","Data":"26628f18894447dcdd0048b3354b063852bfcac00ed5c01fa898cd3ed6482a51"}
Sep 11 16:55:49.883151 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:49.883095    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs" podStartSLOduration=1.565368651 podStartE2EDuration="1.883079062s" totalImagesPullingTime="317.710411ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:49.881598419 +0000 UTC m=+760.440989819" watchObservedRunningTime="2026-09-11 16:55:49.883079062 +0000 UTC m=+760.442470448"
Sep 11 16:55:50.073709 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.073669    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-maas-api-tls\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:50.076383 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.076356    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-maas-api-tls\") pod \"maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:50.127204 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.127124    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"]
Sep 11 16:55:50.131386 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.131366    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:55:50.133698 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.133678    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ab1ade68-dockercfg-hnm5b\""
Sep 11 16:55:50.133841 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.133696    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ab1ade68\""
Sep 11 16:55:50.140774 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.140751    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"]
Sep 11 16:55:50.175085 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.175053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/198484b9-f107-4633-a10c-d1ac649fddd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4\" (UID: \"198484b9-f107-4633-a10c-d1ac649fddd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:55:50.175232 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.175099    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d89wk\" (UniqueName: \"kubernetes.io/projected/198484b9-f107-4633-a10c-d1ac649fddd3-kube-api-access-d89wk\") pod \"payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4\" (UID: \"198484b9-f107-4633-a10c-d1ac649fddd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:55:50.276100 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.276062    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/198484b9-f107-4633-a10c-d1ac649fddd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4\" (UID: \"198484b9-f107-4633-a10c-d1ac649fddd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:55:50.276275 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.276114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d89wk\" (UniqueName: \"kubernetes.io/projected/198484b9-f107-4633-a10c-d1ac649fddd3-kube-api-access-d89wk\") pod \"payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4\" (UID: \"198484b9-f107-4633-a10c-d1ac649fddd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:55:50.277014 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.276989    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/198484b9-f107-4633-a10c-d1ac649fddd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4\" (UID: \"198484b9-f107-4633-a10c-d1ac649fddd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:55:50.280957 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.280933    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:50.285272 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.285250    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d89wk\" (UniqueName: \"kubernetes.io/projected/198484b9-f107-4633-a10c-d1ac649fddd3-kube-api-access-d89wk\") pod \"payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4\" (UID: \"198484b9-f107-4633-a10c-d1ac649fddd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:55:50.443578 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.443540    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:55:50.594686 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.594646    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"]
Sep 11 16:55:50.595696 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:50.595663    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c32240_1ace_40cd_bada_58709c5713a4.slice/crio-9f345db8be45b671cf7cfc683c3593f061d30d2622d996ea0a120a2a1bc49386 WatchSource:0}: Error finding container 9f345db8be45b671cf7cfc683c3593f061d30d2622d996ea0a120a2a1bc49386: Status 404 returned error can't find the container with id 9f345db8be45b671cf7cfc683c3593f061d30d2622d996ea0a120a2a1bc49386
Sep 11 16:55:50.738658 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.738577    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"]
Sep 11 16:55:50.740278 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:50.740245    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod198484b9_f107_4633_a10c_d1ac649fddd3.slice/crio-5c18691e1316c349cf6ebb4c230e2bbe1dfe1fc69eb550e191e890acbeb09103 WatchSource:0}: Error finding container 5c18691e1316c349cf6ebb4c230e2bbe1dfe1fc69eb550e191e890acbeb09103: Status 404 returned error can't find the container with id 5c18691e1316c349cf6ebb4c230e2bbe1dfe1fc69eb550e191e890acbeb09103
Sep 11 16:55:50.872478 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.872440    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww" event={"ID":"b8c32240-1ace-40cd-bada-58709c5713a4","Type":"ContainerStarted","Data":"9f345db8be45b671cf7cfc683c3593f061d30d2622d996ea0a120a2a1bc49386"}
Sep 11 16:55:50.874241 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.874208    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4" event={"ID":"198484b9-f107-4633-a10c-d1ac649fddd3","Type":"ContainerStarted","Data":"0e21c63b262b93b5e758d430bb9872568e165e340f92caebcc9c23aa4a2631df"}
Sep 11 16:55:50.874390 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.874261    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4" event={"ID":"198484b9-f107-4633-a10c-d1ac649fddd3","Type":"ContainerStarted","Data":"5c18691e1316c349cf6ebb4c230e2bbe1dfe1fc69eb550e191e890acbeb09103"}
Sep 11 16:55:50.874522 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.874485    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:55:50.894155 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:50.894101    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4" podStartSLOduration=0.894080971 podStartE2EDuration="894.080971ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:50.891897154 +0000 UTC m=+761.451288542" watchObservedRunningTime="2026-09-11 16:55:50.894080971 +0000 UTC m=+761.453472359"
Sep 11 16:55:51.806916 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:51.806885    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 16:55:51.881856 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:51.881825    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww" event={"ID":"b8c32240-1ace-40cd-bada-58709c5713a4","Type":"ContainerStarted","Data":"57dda57c83c917f158ed5883f5ce5f0113286c51314898667b3cb5f40348fc70"}
Sep 11 16:55:51.882027 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:51.881897    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:51.904265 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:51.904220    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww" podStartSLOduration=2.464206797 podStartE2EDuration="2.904205483s" totalImagesPullingTime="439.998686ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:55:51.901111094 +0000 UTC m=+762.460502485" watchObservedRunningTime="2026-09-11 16:55:51.904205483 +0000 UTC m=+762.463596870"
Sep 11 16:55:55.879991 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:55.879963    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:55:57.894410 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:57.894381    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:55:58.431542 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.431497    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"]
Sep 11 16:55:58.436197 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.436177    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.438189 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.438163    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-32d680-serving-cert\""
Sep 11 16:55:58.448567 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.448480    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"]
Sep 11 16:55:58.554155 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.554122    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-metrics-certs\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.554320 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.554194    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-maas-api-tls\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.554320 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.554223    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7mm7\" (UniqueName: \"kubernetes.io/projected/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-kube-api-access-c7mm7\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.554320 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.554256    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.655126 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.655096    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.655304 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.655137    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-metrics-certs\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.655304 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.655205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-maas-api-tls\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.655304 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.655232    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7mm7\" (UniqueName: \"kubernetes.io/projected/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-kube-api-access-c7mm7\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.655500 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:58.655352    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-serving-cert: secret "maas-api-e2e-inf-b-32d680-serving-cert" not found
Sep 11 16:55:58.655500 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:55:58.655420    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-maas-api-tls podName:3d474bfd-a76f-4ab0-817e-cfdc9275bb69 nodeName:}" failed. No retries permitted until 2026-09-11 16:55:59.155400862 +0000 UTC m=+769.714792238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-maas-api-tls") pod "maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn" (UID: "3d474bfd-a76f-4ab0-817e-cfdc9275bb69") : secret "maas-api-e2e-inf-b-32d680-serving-cert" not found
Sep 11 16:55:58.655932 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.655909    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-openshift-service-ca\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.657848 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.657828    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-metrics-certs\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:58.663597 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:58.663566    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7mm7\" (UniqueName: \"kubernetes.io/projected/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-kube-api-access-c7mm7\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:59.159012 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:59.158977    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-maas-api-tls\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:59.161672 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:59.161636    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-maas-api-tls\") pod \"maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:59.349182 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:59.349153    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:55:59.631823 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:59.631779    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"]
Sep 11 16:55:59.634472 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:55:59.634446    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d474bfd_a76f_4ab0_817e_cfdc9275bb69.slice/crio-1e8473d9c693a6ae1663474167dcc115969144784e6c333dc20768bfe5952b64 WatchSource:0}: Error finding container 1e8473d9c693a6ae1663474167dcc115969144784e6c333dc20768bfe5952b64: Status 404 returned error can't find the container with id 1e8473d9c693a6ae1663474167dcc115969144784e6c333dc20768bfe5952b64
Sep 11 16:55:59.932223 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:55:59.932190    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn" event={"ID":"3d474bfd-a76f-4ab0-817e-cfdc9275bb69","Type":"ContainerStarted","Data":"1e8473d9c693a6ae1663474167dcc115969144784e6c333dc20768bfe5952b64"}
Sep 11 16:56:00.939494 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:00.939452    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn" event={"ID":"3d474bfd-a76f-4ab0-817e-cfdc9275bb69","Type":"ContainerStarted","Data":"eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3"}
Sep 11 16:56:00.939880 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:00.939537    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:56:00.960046 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:00.959998    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn" podStartSLOduration=2.630096358 podStartE2EDuration="2.959983606s" totalImagesPullingTime="329.887248ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:56:00.957443645 +0000 UTC m=+771.516835022" watchObservedRunningTime="2026-09-11 16:56:00.959983606 +0000 UTC m=+771.519375026"
Sep 11 16:56:01.883234 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:01.883179    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4" podUID="198484b9-f107-4633-a10c-d1ac649fddd3" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.57:9004: connect: connection refused"
Sep 11 16:56:06.954371 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:06.954337    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 16:56:11.882981 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:11.882952    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:56:27.941741 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:27.941707    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"]
Sep 11 16:56:27.942565 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:27.942532    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww" podUID="b8c32240-1ace-40cd-bada-58709c5713a4" containerName="maas-api" containerID="cri-o://57dda57c83c917f158ed5883f5ce5f0113286c51314898667b3cb5f40348fc70" gracePeriod=30
Sep 11 16:56:27.943514 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:27.943493    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"]
Sep 11 16:56:27.943730 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:27.943682    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4" podUID="198484b9-f107-4633-a10c-d1ac649fddd3" containerName="payload-pre-processing" containerID="cri-o://0e21c63b262b93b5e758d430bb9872568e165e340f92caebcc9c23aa4a2631df" gracePeriod=30
Sep 11 16:56:28.106736 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.106704    2569 generic.go:356] "Generic (PLEG): container finished" podID="b8c32240-1ace-40cd-bada-58709c5713a4" containerID="57dda57c83c917f158ed5883f5ce5f0113286c51314898667b3cb5f40348fc70" exitCode=0
Sep 11 16:56:28.106949 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.106837    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww" event={"ID":"b8c32240-1ace-40cd-bada-58709c5713a4","Type":"ContainerDied","Data":"57dda57c83c917f158ed5883f5ce5f0113286c51314898667b3cb5f40348fc70"}
Sep 11 16:56:28.108544 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.108517    2569 generic.go:356] "Generic (PLEG): container finished" podID="198484b9-f107-4633-a10c-d1ac649fddd3" containerID="0e21c63b262b93b5e758d430bb9872568e165e340f92caebcc9c23aa4a2631df" exitCode=0
Sep 11 16:56:28.108707 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.108578    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4" event={"ID":"198484b9-f107-4633-a10c-d1ac649fddd3","Type":"ContainerDied","Data":"0e21c63b262b93b5e758d430bb9872568e165e340f92caebcc9c23aa4a2631df"}
Sep 11 16:56:28.201282 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.201210    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:56:28.225093 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.225067    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:56:28.246124 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.246096    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d89wk\" (UniqueName: \"kubernetes.io/projected/198484b9-f107-4633-a10c-d1ac649fddd3-kube-api-access-d89wk\") pod \"198484b9-f107-4633-a10c-d1ac649fddd3\" (UID: \"198484b9-f107-4633-a10c-d1ac649fddd3\") "
Sep 11 16:56:28.246297 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.246142    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-maas-api-tls\") pod \"b8c32240-1ace-40cd-bada-58709c5713a4\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") "
Sep 11 16:56:28.246297 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.246169    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-metrics-certs\") pod \"b8c32240-1ace-40cd-bada-58709c5713a4\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") "
Sep 11 16:56:28.246297 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.246196    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/198484b9-f107-4633-a10c-d1ac649fddd3-plugins-config-volume\") pod \"198484b9-f107-4633-a10c-d1ac649fddd3\" (UID: \"198484b9-f107-4633-a10c-d1ac649fddd3\") "
Sep 11 16:56:28.246297 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.246245    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sdlnv\" (UniqueName: \"kubernetes.io/projected/b8c32240-1ace-40cd-bada-58709c5713a4-kube-api-access-sdlnv\") pod \"b8c32240-1ace-40cd-bada-58709c5713a4\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") "
Sep 11 16:56:28.246297 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.246287    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c32240-1ace-40cd-bada-58709c5713a4-openshift-service-ca\") pod \"b8c32240-1ace-40cd-bada-58709c5713a4\" (UID: \"b8c32240-1ace-40cd-bada-58709c5713a4\") "
Sep 11 16:56:28.246927 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.246893    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8c32240-1ace-40cd-bada-58709c5713a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b8c32240-1ace-40cd-bada-58709c5713a4" (UID: "b8c32240-1ace-40cd-bada-58709c5713a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:56:28.247122 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.247088    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/198484b9-f107-4633-a10c-d1ac649fddd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "198484b9-f107-4633-a10c-d1ac649fddd3" (UID: "198484b9-f107-4633-a10c-d1ac649fddd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:56:28.251572 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.251514    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/198484b9-f107-4633-a10c-d1ac649fddd3-kube-api-access-d89wk" (OuterVolumeSpecName: "kube-api-access-d89wk") pod "198484b9-f107-4633-a10c-d1ac649fddd3" (UID: "198484b9-f107-4633-a10c-d1ac649fddd3"). InnerVolumeSpecName "kube-api-access-d89wk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:56:28.252934 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.252904    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8c32240-1ace-40cd-bada-58709c5713a4-kube-api-access-sdlnv" (OuterVolumeSpecName: "kube-api-access-sdlnv") pod "b8c32240-1ace-40cd-bada-58709c5713a4" (UID: "b8c32240-1ace-40cd-bada-58709c5713a4"). InnerVolumeSpecName "kube-api-access-sdlnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:56:28.253041 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.252956    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b8c32240-1ace-40cd-bada-58709c5713a4" (UID: "b8c32240-1ace-40cd-bada-58709c5713a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:56:28.253041 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.252984    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b8c32240-1ace-40cd-bada-58709c5713a4" (UID: "b8c32240-1ace-40cd-bada-58709c5713a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:56:28.347230 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.347198    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sdlnv\" (UniqueName: \"kubernetes.io/projected/b8c32240-1ace-40cd-bada-58709c5713a4-kube-api-access-sdlnv\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:56:28.347230 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.347224    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8c32240-1ace-40cd-bada-58709c5713a4-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:56:28.347230 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.347233    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d89wk\" (UniqueName: \"kubernetes.io/projected/198484b9-f107-4633-a10c-d1ac649fddd3-kube-api-access-d89wk\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:56:28.347451 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.347242    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:56:28.347451 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.347251    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b8c32240-1ace-40cd-bada-58709c5713a4-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:56:28.347451 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:28.347259    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/198484b9-f107-4633-a10c-d1ac649fddd3-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:56:29.116938 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.116910    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"
Sep 11 16:56:29.116938 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.116918    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww" event={"ID":"b8c32240-1ace-40cd-bada-58709c5713a4","Type":"ContainerDied","Data":"9f345db8be45b671cf7cfc683c3593f061d30d2622d996ea0a120a2a1bc49386"}
Sep 11 16:56:29.117425 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.116974    2569 scope.go:117] "RemoveContainer" containerID="57dda57c83c917f158ed5883f5ce5f0113286c51314898667b3cb5f40348fc70"
Sep 11 16:56:29.118581 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.118534    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4" event={"ID":"198484b9-f107-4633-a10c-d1ac649fddd3","Type":"ContainerDied","Data":"5c18691e1316c349cf6ebb4c230e2bbe1dfe1fc69eb550e191e890acbeb09103"}
Sep 11 16:56:29.118581 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.118559    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"
Sep 11 16:56:29.127370 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.127351    2569 scope.go:117] "RemoveContainer" containerID="0e21c63b262b93b5e758d430bb9872568e165e340f92caebcc9c23aa4a2631df"
Sep 11 16:56:29.143596 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.143574    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"]
Sep 11 16:56:29.147562 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.147543    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-ab1ade68-dd764f67c-gj8ww"]
Sep 11 16:56:29.177661 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.177637    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"]
Sep 11 16:56:29.180062 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.180042    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ab1ade68-59fcf454c8-pq2k4"]
Sep 11 16:56:29.929138 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.929105    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="198484b9-f107-4633-a10c-d1ac649fddd3" path="/var/lib/kubelet/pods/198484b9-f107-4633-a10c-d1ac649fddd3/volumes"
Sep 11 16:56:29.929494 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:29.929470    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8c32240-1ace-40cd-bada-58709c5713a4" path="/var/lib/kubelet/pods/b8c32240-1ace-40cd-bada-58709c5713a4/volumes"
Sep 11 16:56:34.474523 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.474434    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"]
Sep 11 16:56:34.475085 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.475068    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8c32240-1ace-40cd-bada-58709c5713a4" containerName="maas-api"
Sep 11 16:56:34.475146 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.475089    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8c32240-1ace-40cd-bada-58709c5713a4" containerName="maas-api"
Sep 11 16:56:34.475146 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.475105    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="198484b9-f107-4633-a10c-d1ac649fddd3" containerName="payload-pre-processing"
Sep 11 16:56:34.475146 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.475113    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="198484b9-f107-4633-a10c-d1ac649fddd3" containerName="payload-pre-processing"
Sep 11 16:56:34.475247 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.475241    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="198484b9-f107-4633-a10c-d1ac649fddd3" containerName="payload-pre-processing"
Sep 11 16:56:34.475281 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.475259    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8c32240-1ace-40cd-bada-58709c5713a4" containerName="maas-api"
Sep 11 16:56:34.480548 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.480527    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.482822 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.482769    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-5969a028-serving-cert\""
Sep 11 16:56:34.489207 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.489181    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"]
Sep 11 16:56:34.506337 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.506303    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-metrics-certs\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.506473 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.506372    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292e100-60b8-493f-9b13-6d5da489da9e-openshift-service-ca\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.506473 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.506402    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkmh\" (UniqueName: \"kubernetes.io/projected/1292e100-60b8-493f-9b13-6d5da489da9e-kube-api-access-dfkmh\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.506568 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.506510    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-maas-api-tls\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.607682 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.607647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-metrics-certs\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.607891 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.607694    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292e100-60b8-493f-9b13-6d5da489da9e-openshift-service-ca\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.607891 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.607715    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkmh\" (UniqueName: \"kubernetes.io/projected/1292e100-60b8-493f-9b13-6d5da489da9e-kube-api-access-dfkmh\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.607891 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.607776    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-maas-api-tls\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.608043 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:56:34.607924    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-serving-cert: secret "maas-api-e2e-migrate-5969a028-serving-cert" not found
Sep 11 16:56:34.608043 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:56:34.607998    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-maas-api-tls podName:1292e100-60b8-493f-9b13-6d5da489da9e nodeName:}" failed. No retries permitted until 2026-09-11 16:56:35.107978209 +0000 UTC m=+805.667369589 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-maas-api-tls") pod "maas-api-e2e-migrate-5969a028-74ddc77666-csfjb" (UID: "1292e100-60b8-493f-9b13-6d5da489da9e") : secret "maas-api-e2e-migrate-5969a028-serving-cert" not found
Sep 11 16:56:34.608405 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.608384    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292e100-60b8-493f-9b13-6d5da489da9e-openshift-service-ca\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.610304 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.610283    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-metrics-certs\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:34.616908 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:34.616887    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkmh\" (UniqueName: \"kubernetes.io/projected/1292e100-60b8-493f-9b13-6d5da489da9e-kube-api-access-dfkmh\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:35.112435 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.112402    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-maas-api-tls\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:35.114753 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.114730    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-maas-api-tls\") pod \"maas-api-e2e-migrate-5969a028-74ddc77666-csfjb\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:35.246740 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.246705    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"]
Sep 11 16:56:35.250440 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.250424    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:56:35.252710 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.252689    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-5969a028\""
Sep 11 16:56:35.252875 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.252756    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-5969a028-dockercfg-r2kjf\""
Sep 11 16:56:35.258232 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.258209    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"]
Sep 11 16:56:35.314489 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.314456    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvfk\" (UniqueName: \"kubernetes.io/projected/68c166ff-406e-4a00-9196-75d18ecea080-kube-api-access-zmvfk\") pod \"payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq\" (UID: \"68c166ff-406e-4a00-9196-75d18ecea080\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:56:35.314645 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.314502    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c166ff-406e-4a00-9196-75d18ecea080-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq\" (UID: \"68c166ff-406e-4a00-9196-75d18ecea080\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:56:35.395581 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.395492    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:35.415628 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.415598    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c166ff-406e-4a00-9196-75d18ecea080-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq\" (UID: \"68c166ff-406e-4a00-9196-75d18ecea080\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:56:35.415769 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.415754    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvfk\" (UniqueName: \"kubernetes.io/projected/68c166ff-406e-4a00-9196-75d18ecea080-kube-api-access-zmvfk\") pod \"payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq\" (UID: \"68c166ff-406e-4a00-9196-75d18ecea080\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:56:35.416615 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.416590    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c166ff-406e-4a00-9196-75d18ecea080-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq\" (UID: \"68c166ff-406e-4a00-9196-75d18ecea080\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:56:35.423444 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.423425    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvfk\" (UniqueName: \"kubernetes.io/projected/68c166ff-406e-4a00-9196-75d18ecea080-kube-api-access-zmvfk\") pod \"payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq\" (UID: \"68c166ff-406e-4a00-9196-75d18ecea080\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:56:35.563405 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.563369    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:56:35.674289 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.674259    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"]
Sep 11 16:56:35.675668 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:56:35.675634    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1292e100_60b8_493f_9b13_6d5da489da9e.slice/crio-26eea09259ec6d740fda2812c9fce0e3abfca35fd49a8aa0bb68a7b82f0e9a40 WatchSource:0}: Error finding container 26eea09259ec6d740fda2812c9fce0e3abfca35fd49a8aa0bb68a7b82f0e9a40: Status 404 returned error can't find the container with id 26eea09259ec6d740fda2812c9fce0e3abfca35fd49a8aa0bb68a7b82f0e9a40
Sep 11 16:56:35.840950 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:35.840926    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"]
Sep 11 16:56:35.842054 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:56:35.842025    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68c166ff_406e_4a00_9196_75d18ecea080.slice/crio-5d16af6bddf0bd44133ddf307705a1b405cf0b86e08ff636cfa198f1a8cd70f0 WatchSource:0}: Error finding container 5d16af6bddf0bd44133ddf307705a1b405cf0b86e08ff636cfa198f1a8cd70f0: Status 404 returned error can't find the container with id 5d16af6bddf0bd44133ddf307705a1b405cf0b86e08ff636cfa198f1a8cd70f0
Sep 11 16:56:36.170227 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:36.170183    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb" event={"ID":"1292e100-60b8-493f-9b13-6d5da489da9e","Type":"ContainerStarted","Data":"e7aa4b9f03de1bd1b5be730a8ec5d986419f7e71ddb7d06a9bc569898adabdef"}
Sep 11 16:56:36.170413 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:36.170243    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb" event={"ID":"1292e100-60b8-493f-9b13-6d5da489da9e","Type":"ContainerStarted","Data":"26eea09259ec6d740fda2812c9fce0e3abfca35fd49a8aa0bb68a7b82f0e9a40"}
Sep 11 16:56:36.170413 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:36.170266    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:36.172113 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:36.172080    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq" event={"ID":"68c166ff-406e-4a00-9196-75d18ecea080","Type":"ContainerStarted","Data":"e724342c0782cacfb735fb381306d03e3cc871dfad92361262405927ee83c8e6"}
Sep 11 16:56:36.172243 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:36.172141    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq" event={"ID":"68c166ff-406e-4a00-9196-75d18ecea080","Type":"ContainerStarted","Data":"5d16af6bddf0bd44133ddf307705a1b405cf0b86e08ff636cfa198f1a8cd70f0"}
Sep 11 16:56:36.172243 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:36.172173    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:56:36.192574 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:36.192518    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb" podStartSLOduration=1.788464544 podStartE2EDuration="2.192497302s" totalImagesPullingTime="404.032758ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:56:36.18846099 +0000 UTC m=+806.747852379" watchObservedRunningTime="2026-09-11 16:56:36.192497302 +0000 UTC m=+806.751888690"
Sep 11 16:56:36.206884 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:36.206785    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq" podStartSLOduration=1.206766758 podStartE2EDuration="1.206766758s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:56:36.205355221 +0000 UTC m=+806.764746610" watchObservedRunningTime="2026-09-11 16:56:36.206766758 +0000 UTC m=+806.766158145"
Sep 11 16:56:42.183364 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:42.183335    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:56:47.180557 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:56:47.180529    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:57:03.072376 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.072342    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"]
Sep 11 16:57:03.072999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.072587    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb" podUID="1292e100-60b8-493f-9b13-6d5da489da9e" containerName="maas-api" containerID="cri-o://e7aa4b9f03de1bd1b5be730a8ec5d986419f7e71ddb7d06a9bc569898adabdef" gracePeriod=30
Sep 11 16:57:03.138999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.138970    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"]
Sep 11 16:57:03.139236 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.139189    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq" podUID="68c166ff-406e-4a00-9196-75d18ecea080" containerName="payload-pre-processing" containerID="cri-o://e724342c0782cacfb735fb381306d03e3cc871dfad92361262405927ee83c8e6" gracePeriod=30
Sep 11 16:57:03.327444 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.327349    2569 generic.go:356] "Generic (PLEG): container finished" podID="1292e100-60b8-493f-9b13-6d5da489da9e" containerID="e7aa4b9f03de1bd1b5be730a8ec5d986419f7e71ddb7d06a9bc569898adabdef" exitCode=0
Sep 11 16:57:03.327596 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.327427    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb" event={"ID":"1292e100-60b8-493f-9b13-6d5da489da9e","Type":"ContainerDied","Data":"e7aa4b9f03de1bd1b5be730a8ec5d986419f7e71ddb7d06a9bc569898adabdef"}
Sep 11 16:57:03.329311 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.329286    2569 generic.go:356] "Generic (PLEG): container finished" podID="68c166ff-406e-4a00-9196-75d18ecea080" containerID="e724342c0782cacfb735fb381306d03e3cc871dfad92361262405927ee83c8e6" exitCode=0
Sep 11 16:57:03.329442 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.329357    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq" event={"ID":"68c166ff-406e-4a00-9196-75d18ecea080","Type":"ContainerDied","Data":"e724342c0782cacfb735fb381306d03e3cc871dfad92361262405927ee83c8e6"}
Sep 11 16:57:03.415401 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.415374    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:57:03.439830 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.439773    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:57:03.585686 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.585599    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c166ff-406e-4a00-9196-75d18ecea080-plugins-config-volume\") pod \"68c166ff-406e-4a00-9196-75d18ecea080\" (UID: \"68c166ff-406e-4a00-9196-75d18ecea080\") "
Sep 11 16:57:03.585686 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.585640    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dfkmh\" (UniqueName: \"kubernetes.io/projected/1292e100-60b8-493f-9b13-6d5da489da9e-kube-api-access-dfkmh\") pod \"1292e100-60b8-493f-9b13-6d5da489da9e\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") "
Sep 11 16:57:03.585919 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.585718    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmvfk\" (UniqueName: \"kubernetes.io/projected/68c166ff-406e-4a00-9196-75d18ecea080-kube-api-access-zmvfk\") pod \"68c166ff-406e-4a00-9196-75d18ecea080\" (UID: \"68c166ff-406e-4a00-9196-75d18ecea080\") "
Sep 11 16:57:03.585919 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.585751    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292e100-60b8-493f-9b13-6d5da489da9e-openshift-service-ca\") pod \"1292e100-60b8-493f-9b13-6d5da489da9e\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") "
Sep 11 16:57:03.585919 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.585824    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-maas-api-tls\") pod \"1292e100-60b8-493f-9b13-6d5da489da9e\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") "
Sep 11 16:57:03.585919 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.585899    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-metrics-certs\") pod \"1292e100-60b8-493f-9b13-6d5da489da9e\" (UID: \"1292e100-60b8-493f-9b13-6d5da489da9e\") "
Sep 11 16:57:03.586116 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.586027    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68c166ff-406e-4a00-9196-75d18ecea080-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68c166ff-406e-4a00-9196-75d18ecea080" (UID: "68c166ff-406e-4a00-9196-75d18ecea080"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:57:03.586340 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.586294    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1292e100-60b8-493f-9b13-6d5da489da9e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1292e100-60b8-493f-9b13-6d5da489da9e" (UID: "1292e100-60b8-493f-9b13-6d5da489da9e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:57:03.586720 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.586544    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68c166ff-406e-4a00-9196-75d18ecea080-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:03.588311 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.588278    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1292e100-60b8-493f-9b13-6d5da489da9e-kube-api-access-dfkmh" (OuterVolumeSpecName: "kube-api-access-dfkmh") pod "1292e100-60b8-493f-9b13-6d5da489da9e" (UID: "1292e100-60b8-493f-9b13-6d5da489da9e"). InnerVolumeSpecName "kube-api-access-dfkmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:57:03.588415 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.588367    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1292e100-60b8-493f-9b13-6d5da489da9e" (UID: "1292e100-60b8-493f-9b13-6d5da489da9e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:57:03.588731 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.588709    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1292e100-60b8-493f-9b13-6d5da489da9e" (UID: "1292e100-60b8-493f-9b13-6d5da489da9e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:57:03.588820 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.588772    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68c166ff-406e-4a00-9196-75d18ecea080-kube-api-access-zmvfk" (OuterVolumeSpecName: "kube-api-access-zmvfk") pod "68c166ff-406e-4a00-9196-75d18ecea080" (UID: "68c166ff-406e-4a00-9196-75d18ecea080"). InnerVolumeSpecName "kube-api-access-zmvfk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:57:03.687650 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.687620    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmvfk\" (UniqueName: \"kubernetes.io/projected/68c166ff-406e-4a00-9196-75d18ecea080-kube-api-access-zmvfk\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:03.687650 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.687646    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292e100-60b8-493f-9b13-6d5da489da9e-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:03.687650 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.687656    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:03.687902 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.687663    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1292e100-60b8-493f-9b13-6d5da489da9e-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:03.687902 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:03.687671    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dfkmh\" (UniqueName: \"kubernetes.io/projected/1292e100-60b8-493f-9b13-6d5da489da9e-kube-api-access-dfkmh\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:04.337759 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.337733    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"
Sep 11 16:57:04.338248 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.337728    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq" event={"ID":"68c166ff-406e-4a00-9196-75d18ecea080","Type":"ContainerDied","Data":"5d16af6bddf0bd44133ddf307705a1b405cf0b86e08ff636cfa198f1a8cd70f0"}
Sep 11 16:57:04.338248 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.337970    2569 scope.go:117] "RemoveContainer" containerID="e724342c0782cacfb735fb381306d03e3cc871dfad92361262405927ee83c8e6"
Sep 11 16:57:04.339600 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.339581    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"
Sep 11 16:57:04.339743 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.339626    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb" event={"ID":"1292e100-60b8-493f-9b13-6d5da489da9e","Type":"ContainerDied","Data":"26eea09259ec6d740fda2812c9fce0e3abfca35fd49a8aa0bb68a7b82f0e9a40"}
Sep 11 16:57:04.349069 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.349050    2569 scope.go:117] "RemoveContainer" containerID="e7aa4b9f03de1bd1b5be730a8ec5d986419f7e71ddb7d06a9bc569898adabdef"
Sep 11 16:57:04.358230 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.358196    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"]
Sep 11 16:57:04.361746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.361726    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-5969a028-59b9875946-4qpbq"]
Sep 11 16:57:04.370942 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.370919    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"]
Sep 11 16:57:04.374529 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:04.374508    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-5969a028-74ddc77666-csfjb"]
Sep 11 16:57:05.927852 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:05.927789    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1292e100-60b8-493f-9b13-6d5da489da9e" path="/var/lib/kubelet/pods/1292e100-60b8-493f-9b13-6d5da489da9e/volumes"
Sep 11 16:57:05.928211 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:05.928175    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68c166ff-406e-4a00-9196-75d18ecea080" path="/var/lib/kubelet/pods/68c166ff-406e-4a00-9196-75d18ecea080/volumes"
Sep 11 16:57:08.871591 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.871557    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"]
Sep 11 16:57:08.872258 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.872239    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1292e100-60b8-493f-9b13-6d5da489da9e" containerName="maas-api"
Sep 11 16:57:08.872342 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.872261    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="1292e100-60b8-493f-9b13-6d5da489da9e" containerName="maas-api"
Sep 11 16:57:08.872342 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.872286    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68c166ff-406e-4a00-9196-75d18ecea080" containerName="payload-pre-processing"
Sep 11 16:57:08.872342 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.872295    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="68c166ff-406e-4a00-9196-75d18ecea080" containerName="payload-pre-processing"
Sep 11 16:57:08.872442 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.872388    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="68c166ff-406e-4a00-9196-75d18ecea080" containerName="payload-pre-processing"
Sep 11 16:57:08.872442 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.872402    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="1292e100-60b8-493f-9b13-6d5da489da9e" containerName="maas-api"
Sep 11 16:57:08.876387 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.876366    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:08.878609 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.878589    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d310aa61-serving-cert\""
Sep 11 16:57:08.887759 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.887734    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"]
Sep 11 16:57:08.938260 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.938235    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kzw6\" (UniqueName: \"kubernetes.io/projected/a8e45470-3497-44bd-bd13-59d611bc270e-kube-api-access-5kzw6\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:08.938397 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.938294    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e45470-3497-44bd-bd13-59d611bc270e-openshift-service-ca\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:08.938397 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.938324    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-maas-api-tls\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:08.938545 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:08.938435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-metrics-certs\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.039093 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.039063    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kzw6\" (UniqueName: \"kubernetes.io/projected/a8e45470-3497-44bd-bd13-59d611bc270e-kube-api-access-5kzw6\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.039301 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.039126    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e45470-3497-44bd-bd13-59d611bc270e-openshift-service-ca\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.039301 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.039158    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-maas-api-tls\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.039301 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.039205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-metrics-certs\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.039480 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:57:09.039311    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-serving-cert: secret "maas-api-e2e-ait-d310aa61-serving-cert" not found
Sep 11 16:57:09.039480 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:57:09.039392    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-maas-api-tls podName:a8e45470-3497-44bd-bd13-59d611bc270e nodeName:}" failed. No retries permitted until 2026-09-11 16:57:09.53937029 +0000 UTC m=+840.098761660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-maas-api-tls") pod "maas-api-e2e-ait-d310aa61-7567c98864-fssh7" (UID: "a8e45470-3497-44bd-bd13-59d611bc270e") : secret "maas-api-e2e-ait-d310aa61-serving-cert" not found
Sep 11 16:57:09.039827 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.039791    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e45470-3497-44bd-bd13-59d611bc270e-openshift-service-ca\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.041753 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.041735    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-metrics-certs\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.050233 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.050210    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kzw6\" (UniqueName: \"kubernetes.io/projected/a8e45470-3497-44bd-bd13-59d611bc270e-kube-api-access-5kzw6\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.540355 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.540327    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"]
Sep 11 16:57:09.543917 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.543897    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-maas-api-tls\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.544123 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.544107    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:09.546464 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.546439    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-d310aa61\""
Sep 11 16:57:09.546620 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.546528    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d310aa61-dockercfg-62dlv\""
Sep 11 16:57:09.546620 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.546549    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-maas-api-tls\") pod \"maas-api-e2e-ait-d310aa61-7567c98864-fssh7\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.555660 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.555639    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"]
Sep 11 16:57:09.572428 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.572401    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"]
Sep 11 16:57:09.576021 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.576005    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:09.590375 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.590352    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"]
Sep 11 16:57:09.644984 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.644955    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf24a23-a773-4a24-b0fb-87c7d91862ec-plugins-config-volume\") pod \"payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl\" (UID: \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\") " pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:09.644984 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.644988    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wc2p\" (UniqueName: \"kubernetes.io/projected/ebf24a23-a773-4a24-b0fb-87c7d91862ec-kube-api-access-7wc2p\") pod \"payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl\" (UID: \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\") " pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:09.645184 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.645094    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxjgk\" (UniqueName: \"kubernetes.io/projected/c394d411-669a-424f-9c3e-6ae0a3cc3320-kube-api-access-pxjgk\") pod \"payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp\" (UID: \"c394d411-669a-424f-9c3e-6ae0a3cc3320\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:09.645184 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.645120    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c394d411-669a-424f-9c3e-6ae0a3cc3320-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp\" (UID: \"c394d411-669a-424f-9c3e-6ae0a3cc3320\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:09.745825 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.745776    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c394d411-669a-424f-9c3e-6ae0a3cc3320-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp\" (UID: \"c394d411-669a-424f-9c3e-6ae0a3cc3320\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:09.745999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.745871    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf24a23-a773-4a24-b0fb-87c7d91862ec-plugins-config-volume\") pod \"payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl\" (UID: \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\") " pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:09.745999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.745897    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wc2p\" (UniqueName: \"kubernetes.io/projected/ebf24a23-a773-4a24-b0fb-87c7d91862ec-kube-api-access-7wc2p\") pod \"payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl\" (UID: \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\") " pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:09.745999 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.745963    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxjgk\" (UniqueName: \"kubernetes.io/projected/c394d411-669a-424f-9c3e-6ae0a3cc3320-kube-api-access-pxjgk\") pod \"payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp\" (UID: \"c394d411-669a-424f-9c3e-6ae0a3cc3320\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:09.746459 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.746436    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c394d411-669a-424f-9c3e-6ae0a3cc3320-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp\" (UID: \"c394d411-669a-424f-9c3e-6ae0a3cc3320\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:09.746512 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.746499    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf24a23-a773-4a24-b0fb-87c7d91862ec-plugins-config-volume\") pod \"payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl\" (UID: \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\") " pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:09.755026 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.754998    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxjgk\" (UniqueName: \"kubernetes.io/projected/c394d411-669a-424f-9c3e-6ae0a3cc3320-kube-api-access-pxjgk\") pod \"payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp\" (UID: \"c394d411-669a-424f-9c3e-6ae0a3cc3320\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:09.755184 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.755169    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wc2p\" (UniqueName: \"kubernetes.io/projected/ebf24a23-a773-4a24-b0fb-87c7d91862ec-kube-api-access-7wc2p\") pod \"payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl\" (UID: \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\") " pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:09.790105 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.790077    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:09.868146 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.868121    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-d310aa61-dockercfg-62dlv\""
Sep 11 16:57:09.875371 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.875342    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:09.885671 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:09.885646    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:10.083102 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.083077    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"]
Sep 11 16:57:10.084785 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:57:10.084753    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8e45470_3497_44bd_bd13_59d611bc270e.slice/crio-99a2ce4c50ee920ed397a969401c53644323f60086e65b2ead90e1f743c6995d WatchSource:0}: Error finding container 99a2ce4c50ee920ed397a969401c53644323f60086e65b2ead90e1f743c6995d: Status 404 returned error can't find the container with id 99a2ce4c50ee920ed397a969401c53644323f60086e65b2ead90e1f743c6995d
Sep 11 16:57:10.161938 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.161916    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"]
Sep 11 16:57:10.163615 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:57:10.163585    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc394d411_669a_424f_9c3e_6ae0a3cc3320.slice/crio-644eda21eec1237e5edf0207830d2fea36fa4e6d72cfc57363225871f1fe706b WatchSource:0}: Error finding container 644eda21eec1237e5edf0207830d2fea36fa4e6d72cfc57363225871f1fe706b: Status 404 returned error can't find the container with id 644eda21eec1237e5edf0207830d2fea36fa4e6d72cfc57363225871f1fe706b
Sep 11 16:57:10.178302 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.178279    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"]
Sep 11 16:57:10.180317 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:57:10.180290    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf24a23_a773_4a24_b0fb_87c7d91862ec.slice/crio-f96cfe329680b11103aaa4e4c13e230bd338b230ff9b6785ca21c6f09c433294 WatchSource:0}: Error finding container f96cfe329680b11103aaa4e4c13e230bd338b230ff9b6785ca21c6f09c433294: Status 404 returned error can't find the container with id f96cfe329680b11103aaa4e4c13e230bd338b230ff9b6785ca21c6f09c433294
Sep 11 16:57:10.387386 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.387284    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp" event={"ID":"c394d411-669a-424f-9c3e-6ae0a3cc3320","Type":"ContainerStarted","Data":"6c11837411a053e3b67957075b2acd3a5d208c1f6bc38fe62e4bf59e34537755"}
Sep 11 16:57:10.387386 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.387378    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:10.387622 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.387404    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp" event={"ID":"c394d411-669a-424f-9c3e-6ae0a3cc3320","Type":"ContainerStarted","Data":"644eda21eec1237e5edf0207830d2fea36fa4e6d72cfc57363225871f1fe706b"}
Sep 11 16:57:10.393444 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.393414    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl" event={"ID":"ebf24a23-a773-4a24-b0fb-87c7d91862ec","Type":"ContainerStarted","Data":"e916e980ae8fb60ff87cb9333c6a5772c2c849cb09935a6a928bef42c0663fca"}
Sep 11 16:57:10.393664 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.393633    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:10.393831 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.393666    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl" event={"ID":"ebf24a23-a773-4a24-b0fb-87c7d91862ec","Type":"ContainerStarted","Data":"f96cfe329680b11103aaa4e4c13e230bd338b230ff9b6785ca21c6f09c433294"}
Sep 11 16:57:10.395271 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.395249    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7" event={"ID":"a8e45470-3497-44bd-bd13-59d611bc270e","Type":"ContainerStarted","Data":"99a2ce4c50ee920ed397a969401c53644323f60086e65b2ead90e1f743c6995d"}
Sep 11 16:57:10.411650 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.411605    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp" podStartSLOduration=1.411592292 podStartE2EDuration="1.411592292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:57:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:57:10.407908704 +0000 UTC m=+840.967300093" watchObservedRunningTime="2026-09-11 16:57:10.411592292 +0000 UTC m=+840.970983679"
Sep 11 16:57:10.428091 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:10.428038    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl" podStartSLOduration=1.428019298 podStartE2EDuration="1.428019298s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:57:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:57:10.424636426 +0000 UTC m=+840.984027813" watchObservedRunningTime="2026-09-11 16:57:10.428019298 +0000 UTC m=+840.987410691"
Sep 11 16:57:11.404283 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:11.404247    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7" event={"ID":"a8e45470-3497-44bd-bd13-59d611bc270e","Type":"ContainerStarted","Data":"834b1fdf812b7d735174bf734d7c1e731756b4ee3a589d602c215d17729b34a7"}
Sep 11 16:57:11.404733 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:11.404481    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:11.437347 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:11.437300    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7" podStartSLOduration=2.9588789970000002 podStartE2EDuration="3.437284183s" totalImagesPullingTime="478.405186ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:57:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:57:11.435982007 +0000 UTC m=+841.995373397" watchObservedRunningTime="2026-09-11 16:57:11.437284183 +0000 UTC m=+841.996675599"
Sep 11 16:57:17.416311 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:17.416278    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:21.407001 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:21.406969    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:21.407372 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:21.407035    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:39.266053 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.266020    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"]
Sep 11 16:57:39.266530 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.266247    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7" podUID="a8e45470-3497-44bd-bd13-59d611bc270e" containerName="maas-api" containerID="cri-o://834b1fdf812b7d735174bf734d7c1e731756b4ee3a589d602c215d17729b34a7" gracePeriod=30
Sep 11 16:57:39.326577 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.326539    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"]
Sep 11 16:57:39.326889 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.326792    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl" podUID="ebf24a23-a773-4a24-b0fb-87c7d91862ec" containerName="payload-processing" containerID="cri-o://e916e980ae8fb60ff87cb9333c6a5772c2c849cb09935a6a928bef42c0663fca" gracePeriod=30
Sep 11 16:57:39.335525 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.335498    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"]
Sep 11 16:57:39.335716 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.335678    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp" podUID="c394d411-669a-424f-9c3e-6ae0a3cc3320" containerName="payload-pre-processing" containerID="cri-o://6c11837411a053e3b67957075b2acd3a5d208c1f6bc38fe62e4bf59e34537755" gracePeriod=30
Sep 11 16:57:39.580925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.580676    2569 generic.go:356] "Generic (PLEG): container finished" podID="c394d411-669a-424f-9c3e-6ae0a3cc3320" containerID="6c11837411a053e3b67957075b2acd3a5d208c1f6bc38fe62e4bf59e34537755" exitCode=0
Sep 11 16:57:39.580925 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.580895    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp" event={"ID":"c394d411-669a-424f-9c3e-6ae0a3cc3320","Type":"ContainerDied","Data":"6c11837411a053e3b67957075b2acd3a5d208c1f6bc38fe62e4bf59e34537755"}
Sep 11 16:57:39.582637 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.582611    2569 generic.go:356] "Generic (PLEG): container finished" podID="ebf24a23-a773-4a24-b0fb-87c7d91862ec" containerID="e916e980ae8fb60ff87cb9333c6a5772c2c849cb09935a6a928bef42c0663fca" exitCode=0
Sep 11 16:57:39.582778 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.582759    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl" event={"ID":"ebf24a23-a773-4a24-b0fb-87c7d91862ec","Type":"ContainerDied","Data":"e916e980ae8fb60ff87cb9333c6a5772c2c849cb09935a6a928bef42c0663fca"}
Sep 11 16:57:39.582855 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.582845    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl" event={"ID":"ebf24a23-a773-4a24-b0fb-87c7d91862ec","Type":"ContainerDied","Data":"f96cfe329680b11103aaa4e4c13e230bd338b230ff9b6785ca21c6f09c433294"}
Sep 11 16:57:39.582897 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.582872    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f96cfe329680b11103aaa4e4c13e230bd338b230ff9b6785ca21c6f09c433294"
Sep 11 16:57:39.584737 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.584714    2569 generic.go:356] "Generic (PLEG): container finished" podID="a8e45470-3497-44bd-bd13-59d611bc270e" containerID="834b1fdf812b7d735174bf734d7c1e731756b4ee3a589d602c215d17729b34a7" exitCode=0
Sep 11 16:57:39.584874 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.584744    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7" event={"ID":"a8e45470-3497-44bd-bd13-59d611bc270e","Type":"ContainerDied","Data":"834b1fdf812b7d735174bf734d7c1e731756b4ee3a589d602c215d17729b34a7"}
Sep 11 16:57:39.587236 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.587216    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:39.651337 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.651316    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:39.654734 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.654717    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:39.738013 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.737981    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c394d411-669a-424f-9c3e-6ae0a3cc3320-plugins-config-volume\") pod \"c394d411-669a-424f-9c3e-6ae0a3cc3320\" (UID: \"c394d411-669a-424f-9c3e-6ae0a3cc3320\") "
Sep 11 16:57:39.738173 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738037    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wc2p\" (UniqueName: \"kubernetes.io/projected/ebf24a23-a773-4a24-b0fb-87c7d91862ec-kube-api-access-7wc2p\") pod \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\" (UID: \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\") "
Sep 11 16:57:39.738297 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738169    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kzw6\" (UniqueName: \"kubernetes.io/projected/a8e45470-3497-44bd-bd13-59d611bc270e-kube-api-access-5kzw6\") pod \"a8e45470-3497-44bd-bd13-59d611bc270e\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") "
Sep 11 16:57:39.738297 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738208    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf24a23-a773-4a24-b0fb-87c7d91862ec-plugins-config-volume\") pod \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\" (UID: \"ebf24a23-a773-4a24-b0fb-87c7d91862ec\") "
Sep 11 16:57:39.738297 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738250    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-metrics-certs\") pod \"a8e45470-3497-44bd-bd13-59d611bc270e\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") "
Sep 11 16:57:39.738297 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738291    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-maas-api-tls\") pod \"a8e45470-3497-44bd-bd13-59d611bc270e\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") "
Sep 11 16:57:39.738505 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738321    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxjgk\" (UniqueName: \"kubernetes.io/projected/c394d411-669a-424f-9c3e-6ae0a3cc3320-kube-api-access-pxjgk\") pod \"c394d411-669a-424f-9c3e-6ae0a3cc3320\" (UID: \"c394d411-669a-424f-9c3e-6ae0a3cc3320\") "
Sep 11 16:57:39.738505 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738357    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e45470-3497-44bd-bd13-59d611bc270e-openshift-service-ca\") pod \"a8e45470-3497-44bd-bd13-59d611bc270e\" (UID: \"a8e45470-3497-44bd-bd13-59d611bc270e\") "
Sep 11 16:57:39.738505 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738390    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c394d411-669a-424f-9c3e-6ae0a3cc3320-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c394d411-669a-424f-9c3e-6ae0a3cc3320" (UID: "c394d411-669a-424f-9c3e-6ae0a3cc3320"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:57:39.738668 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738584    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebf24a23-a773-4a24-b0fb-87c7d91862ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ebf24a23-a773-4a24-b0fb-87c7d91862ec" (UID: "ebf24a23-a773-4a24-b0fb-87c7d91862ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:57:39.738897 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738871    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebf24a23-a773-4a24-b0fb-87c7d91862ec-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:39.738897 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738898    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c394d411-669a-424f-9c3e-6ae0a3cc3320-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:39.739060 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.738996    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8e45470-3497-44bd-bd13-59d611bc270e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a8e45470-3497-44bd-bd13-59d611bc270e" (UID: "a8e45470-3497-44bd-bd13-59d611bc270e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:57:39.740402 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.740382    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebf24a23-a773-4a24-b0fb-87c7d91862ec-kube-api-access-7wc2p" (OuterVolumeSpecName: "kube-api-access-7wc2p") pod "ebf24a23-a773-4a24-b0fb-87c7d91862ec" (UID: "ebf24a23-a773-4a24-b0fb-87c7d91862ec"). InnerVolumeSpecName "kube-api-access-7wc2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:57:39.741090 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.741066    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a8e45470-3497-44bd-bd13-59d611bc270e" (UID: "a8e45470-3497-44bd-bd13-59d611bc270e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:57:39.741153 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.741087    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a8e45470-3497-44bd-bd13-59d611bc270e" (UID: "a8e45470-3497-44bd-bd13-59d611bc270e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:57:39.741153 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.741132    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c394d411-669a-424f-9c3e-6ae0a3cc3320-kube-api-access-pxjgk" (OuterVolumeSpecName: "kube-api-access-pxjgk") pod "c394d411-669a-424f-9c3e-6ae0a3cc3320" (UID: "c394d411-669a-424f-9c3e-6ae0a3cc3320"). InnerVolumeSpecName "kube-api-access-pxjgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:57:39.741153 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.741142    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e45470-3497-44bd-bd13-59d611bc270e-kube-api-access-5kzw6" (OuterVolumeSpecName: "kube-api-access-5kzw6") pod "a8e45470-3497-44bd-bd13-59d611bc270e" (UID: "a8e45470-3497-44bd-bd13-59d611bc270e"). InnerVolumeSpecName "kube-api-access-5kzw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:57:39.840319 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.840232    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wc2p\" (UniqueName: \"kubernetes.io/projected/ebf24a23-a773-4a24-b0fb-87c7d91862ec-kube-api-access-7wc2p\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:39.840319 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.840259    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kzw6\" (UniqueName: \"kubernetes.io/projected/a8e45470-3497-44bd-bd13-59d611bc270e-kube-api-access-5kzw6\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:39.840319 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.840268    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:39.840319 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.840280    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a8e45470-3497-44bd-bd13-59d611bc270e-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:39.840319 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.840288    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxjgk\" (UniqueName: \"kubernetes.io/projected/c394d411-669a-424f-9c3e-6ae0a3cc3320-kube-api-access-pxjgk\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:39.840319 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:39.840297    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a8e45470-3497-44bd-bd13-59d611bc270e-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:57:40.592087 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.592001    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"
Sep 11 16:57:40.592530 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.591999    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7" event={"ID":"a8e45470-3497-44bd-bd13-59d611bc270e","Type":"ContainerDied","Data":"99a2ce4c50ee920ed397a969401c53644323f60086e65b2ead90e1f743c6995d"}
Sep 11 16:57:40.592530 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.592187    2569 scope.go:117] "RemoveContainer" containerID="834b1fdf812b7d735174bf734d7c1e731756b4ee3a589d602c215d17729b34a7"
Sep 11 16:57:40.593981 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.593959    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"
Sep 11 16:57:40.594154 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.594027    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp" event={"ID":"c394d411-669a-424f-9c3e-6ae0a3cc3320","Type":"ContainerDied","Data":"644eda21eec1237e5edf0207830d2fea36fa4e6d72cfc57363225871f1fe706b"}
Sep 11 16:57:40.594154 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.594140    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"
Sep 11 16:57:40.604852 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.604822    2569 scope.go:117] "RemoveContainer" containerID="6c11837411a053e3b67957075b2acd3a5d208c1f6bc38fe62e4bf59e34537755"
Sep 11 16:57:40.614628 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.614609    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"]
Sep 11 16:57:40.617985 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.617956    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d310aa61-7567c98864-fssh7"]
Sep 11 16:57:40.627896 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.627875    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"]
Sep 11 16:57:40.631553 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.631532    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-d310aa61-7c59b557c4-pqncp"]
Sep 11 16:57:40.646531 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.646513    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"]
Sep 11 16:57:40.650232 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:40.650213    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-d310aa61-65898c45df-jfvzl"]
Sep 11 16:57:41.927685 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:41.927651    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e45470-3497-44bd-bd13-59d611bc270e" path="/var/lib/kubelet/pods/a8e45470-3497-44bd-bd13-59d611bc270e/volumes"
Sep 11 16:57:41.928146 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:41.928128    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c394d411-669a-424f-9c3e-6ae0a3cc3320" path="/var/lib/kubelet/pods/c394d411-669a-424f-9c3e-6ae0a3cc3320/volumes"
Sep 11 16:57:41.928450 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:41.928438    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebf24a23-a773-4a24-b0fb-87c7d91862ec" path="/var/lib/kubelet/pods/ebf24a23-a773-4a24-b0fb-87c7d91862ec/volumes"
Sep 11 16:57:49.316550 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.316500    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"]
Sep 11 16:57:49.317198 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.317174    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c394d411-669a-424f-9c3e-6ae0a3cc3320" containerName="payload-pre-processing"
Sep 11 16:57:49.317292 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.317201    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c394d411-669a-424f-9c3e-6ae0a3cc3320" containerName="payload-pre-processing"
Sep 11 16:57:49.317292 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.317226    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e45470-3497-44bd-bd13-59d611bc270e" containerName="maas-api"
Sep 11 16:57:49.317292 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.317234    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e45470-3497-44bd-bd13-59d611bc270e" containerName="maas-api"
Sep 11 16:57:49.317292 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.317272    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebf24a23-a773-4a24-b0fb-87c7d91862ec" containerName="payload-processing"
Sep 11 16:57:49.317292 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.317281    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebf24a23-a773-4a24-b0fb-87c7d91862ec" containerName="payload-processing"
Sep 11 16:57:49.317459 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.317387    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e45470-3497-44bd-bd13-59d611bc270e" containerName="maas-api"
Sep 11 16:57:49.317459 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.317403    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebf24a23-a773-4a24-b0fb-87c7d91862ec" containerName="payload-processing"
Sep 11 16:57:49.317459 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.317413    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c394d411-669a-424f-9c3e-6ae0a3cc3320" containerName="payload-pre-processing"
Sep 11 16:57:49.322227 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.322204    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.324867 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.324845    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-9abacf77-serving-cert\""
Sep 11 16:57:49.328540 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.328519    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm88b\" (UniqueName: \"kubernetes.io/projected/f5b91de6-21e3-4f40-b357-f03a829a7112-kube-api-access-jm88b\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.328646 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.328561    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-metrics-certs\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.328646 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.328614    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-maas-api-tls\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.328746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.328646    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b91de6-21e3-4f40-b357-f03a829a7112-openshift-service-ca\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.337621 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.337593    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"]
Sep 11 16:57:49.429746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.429718    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm88b\" (UniqueName: \"kubernetes.io/projected/f5b91de6-21e3-4f40-b357-f03a829a7112-kube-api-access-jm88b\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.429957 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.429751    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-metrics-certs\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.429957 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.429778    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-maas-api-tls\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.429957 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.429792    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b91de6-21e3-4f40-b357-f03a829a7112-openshift-service-ca\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.429957 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:57:49.429914    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-serving-cert: secret "maas-api-e2e-derive-9abacf77-serving-cert" not found
Sep 11 16:57:49.430166 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:57:49.429991    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-maas-api-tls podName:f5b91de6-21e3-4f40-b357-f03a829a7112 nodeName:}" failed. No retries permitted until 2026-09-11 16:57:49.929969434 +0000 UTC m=+880.489360802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-maas-api-tls") pod "maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72" (UID: "f5b91de6-21e3-4f40-b357-f03a829a7112") : secret "maas-api-e2e-derive-9abacf77-serving-cert" not found
Sep 11 16:57:49.430377 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.430352    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b91de6-21e3-4f40-b357-f03a829a7112-openshift-service-ca\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.432453 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.432424    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-metrics-certs\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.440036 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.440007    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm88b\" (UniqueName: \"kubernetes.io/projected/f5b91de6-21e3-4f40-b357-f03a829a7112-kube-api-access-jm88b\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.934987 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.934955    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-maas-api-tls\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:49.937552 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:49.937524    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-maas-api-tls\") pod \"maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:50.093470 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.093435    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"]
Sep 11 16:57:50.097337 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.097313    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:57:50.099573 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.099557    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-9abacf77-dockercfg-b7d48\""
Sep 11 16:57:50.099657 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.099578    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-9abacf77\""
Sep 11 16:57:50.110160 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.110113    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"]
Sep 11 16:57:50.136709 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.136672    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23a01da0-ea95-4f63-80a5-602a41934f85-plugins-config-volume\") pod \"payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm\" (UID: \"23a01da0-ea95-4f63-80a5-602a41934f85\") " pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:57:50.136903 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.136733    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvv5\" (UniqueName: \"kubernetes.io/projected/23a01da0-ea95-4f63-80a5-602a41934f85-kube-api-access-khvv5\") pod \"payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm\" (UID: \"23a01da0-ea95-4f63-80a5-602a41934f85\") " pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:57:50.236458 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.236425    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:50.237746 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.237719    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23a01da0-ea95-4f63-80a5-602a41934f85-plugins-config-volume\") pod \"payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm\" (UID: \"23a01da0-ea95-4f63-80a5-602a41934f85\") " pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:57:50.237886 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.237823    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvv5\" (UniqueName: \"kubernetes.io/projected/23a01da0-ea95-4f63-80a5-602a41934f85-kube-api-access-khvv5\") pod \"payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm\" (UID: \"23a01da0-ea95-4f63-80a5-602a41934f85\") " pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:57:50.238327 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.238308    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23a01da0-ea95-4f63-80a5-602a41934f85-plugins-config-volume\") pod \"payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm\" (UID: \"23a01da0-ea95-4f63-80a5-602a41934f85\") " pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:57:50.246355 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.246333    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvv5\" (UniqueName: \"kubernetes.io/projected/23a01da0-ea95-4f63-80a5-602a41934f85-kube-api-access-khvv5\") pod \"payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm\" (UID: \"23a01da0-ea95-4f63-80a5-602a41934f85\") " pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:57:50.415083 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.415052    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:57:50.516705 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.516673    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"]
Sep 11 16:57:50.517963 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:57:50.517924    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b91de6_21e3_4f40_b357_f03a829a7112.slice/crio-f4b20706c1667ef5ad5281586d9b06bc5a768124f6ec6b9a3743e9ce90cff988 WatchSource:0}: Error finding container f4b20706c1667ef5ad5281586d9b06bc5a768124f6ec6b9a3743e9ce90cff988: Status 404 returned error can't find the container with id f4b20706c1667ef5ad5281586d9b06bc5a768124f6ec6b9a3743e9ce90cff988
Sep 11 16:57:50.658485 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.658450    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72" event={"ID":"f5b91de6-21e3-4f40-b357-f03a829a7112","Type":"ContainerStarted","Data":"f4b20706c1667ef5ad5281586d9b06bc5a768124f6ec6b9a3743e9ce90cff988"}
Sep 11 16:57:50.693701 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:50.693671    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"]
Sep 11 16:57:50.695394 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:57:50.695368    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23a01da0_ea95_4f63_80a5_602a41934f85.slice/crio-ca6988e640ead47abc7411bb71a7fba93c9125cfe3745f268d5f9e5061e3d903 WatchSource:0}: Error finding container ca6988e640ead47abc7411bb71a7fba93c9125cfe3745f268d5f9e5061e3d903: Status 404 returned error can't find the container with id ca6988e640ead47abc7411bb71a7fba93c9125cfe3745f268d5f9e5061e3d903
Sep 11 16:57:51.665205 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:51.665173    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72" event={"ID":"f5b91de6-21e3-4f40-b357-f03a829a7112","Type":"ContainerStarted","Data":"e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4"}
Sep 11 16:57:51.665629 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:51.665307    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:57:51.666934 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:51.666908    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm" event={"ID":"23a01da0-ea95-4f63-80a5-602a41934f85","Type":"ContainerStarted","Data":"60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85"}
Sep 11 16:57:51.667036 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:51.666965    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:57:51.667036 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:51.666991    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm" event={"ID":"23a01da0-ea95-4f63-80a5-602a41934f85","Type":"ContainerStarted","Data":"ca6988e640ead47abc7411bb71a7fba93c9125cfe3745f268d5f9e5061e3d903"}
Sep 11 16:57:51.685281 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:51.685232    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72" podStartSLOduration=2.3387544399999998 podStartE2EDuration="2.685217756s" totalImagesPullingTime="346.463316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:57:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:57:51.683249567 +0000 UTC m=+882.242640955" watchObservedRunningTime="2026-09-11 16:57:51.685217756 +0000 UTC m=+882.244609142"
Sep 11 16:57:51.700518 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:51.700480    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm" podStartSLOduration=1.700467704 podStartE2EDuration="1.700467704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:57:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:57:51.699542768 +0000 UTC m=+882.258934150" watchObservedRunningTime="2026-09-11 16:57:51.700467704 +0000 UTC m=+882.259859090"
Sep 11 16:57:57.677735 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:57:57.677709    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:58:02.674846 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:02.674747    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:58:26.175432 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.175399    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"]
Sep 11 16:58:26.175947 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.175646    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72" podUID="f5b91de6-21e3-4f40-b357-f03a829a7112" containerName="maas-api" containerID="cri-o://e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4" gracePeriod=30
Sep 11 16:58:26.215894 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.215863    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"]
Sep 11 16:58:26.216345 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.216295    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm" podUID="23a01da0-ea95-4f63-80a5-602a41934f85" containerName="payload-processing" containerID="cri-o://60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85" gracePeriod=30
Sep 11 16:58:26.466170 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.466150    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:58:26.497889 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.497784    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:58:26.569372 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.569344    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jm88b\" (UniqueName: \"kubernetes.io/projected/f5b91de6-21e3-4f40-b357-f03a829a7112-kube-api-access-jm88b\") pod \"f5b91de6-21e3-4f40-b357-f03a829a7112\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") "
Sep 11 16:58:26.569543 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.569383    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-metrics-certs\") pod \"f5b91de6-21e3-4f40-b357-f03a829a7112\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") "
Sep 11 16:58:26.569543 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.569425    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-maas-api-tls\") pod \"f5b91de6-21e3-4f40-b357-f03a829a7112\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") "
Sep 11 16:58:26.569543 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.569489    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b91de6-21e3-4f40-b357-f03a829a7112-openshift-service-ca\") pod \"f5b91de6-21e3-4f40-b357-f03a829a7112\" (UID: \"f5b91de6-21e3-4f40-b357-f03a829a7112\") "
Sep 11 16:58:26.569904 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.569878    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5b91de6-21e3-4f40-b357-f03a829a7112-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5b91de6-21e3-4f40-b357-f03a829a7112" (UID: "f5b91de6-21e3-4f40-b357-f03a829a7112"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:58:26.571666 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.571647    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5b91de6-21e3-4f40-b357-f03a829a7112" (UID: "f5b91de6-21e3-4f40-b357-f03a829a7112"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:58:26.571749 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.571695    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f5b91de6-21e3-4f40-b357-f03a829a7112" (UID: "f5b91de6-21e3-4f40-b357-f03a829a7112"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:58:26.571749 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.571700    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b91de6-21e3-4f40-b357-f03a829a7112-kube-api-access-jm88b" (OuterVolumeSpecName: "kube-api-access-jm88b") pod "f5b91de6-21e3-4f40-b357-f03a829a7112" (UID: "f5b91de6-21e3-4f40-b357-f03a829a7112"). InnerVolumeSpecName "kube-api-access-jm88b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:58:26.670227 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.670196    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23a01da0-ea95-4f63-80a5-602a41934f85-plugins-config-volume\") pod \"23a01da0-ea95-4f63-80a5-602a41934f85\" (UID: \"23a01da0-ea95-4f63-80a5-602a41934f85\") "
Sep 11 16:58:26.670398 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.670259    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khvv5\" (UniqueName: \"kubernetes.io/projected/23a01da0-ea95-4f63-80a5-602a41934f85-kube-api-access-khvv5\") pod \"23a01da0-ea95-4f63-80a5-602a41934f85\" (UID: \"23a01da0-ea95-4f63-80a5-602a41934f85\") "
Sep 11 16:58:26.670474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.670443    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jm88b\" (UniqueName: \"kubernetes.io/projected/f5b91de6-21e3-4f40-b357-f03a829a7112-kube-api-access-jm88b\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:26.670474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.670454    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:26.670474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.670463    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b91de6-21e3-4f40-b357-f03a829a7112-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:26.670474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.670470    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b91de6-21e3-4f40-b357-f03a829a7112-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:26.670668 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.670539    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23a01da0-ea95-4f63-80a5-602a41934f85-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "23a01da0-ea95-4f63-80a5-602a41934f85" (UID: "23a01da0-ea95-4f63-80a5-602a41934f85"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:58:26.672432 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.672409    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23a01da0-ea95-4f63-80a5-602a41934f85-kube-api-access-khvv5" (OuterVolumeSpecName: "kube-api-access-khvv5") pod "23a01da0-ea95-4f63-80a5-602a41934f85" (UID: "23a01da0-ea95-4f63-80a5-602a41934f85"). InnerVolumeSpecName "kube-api-access-khvv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:58:26.771569 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.771492    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/23a01da0-ea95-4f63-80a5-602a41934f85-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:26.771569 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.771518    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khvv5\" (UniqueName: \"kubernetes.io/projected/23a01da0-ea95-4f63-80a5-602a41934f85-kube-api-access-khvv5\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:26.878767 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.878732    2569 generic.go:356] "Generic (PLEG): container finished" podID="23a01da0-ea95-4f63-80a5-602a41934f85" containerID="60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85" exitCode=0
Sep 11 16:58:26.878967 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.878779    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"
Sep 11 16:58:26.878967 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.878831    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm" event={"ID":"23a01da0-ea95-4f63-80a5-602a41934f85","Type":"ContainerDied","Data":"60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85"}
Sep 11 16:58:26.878967 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.878883    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm" event={"ID":"23a01da0-ea95-4f63-80a5-602a41934f85","Type":"ContainerDied","Data":"ca6988e640ead47abc7411bb71a7fba93c9125cfe3745f268d5f9e5061e3d903"}
Sep 11 16:58:26.878967 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.878906    2569 scope.go:117] "RemoveContainer" containerID="60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85"
Sep 11 16:58:26.880689 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.880659    2569 generic.go:356] "Generic (PLEG): container finished" podID="f5b91de6-21e3-4f40-b357-f03a829a7112" containerID="e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4" exitCode=0
Sep 11 16:58:26.880850 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.880694    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72" event={"ID":"f5b91de6-21e3-4f40-b357-f03a829a7112","Type":"ContainerDied","Data":"e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4"}
Sep 11 16:58:26.880850 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.880716    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"
Sep 11 16:58:26.880850 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.880761    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72" event={"ID":"f5b91de6-21e3-4f40-b357-f03a829a7112","Type":"ContainerDied","Data":"f4b20706c1667ef5ad5281586d9b06bc5a768124f6ec6b9a3743e9ce90cff988"}
Sep 11 16:58:26.889438 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.889419    2569 scope.go:117] "RemoveContainer" containerID="60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85"
Sep 11 16:58:26.889789 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:58:26.889753    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85\": container with ID starting with 60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85 not found: ID does not exist" containerID="60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85"
Sep 11 16:58:26.889933 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.889852    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85"} err="failed to get container status \"60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85\": rpc error: code = NotFound desc = could not find container \"60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85\": container with ID starting with 60863c01f918ed7411e83eb34544db8eba8605b201b9aaeb2cffaf3a628a7e85 not found: ID does not exist"
Sep 11 16:58:26.889933 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.889877    2569 scope.go:117] "RemoveContainer" containerID="e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4"
Sep 11 16:58:26.898537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.898522    2569 scope.go:117] "RemoveContainer" containerID="e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4"
Sep 11 16:58:26.898828 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:58:26.898784    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4\": container with ID starting with e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4 not found: ID does not exist" containerID="e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4"
Sep 11 16:58:26.898895 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.898836    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4"} err="failed to get container status \"e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4\": rpc error: code = NotFound desc = could not find container \"e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4\": container with ID starting with e1a1004d63fd83dcf209eb1618fb52b28b5d6ef32a9e6b4263c30639547821b4 not found: ID does not exist"
Sep 11 16:58:26.910757 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.910736    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"]
Sep 11 16:58:26.918549 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.918527    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-9abacf77-74cb64cbd-rwh72"]
Sep 11 16:58:26.929076 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.929055    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"]
Sep 11 16:58:26.933673 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:26.933650    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-9abacf77-5fc5d74c4f-fl4tm"]
Sep 11 16:58:27.927599 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:27.927565    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23a01da0-ea95-4f63-80a5-602a41934f85" path="/var/lib/kubelet/pods/23a01da0-ea95-4f63-80a5-602a41934f85/volumes"
Sep 11 16:58:27.927990 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:27.927976    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b91de6-21e3-4f40-b357-f03a829a7112" path="/var/lib/kubelet/pods/f5b91de6-21e3-4f40-b357-f03a829a7112/volumes"
Sep 11 16:58:38.764612 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:38.764578    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"]
Sep 11 16:58:38.765047 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:38.764857    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs" podUID="9369547f-a18c-40f7-87f8-f96235955ef0" containerName="maas-api" containerID="cri-o://7591a4a79c93e7a6fa316fa898b9101c29a465bdb0222844f49404f543ed8f5e" gracePeriod=30
Sep 11 16:58:38.952419 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:38.952378    2569 generic.go:356] "Generic (PLEG): container finished" podID="9369547f-a18c-40f7-87f8-f96235955ef0" containerID="7591a4a79c93e7a6fa316fa898b9101c29a465bdb0222844f49404f543ed8f5e" exitCode=0
Sep 11 16:58:38.952575 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:38.952452    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs" event={"ID":"9369547f-a18c-40f7-87f8-f96235955ef0","Type":"ContainerDied","Data":"7591a4a79c93e7a6fa316fa898b9101c29a465bdb0222844f49404f543ed8f5e"}
Sep 11 16:58:39.020572 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.020502    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:58:39.085117 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.085085    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-metrics-certs\") pod \"9369547f-a18c-40f7-87f8-f96235955ef0\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") "
Sep 11 16:58:39.085306 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.085127    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-maas-api-tls\") pod \"9369547f-a18c-40f7-87f8-f96235955ef0\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") "
Sep 11 16:58:39.085306 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.085158    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gz9r7\" (UniqueName: \"kubernetes.io/projected/9369547f-a18c-40f7-87f8-f96235955ef0-kube-api-access-gz9r7\") pod \"9369547f-a18c-40f7-87f8-f96235955ef0\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") "
Sep 11 16:58:39.085306 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.085233    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9369547f-a18c-40f7-87f8-f96235955ef0-openshift-service-ca\") pod \"9369547f-a18c-40f7-87f8-f96235955ef0\" (UID: \"9369547f-a18c-40f7-87f8-f96235955ef0\") "
Sep 11 16:58:39.085720 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.085672    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9369547f-a18c-40f7-87f8-f96235955ef0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9369547f-a18c-40f7-87f8-f96235955ef0" (UID: "9369547f-a18c-40f7-87f8-f96235955ef0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 16:58:39.087491 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.087467    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9369547f-a18c-40f7-87f8-f96235955ef0" (UID: "9369547f-a18c-40f7-87f8-f96235955ef0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:58:39.087597 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.087494    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9369547f-a18c-40f7-87f8-f96235955ef0" (UID: "9369547f-a18c-40f7-87f8-f96235955ef0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 16:58:39.087635 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.087605    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9369547f-a18c-40f7-87f8-f96235955ef0-kube-api-access-gz9r7" (OuterVolumeSpecName: "kube-api-access-gz9r7") pod "9369547f-a18c-40f7-87f8-f96235955ef0" (UID: "9369547f-a18c-40f7-87f8-f96235955ef0"). InnerVolumeSpecName "kube-api-access-gz9r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 16:58:39.186156 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.186126    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9369547f-a18c-40f7-87f8-f96235955ef0-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:39.186156 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.186154    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:39.186156 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.186163    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9369547f-a18c-40f7-87f8-f96235955ef0-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:39.186388 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.186172    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gz9r7\" (UniqueName: \"kubernetes.io/projected/9369547f-a18c-40f7-87f8-f96235955ef0-kube-api-access-gz9r7\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 16:58:39.959439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.959415    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"
Sep 11 16:58:39.959439 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.959430    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs" event={"ID":"9369547f-a18c-40f7-87f8-f96235955ef0","Type":"ContainerDied","Data":"26628f18894447dcdd0048b3354b063852bfcac00ed5c01fa898cd3ed6482a51"}
Sep 11 16:58:39.959892 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.959487    2569 scope.go:117] "RemoveContainer" containerID="7591a4a79c93e7a6fa316fa898b9101c29a465bdb0222844f49404f543ed8f5e"
Sep 11 16:58:39.975931 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.975904    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"]
Sep 11 16:58:39.978483 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:39.978464    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-8b1a16-65d7775b6f-8nrxs"]
Sep 11 16:58:41.928385 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:41.928354    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9369547f-a18c-40f7-87f8-f96235955ef0" path="/var/lib/kubelet/pods/9369547f-a18c-40f7-87f8-f96235955ef0/volumes"
Sep 11 16:58:54.171420 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171380    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"]
Sep 11 16:58:54.174099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171778    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9369547f-a18c-40f7-87f8-f96235955ef0" containerName="maas-api"
Sep 11 16:58:54.174099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171789    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9369547f-a18c-40f7-87f8-f96235955ef0" containerName="maas-api"
Sep 11 16:58:54.174099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171815    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23a01da0-ea95-4f63-80a5-602a41934f85" containerName="payload-processing"
Sep 11 16:58:54.174099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171822    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="23a01da0-ea95-4f63-80a5-602a41934f85" containerName="payload-processing"
Sep 11 16:58:54.174099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171834    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b91de6-21e3-4f40-b357-f03a829a7112" containerName="maas-api"
Sep 11 16:58:54.174099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171839    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b91de6-21e3-4f40-b357-f03a829a7112" containerName="maas-api"
Sep 11 16:58:54.174099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171910    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9369547f-a18c-40f7-87f8-f96235955ef0" containerName="maas-api"
Sep 11 16:58:54.174099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171921    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b91de6-21e3-4f40-b357-f03a829a7112" containerName="maas-api"
Sep 11 16:58:54.174099 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.171929    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="23a01da0-ea95-4f63-80a5-602a41934f85" containerName="payload-processing"
Sep 11 16:58:54.174972 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.174951    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.176972 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.176953    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-2cceea-serving-cert\""
Sep 11 16:58:54.185649 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.185622    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"]
Sep 11 16:58:54.224228 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.224198    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgq4v\" (UniqueName: \"kubernetes.io/projected/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-kube-api-access-kgq4v\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.224418 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.224284    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-maas-api-tls\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.224418 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.224334    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-openshift-service-ca\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.224418 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.224409    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-metrics-certs\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.325628 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.325590    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgq4v\" (UniqueName: \"kubernetes.io/projected/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-kube-api-access-kgq4v\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.325834 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.325650    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-maas-api-tls\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.325834 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.325673    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-openshift-service-ca\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.325834 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.325709    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-metrics-certs\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.325834 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:58:54.325775    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-serving-cert: secret "maas-api-e2e-explicit-2cceea-serving-cert" not found
Sep 11 16:58:54.326050 ip-10-0-141-153 kubenswrapper[2569]: E0911 16:58:54.325862    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-maas-api-tls podName:7a5a947b-83f9-4b0d-93b1-2df5c3424ea7 nodeName:}" failed. No retries permitted until 2026-09-11 16:58:54.8258396 +0000 UTC m=+945.385230970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-maas-api-tls") pod "maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h" (UID: "7a5a947b-83f9-4b0d-93b1-2df5c3424ea7") : secret "maas-api-e2e-explicit-2cceea-serving-cert" not found
Sep 11 16:58:54.327101 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.327025    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-openshift-service-ca\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.334901 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.329189    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-metrics-certs\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.337474 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.337449    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgq4v\" (UniqueName: \"kubernetes.io/projected/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-kube-api-access-kgq4v\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.799182 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.799142    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"]
Sep 11 16:58:54.803018 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.802996    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 16:58:54.805179 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.805153    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-2cceea-dockercfg-szfkh\""
Sep 11 16:58:54.805324 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.805232    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-2cceea\""
Sep 11 16:58:54.813650 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.813630    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"]
Sep 11 16:58:54.830427 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.830402    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-maas-api-tls\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.832978 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.832951    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-maas-api-tls\") pod \"maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:54.931948 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.931914    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50d49563-745f-4c09-8e22-2725e85822f1-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl\" (UID: \"50d49563-745f-4c09-8e22-2725e85822f1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 16:58:54.932109 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:54.931971    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt5n9\" (UniqueName: \"kubernetes.io/projected/50d49563-745f-4c09-8e22-2725e85822f1-kube-api-access-pt5n9\") pod \"payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl\" (UID: \"50d49563-745f-4c09-8e22-2725e85822f1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 16:58:55.033302 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:55.033261    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt5n9\" (UniqueName: \"kubernetes.io/projected/50d49563-745f-4c09-8e22-2725e85822f1-kube-api-access-pt5n9\") pod \"payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl\" (UID: \"50d49563-745f-4c09-8e22-2725e85822f1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 16:58:55.033619 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:55.033595    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50d49563-745f-4c09-8e22-2725e85822f1-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl\" (UID: \"50d49563-745f-4c09-8e22-2725e85822f1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 16:58:55.034408 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:55.034385    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50d49563-745f-4c09-8e22-2725e85822f1-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl\" (UID: \"50d49563-745f-4c09-8e22-2725e85822f1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 16:58:55.040854 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:55.040833    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt5n9\" (UniqueName: \"kubernetes.io/projected/50d49563-745f-4c09-8e22-2725e85822f1-kube-api-access-pt5n9\") pod \"payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl\" (UID: \"50d49563-745f-4c09-8e22-2725e85822f1\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 16:58:55.089221 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:55.089152    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:55.115166 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:55.115143    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 16:58:55.363537 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:55.363512    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"]
Sep 11 16:58:55.365462 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:58:55.365436    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5a947b_83f9_4b0d_93b1_2df5c3424ea7.slice/crio-4c84e76e3b4700447bbae3056a0e2d6cbef3e4d92c03cb6621dfa483e30c1715 WatchSource:0}: Error finding container 4c84e76e3b4700447bbae3056a0e2d6cbef3e4d92c03cb6621dfa483e30c1715: Status 404 returned error can't find the container with id 4c84e76e3b4700447bbae3056a0e2d6cbef3e4d92c03cb6621dfa483e30c1715
Sep 11 16:58:55.395753 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:55.395731    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"]
Sep 11 16:58:55.397075 ip-10-0-141-153 kubenswrapper[2569]: W0911 16:58:55.397047    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50d49563_745f_4c09_8e22_2725e85822f1.slice/crio-9a878fa5ed16e98da737f0ffdfff063dd15644909a35e713dad85d0f019babca WatchSource:0}: Error finding container 9a878fa5ed16e98da737f0ffdfff063dd15644909a35e713dad85d0f019babca: Status 404 returned error can't find the container with id 9a878fa5ed16e98da737f0ffdfff063dd15644909a35e713dad85d0f019babca
Sep 11 16:58:56.060184 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:56.060100    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h" event={"ID":"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7","Type":"ContainerStarted","Data":"0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195"}
Sep 11 16:58:56.060184 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:56.060160    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h" event={"ID":"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7","Type":"ContainerStarted","Data":"4c84e76e3b4700447bbae3056a0e2d6cbef3e4d92c03cb6621dfa483e30c1715"}
Sep 11 16:58:56.060411 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:56.060215    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:58:56.061849 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:56.061825    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl" event={"ID":"50d49563-745f-4c09-8e22-2725e85822f1","Type":"ContainerStarted","Data":"280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9"}
Sep 11 16:58:56.061944 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:56.061862    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl" event={"ID":"50d49563-745f-4c09-8e22-2725e85822f1","Type":"ContainerStarted","Data":"9a878fa5ed16e98da737f0ffdfff063dd15644909a35e713dad85d0f019babca"}
Sep 11 16:58:56.061944 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:56.061881    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 16:58:56.080648 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:56.080599    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h" podStartSLOduration=1.639499547 podStartE2EDuration="2.080585463s" totalImagesPullingTime="441.085916ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:58:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:58:56.078028689 +0000 UTC m=+946.637420080" watchObservedRunningTime="2026-09-11 16:58:56.080585463 +0000 UTC m=+946.639976849"
Sep 11 16:58:56.099589 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:58:56.099537    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl" podStartSLOduration=2.099518717 podStartE2EDuration="2.099518717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 16:58:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 16:58:56.096617101 +0000 UTC m=+946.656008489" watchObservedRunningTime="2026-09-11 16:58:56.099518717 +0000 UTC m=+946.658910106"
Sep 11 16:59:02.073017 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:59:02.072990    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 16:59:07.070357 ip-10-0-141-153 kubenswrapper[2569]: I0911 16:59:07.070324    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 17:00:15.185421 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.185391    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"]
Sep 11 17:00:15.189221 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.189201    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.191778 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.191757    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-31e12f72-serving-cert\""
Sep 11 17:00:15.205308 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.205283    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"]
Sep 11 17:00:15.287853 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.287787    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-metrics-certs\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.287853 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.287859    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j4mh\" (UniqueName: \"kubernetes.io/projected/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-kube-api-access-9j4mh\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.288063 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.287886    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-openshift-service-ca\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.288063 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.287912    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-maas-api-tls\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.388540 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.388506    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-openshift-service-ca\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.388540 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.388543    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-maas-api-tls\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.388775 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.388629    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-metrics-certs\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.388775 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.388647    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j4mh\" (UniqueName: \"kubernetes.io/projected/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-kube-api-access-9j4mh\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.388775 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:00:15.388712    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-serving-cert: secret "maas-api-e2e-mt-31e12f72-serving-cert" not found
Sep 11 17:00:15.388967 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:00:15.388826    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-maas-api-tls podName:b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a nodeName:}" failed. No retries permitted until 2026-09-11 17:00:15.88877837 +0000 UTC m=+1026.448169743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-maas-api-tls") pod "maas-api-e2e-mt-31e12f72-654f7565f9-h9bth" (UID: "b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a") : secret "maas-api-e2e-mt-31e12f72-serving-cert" not found
Sep 11 17:00:15.389192 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.389175    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-openshift-service-ca\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.391238 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.391217    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-metrics-certs\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.412080 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.412054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j4mh\" (UniqueName: \"kubernetes.io/projected/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-kube-api-access-9j4mh\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.892682 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.892649    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-maas-api-tls\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:15.895177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:15.895150    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-maas-api-tls\") pod \"maas-api-e2e-mt-31e12f72-654f7565f9-h9bth\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:16.032465 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.032435    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"]
Sep 11 17:00:16.036006 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.035991    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:16.040193 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.040168    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-31e12f72\""
Sep 11 17:00:16.040675 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.040657    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-31e12f72-dockercfg-wxf95\""
Sep 11 17:00:16.063842 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.063820    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"]
Sep 11 17:00:16.094655 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.094626    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsgl5\" (UniqueName: \"kubernetes.io/projected/c5044def-a852-48e9-b669-5a88571c7c1d-kube-api-access-nsgl5\") pod \"payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz\" (UID: \"c5044def-a852-48e9-b669-5a88571c7c1d\") " pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:16.094818 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.094679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5044def-a852-48e9-b669-5a88571c7c1d-plugins-config-volume\") pod \"payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz\" (UID: \"c5044def-a852-48e9-b669-5a88571c7c1d\") " pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:16.099493 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.099465    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:16.195992 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.195963    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5044def-a852-48e9-b669-5a88571c7c1d-plugins-config-volume\") pod \"payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz\" (UID: \"c5044def-a852-48e9-b669-5a88571c7c1d\") " pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:16.196411 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.196050    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsgl5\" (UniqueName: \"kubernetes.io/projected/c5044def-a852-48e9-b669-5a88571c7c1d-kube-api-access-nsgl5\") pod \"payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz\" (UID: \"c5044def-a852-48e9-b669-5a88571c7c1d\") " pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:16.196980 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.196954    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5044def-a852-48e9-b669-5a88571c7c1d-plugins-config-volume\") pod \"payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz\" (UID: \"c5044def-a852-48e9-b669-5a88571c7c1d\") " pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:16.212637 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.212610    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsgl5\" (UniqueName: \"kubernetes.io/projected/c5044def-a852-48e9-b669-5a88571c7c1d-kube-api-access-nsgl5\") pod \"payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz\" (UID: \"c5044def-a852-48e9-b669-5a88571c7c1d\") " pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:16.347982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.347947    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:16.381995 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.381973    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"]
Sep 11 17:00:16.384513 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:00:16.384480    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb727ae6b_75d9_4b4d_bbbe_b9ff37e4129a.slice/crio-ebb942486490419fdcb34dfd540399c3a3a6a5f1d371f0ccc974cad64dd862c1 WatchSource:0}: Error finding container ebb942486490419fdcb34dfd540399c3a3a6a5f1d371f0ccc974cad64dd862c1: Status 404 returned error can't find the container with id ebb942486490419fdcb34dfd540399c3a3a6a5f1d371f0ccc974cad64dd862c1
Sep 11 17:00:16.386072 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.386048    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:00:16.532304 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.532271    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth" event={"ID":"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a","Type":"ContainerStarted","Data":"ebb942486490419fdcb34dfd540399c3a3a6a5f1d371f0ccc974cad64dd862c1"}
Sep 11 17:00:16.636005 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:16.635981    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"]
Sep 11 17:00:16.637902 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:00:16.637875    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5044def_a852_48e9_b669_5a88571c7c1d.slice/crio-c8907b5baa9f842202ca6be6493fa8a1c08f7063fbdaf4826570b32b3cfb32df WatchSource:0}: Error finding container c8907b5baa9f842202ca6be6493fa8a1c08f7063fbdaf4826570b32b3cfb32df: Status 404 returned error can't find the container with id c8907b5baa9f842202ca6be6493fa8a1c08f7063fbdaf4826570b32b3cfb32df
Sep 11 17:00:17.540513 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:17.540470    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz" event={"ID":"c5044def-a852-48e9-b669-5a88571c7c1d","Type":"ContainerStarted","Data":"0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7"}
Sep 11 17:00:17.541073 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:17.540532    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz" event={"ID":"c5044def-a852-48e9-b669-5a88571c7c1d","Type":"ContainerStarted","Data":"c8907b5baa9f842202ca6be6493fa8a1c08f7063fbdaf4826570b32b3cfb32df"}
Sep 11 17:00:17.541073 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:17.540616    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:17.542242 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:17.542216    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth" event={"ID":"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a","Type":"ContainerStarted","Data":"d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732"}
Sep 11 17:00:17.542342 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:17.542270    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:17.560526 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:17.560488    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz" podStartSLOduration=1.5604744720000001 podStartE2EDuration="1.560474472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:00:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:00:17.55906921 +0000 UTC m=+1028.118460597" watchObservedRunningTime="2026-09-11 17:00:17.560474472 +0000 UTC m=+1028.119865940"
Sep 11 17:00:17.580970 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:17.580929    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth" podStartSLOduration=2.219892436 podStartE2EDuration="2.580915051s" totalImagesPullingTime="361.022615ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:00:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:00:17.579255995 +0000 UTC m=+1028.138647382" watchObservedRunningTime="2026-09-11 17:00:17.580915051 +0000 UTC m=+1028.140306446"
Sep 11 17:00:23.554015 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:23.553989    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:00:28.550487 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:28.550459    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:00:59.876958 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:59.876919    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"]
Sep 11 17:00:59.877578 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:59.877167    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth" podUID="b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" containerName="maas-api" containerID="cri-o://d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732" gracePeriod=30
Sep 11 17:00:59.936826 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:59.936769    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"]
Sep 11 17:00:59.937061 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:00:59.937020    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz" podUID="c5044def-a852-48e9-b669-5a88571c7c1d" containerName="payload-processing" containerID="cri-o://0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7" gracePeriod=30
Sep 11 17:01:00.184671 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.184633    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:01:00.228759 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.228735    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-metrics-certs\") pod \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") "
Sep 11 17:01:00.228944 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.228815    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j4mh\" (UniqueName: \"kubernetes.io/projected/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-kube-api-access-9j4mh\") pod \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") "
Sep 11 17:01:00.228944 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.228917    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-openshift-service-ca\") pod \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") "
Sep 11 17:01:00.229071 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.228992    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-maas-api-tls\") pod \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\" (UID: \"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a\") "
Sep 11 17:01:00.229253 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.229220    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" (UID: "b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:01:00.231004 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.230976    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-kube-api-access-9j4mh" (OuterVolumeSpecName: "kube-api-access-9j4mh") pod "b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" (UID: "b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a"). InnerVolumeSpecName "kube-api-access-9j4mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:01:00.231099 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.231012    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" (UID: "b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:01:00.231187 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.231124    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" (UID: "b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:01:00.243438 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.243420    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:01:00.330466 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.330428    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5044def-a852-48e9-b669-5a88571c7c1d-plugins-config-volume\") pod \"c5044def-a852-48e9-b669-5a88571c7c1d\" (UID: \"c5044def-a852-48e9-b669-5a88571c7c1d\") "
Sep 11 17:01:00.330466 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.330472    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsgl5\" (UniqueName: \"kubernetes.io/projected/c5044def-a852-48e9-b669-5a88571c7c1d-kube-api-access-nsgl5\") pod \"c5044def-a852-48e9-b669-5a88571c7c1d\" (UID: \"c5044def-a852-48e9-b669-5a88571c7c1d\") "
Sep 11 17:01:00.330743 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.330723    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j4mh\" (UniqueName: \"kubernetes.io/projected/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-kube-api-access-9j4mh\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:00.330743 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.330739    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:00.330898 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.330749    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:00.330898 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.330757    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:00.330987 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.330892    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5044def-a852-48e9-b669-5a88571c7c1d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c5044def-a852-48e9-b669-5a88571c7c1d" (UID: "c5044def-a852-48e9-b669-5a88571c7c1d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:01:00.332621 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.332601    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5044def-a852-48e9-b669-5a88571c7c1d-kube-api-access-nsgl5" (OuterVolumeSpecName: "kube-api-access-nsgl5") pod "c5044def-a852-48e9-b669-5a88571c7c1d" (UID: "c5044def-a852-48e9-b669-5a88571c7c1d"). InnerVolumeSpecName "kube-api-access-nsgl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:01:00.432138 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.432049    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5044def-a852-48e9-b669-5a88571c7c1d-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:00.432138 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.432074    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsgl5\" (UniqueName: \"kubernetes.io/projected/c5044def-a852-48e9-b669-5a88571c7c1d-kube-api-access-nsgl5\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:00.804206 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.804169    2569 generic.go:356] "Generic (PLEG): container finished" podID="c5044def-a852-48e9-b669-5a88571c7c1d" containerID="0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7" exitCode=0
Sep 11 17:01:00.804385 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.804215    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"
Sep 11 17:01:00.804385 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.804243    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz" event={"ID":"c5044def-a852-48e9-b669-5a88571c7c1d","Type":"ContainerDied","Data":"0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7"}
Sep 11 17:01:00.804385 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.804293    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz" event={"ID":"c5044def-a852-48e9-b669-5a88571c7c1d","Type":"ContainerDied","Data":"c8907b5baa9f842202ca6be6493fa8a1c08f7063fbdaf4826570b32b3cfb32df"}
Sep 11 17:01:00.804385 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.804324    2569 scope.go:117] "RemoveContainer" containerID="0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7"
Sep 11 17:01:00.805866 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.805786    2569 generic.go:356] "Generic (PLEG): container finished" podID="b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" containerID="d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732" exitCode=0
Sep 11 17:01:00.806114 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.806097    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth" event={"ID":"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a","Type":"ContainerDied","Data":"d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732"}
Sep 11 17:01:00.806180 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.806143    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth" event={"ID":"b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a","Type":"ContainerDied","Data":"ebb942486490419fdcb34dfd540399c3a3a6a5f1d371f0ccc974cad64dd862c1"}
Sep 11 17:01:00.806251 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.806233    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"
Sep 11 17:01:00.814665 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.814644    2569 scope.go:117] "RemoveContainer" containerID="0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7"
Sep 11 17:01:00.815019 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:01:00.814991    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7\": container with ID starting with 0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7 not found: ID does not exist" containerID="0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7"
Sep 11 17:01:00.815140 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.815034    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7"} err="failed to get container status \"0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7\": rpc error: code = NotFound desc = could not find container \"0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7\": container with ID starting with 0634b020d0288b8b5fc1a99055e7dfacba795a72ae81597e5dbb48c6649336c7 not found: ID does not exist"
Sep 11 17:01:00.815140 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.815052    2569 scope.go:117] "RemoveContainer" containerID="d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732"
Sep 11 17:01:00.823764 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.823748    2569 scope.go:117] "RemoveContainer" containerID="d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732"
Sep 11 17:01:00.824044 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:01:00.824027    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732\": container with ID starting with d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732 not found: ID does not exist" containerID="d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732"
Sep 11 17:01:00.824150 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.824051    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732"} err="failed to get container status \"d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732\": rpc error: code = NotFound desc = could not find container \"d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732\": container with ID starting with d711afe85d952466afbb7ea29e3f934c7771785c67c11fe7a5d84c34c1d6b732 not found: ID does not exist"
Sep 11 17:01:00.830034 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.830015    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"]
Sep 11 17:01:00.833699 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.833672    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-31e12f72-869b47bb4f-zfntz"]
Sep 11 17:01:00.842528 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.842509    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"]
Sep 11 17:01:00.848251 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:00.848226    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-31e12f72-654f7565f9-h9bth"]
Sep 11 17:01:01.126133 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.126056    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"]
Sep 11 17:01:01.126492 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.126286    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h" podUID="7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" containerName="maas-api" containerID="cri-o://0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195" gracePeriod=30
Sep 11 17:01:01.191876 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.191784    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"]
Sep 11 17:01:01.192094 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.192065    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl" podUID="50d49563-745f-4c09-8e22-2725e85822f1" containerName="payload-pre-processing" containerID="cri-o://280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9" gracePeriod=30
Sep 11 17:01:01.455358 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.455331    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 17:01:01.476329 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.476303    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 17:01:01.542525 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.542491    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt5n9\" (UniqueName: \"kubernetes.io/projected/50d49563-745f-4c09-8e22-2725e85822f1-kube-api-access-pt5n9\") pod \"50d49563-745f-4c09-8e22-2725e85822f1\" (UID: \"50d49563-745f-4c09-8e22-2725e85822f1\") "
Sep 11 17:01:01.542693 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.542577    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50d49563-745f-4c09-8e22-2725e85822f1-plugins-config-volume\") pod \"50d49563-745f-4c09-8e22-2725e85822f1\" (UID: \"50d49563-745f-4c09-8e22-2725e85822f1\") "
Sep 11 17:01:01.542693 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.542614    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-openshift-service-ca\") pod \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") "
Sep 11 17:01:01.542693 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.542663    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgq4v\" (UniqueName: \"kubernetes.io/projected/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-kube-api-access-kgq4v\") pod \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") "
Sep 11 17:01:01.542891 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.542701    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-maas-api-tls\") pod \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") "
Sep 11 17:01:01.542891 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.542735    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-metrics-certs\") pod \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\" (UID: \"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7\") "
Sep 11 17:01:01.543000 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.542978    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" (UID: "7a5a947b-83f9-4b0d-93b1-2df5c3424ea7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:01:01.543062 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.543024    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50d49563-745f-4c09-8e22-2725e85822f1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "50d49563-745f-4c09-8e22-2725e85822f1" (UID: "50d49563-745f-4c09-8e22-2725e85822f1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:01:01.543358 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.543326    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/50d49563-745f-4c09-8e22-2725e85822f1-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:01.543358 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.543352    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:01.544860 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.544836    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50d49563-745f-4c09-8e22-2725e85822f1-kube-api-access-pt5n9" (OuterVolumeSpecName: "kube-api-access-pt5n9") pod "50d49563-745f-4c09-8e22-2725e85822f1" (UID: "50d49563-745f-4c09-8e22-2725e85822f1"). InnerVolumeSpecName "kube-api-access-pt5n9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:01:01.544940 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.544879    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-kube-api-access-kgq4v" (OuterVolumeSpecName: "kube-api-access-kgq4v") pod "7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" (UID: "7a5a947b-83f9-4b0d-93b1-2df5c3424ea7"). InnerVolumeSpecName "kube-api-access-kgq4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:01:01.545382 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.545359    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" (UID: "7a5a947b-83f9-4b0d-93b1-2df5c3424ea7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:01:01.545382 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.545374    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" (UID: "7a5a947b-83f9-4b0d-93b1-2df5c3424ea7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:01:01.644067 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.644036    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgq4v\" (UniqueName: \"kubernetes.io/projected/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-kube-api-access-kgq4v\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:01.644067 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.644065    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:01.644067 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.644075    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:01.644300 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.644082    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt5n9\" (UniqueName: \"kubernetes.io/projected/50d49563-745f-4c09-8e22-2725e85822f1-kube-api-access-pt5n9\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:01:01.814526 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.814493    2569 generic.go:356] "Generic (PLEG): container finished" podID="7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" containerID="0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195" exitCode=0
Sep 11 17:01:01.814728 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.814541    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"
Sep 11 17:01:01.814728 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.814590    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h" event={"ID":"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7","Type":"ContainerDied","Data":"0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195"}
Sep 11 17:01:01.814728 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.814645    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h" event={"ID":"7a5a947b-83f9-4b0d-93b1-2df5c3424ea7","Type":"ContainerDied","Data":"4c84e76e3b4700447bbae3056a0e2d6cbef3e4d92c03cb6621dfa483e30c1715"}
Sep 11 17:01:01.814728 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.814676    2569 scope.go:117] "RemoveContainer" containerID="0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195"
Sep 11 17:01:01.816060 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.816040    2569 generic.go:356] "Generic (PLEG): container finished" podID="50d49563-745f-4c09-8e22-2725e85822f1" containerID="280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9" exitCode=0
Sep 11 17:01:01.816170 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.816073    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl" event={"ID":"50d49563-745f-4c09-8e22-2725e85822f1","Type":"ContainerDied","Data":"280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9"}
Sep 11 17:01:01.816170 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.816094    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"
Sep 11 17:01:01.816170 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.816130    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl" event={"ID":"50d49563-745f-4c09-8e22-2725e85822f1","Type":"ContainerDied","Data":"9a878fa5ed16e98da737f0ffdfff063dd15644909a35e713dad85d0f019babca"}
Sep 11 17:01:01.825273 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.825209    2569 scope.go:117] "RemoveContainer" containerID="0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195"
Sep 11 17:01:01.825571 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:01:01.825551    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195\": container with ID starting with 0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195 not found: ID does not exist" containerID="0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195"
Sep 11 17:01:01.825643 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.825578    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195"} err="failed to get container status \"0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195\": rpc error: code = NotFound desc = could not find container \"0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195\": container with ID starting with 0c611b2071cfce25e4b5194412baa117c17c47a659ad82a1aea40e7a98a94195 not found: ID does not exist"
Sep 11 17:01:01.825643 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.825595    2569 scope.go:117] "RemoveContainer" containerID="280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9"
Sep 11 17:01:01.833893 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.833874    2569 scope.go:117] "RemoveContainer" containerID="280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9"
Sep 11 17:01:01.834164 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:01:01.834147    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9\": container with ID starting with 280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9 not found: ID does not exist" containerID="280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9"
Sep 11 17:01:01.834241 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.834170    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9"} err="failed to get container status \"280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9\": rpc error: code = NotFound desc = could not find container \"280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9\": container with ID starting with 280deedaa31f16780e71790c7e4e85e63b83a8d24a88d30373aad106e98bbcc9 not found: ID does not exist"
Sep 11 17:01:01.837392 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.837371    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"]
Sep 11 17:01:01.843825 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.843774    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-2cceea-86f5f9d5d4-fmc9h"]
Sep 11 17:01:01.853835 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.853790    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"]
Sep 11 17:01:01.856143 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.856124    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-2cceea-7bd48d77bb-z6qvl"]
Sep 11 17:01:01.928547 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.928513    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50d49563-745f-4c09-8e22-2725e85822f1" path="/var/lib/kubelet/pods/50d49563-745f-4c09-8e22-2725e85822f1/volumes"
Sep 11 17:01:01.928928 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.928915    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" path="/var/lib/kubelet/pods/7a5a947b-83f9-4b0d-93b1-2df5c3424ea7/volumes"
Sep 11 17:01:01.929253 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.929242    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" path="/var/lib/kubelet/pods/b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a/volumes"
Sep 11 17:01:01.929851 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:01.929837    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5044def-a852-48e9-b669-5a88571c7c1d" path="/var/lib/kubelet/pods/c5044def-a852-48e9-b669-5a88571c7c1d/volumes"
Sep 11 17:01:09.495883 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.495852    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"]
Sep 11 17:01:09.496314 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496298    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" containerName="maas-api"
Sep 11 17:01:09.496357 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496318    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" containerName="maas-api"
Sep 11 17:01:09.496357 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496344    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" containerName="maas-api"
Sep 11 17:01:09.496357 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496352    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" containerName="maas-api"
Sep 11 17:01:09.496491 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496367    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50d49563-745f-4c09-8e22-2725e85822f1" containerName="payload-pre-processing"
Sep 11 17:01:09.496491 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496373    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="50d49563-745f-4c09-8e22-2725e85822f1" containerName="payload-pre-processing"
Sep 11 17:01:09.496491 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496385    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5044def-a852-48e9-b669-5a88571c7c1d" containerName="payload-processing"
Sep 11 17:01:09.496491 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496390    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5044def-a852-48e9-b669-5a88571c7c1d" containerName="payload-processing"
Sep 11 17:01:09.496491 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496482    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5044def-a852-48e9-b669-5a88571c7c1d" containerName="payload-processing"
Sep 11 17:01:09.496491 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496493    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="50d49563-745f-4c09-8e22-2725e85822f1" containerName="payload-pre-processing"
Sep 11 17:01:09.496789 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496500    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b727ae6b-75d9-4b4d-bbbe-b9ff37e4129a" containerName="maas-api"
Sep 11 17:01:09.496789 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.496506    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a5a947b-83f9-4b0d-93b1-2df5c3424ea7" containerName="maas-api"
Sep 11 17:01:09.500061 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.500043    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.503391 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.503371    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-9459f0-openshift-default-dockercfg-8xhx7\""
Sep 11 17:01:09.504666 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.504651    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 17:01:09.532566 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.532540    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"]
Sep 11 17:01:09.617534 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.617497    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-socket\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.617708 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.617537    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-envoy\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.617708 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.617600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-data\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.617708 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.617644    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istiod-ca-cert\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.617708 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.617679    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-token\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.617889 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.617790    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-podinfo\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.617889 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.617852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmhjv\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-kube-api-access-nmhjv\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.617956 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.617904    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-credential-socket\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.617956 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.617938    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-certs\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.718691 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.718654    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-credential-socket\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.718691 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.718692    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-certs\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.718982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.718722    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-socket\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.718982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.718741    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-envoy\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.718982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.718766    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-data\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.718982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.718791    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istiod-ca-cert\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.718982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.718854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-token\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.718982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.718937    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-podinfo\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.718982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.718971    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmhjv\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-kube-api-access-nmhjv\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.719358 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.719074    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-credential-socket\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.719358 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.719100    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-socket\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.719476 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.719410    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-data\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.719476 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.719425    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-certs\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.719592 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.719561    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istiod-ca-cert\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.721357 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.721331    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-envoy\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.721482 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.721466    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-podinfo\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.726925 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.726899    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-token\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.727174 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.727158    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmhjv\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-kube-api-access-nmhjv\") pod \"e2e-noten-9459f0-openshift-default-5b98456494-xxl9s\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") " pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:09.810634 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:09.810533    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:10.099532 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:10.099504    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"]
Sep 11 17:01:10.100623 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:01:10.100598    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ced4443_e6ed_4a7c_a9cd_a678c15ebef8.slice/crio-f0814a37825edb3d4199ce5c5fc75db56b80b7cf3df41c6ff43860bbe935f2a6 WatchSource:0}: Error finding container f0814a37825edb3d4199ce5c5fc75db56b80b7cf3df41c6ff43860bbe935f2a6: Status 404 returned error can't find the container with id f0814a37825edb3d4199ce5c5fc75db56b80b7cf3df41c6ff43860bbe935f2a6
Sep 11 17:01:10.874195 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:10.874162    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s" event={"ID":"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8","Type":"ContainerStarted","Data":"f0814a37825edb3d4199ce5c5fc75db56b80b7cf3df41c6ff43860bbe935f2a6"}
Sep 11 17:01:12.727143 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:12.727104    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:01:12.727418 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:12.727187    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:01:12.727418 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:12.727221    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:01:12.888737 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:12.888700    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s" event={"ID":"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8","Type":"ContainerStarted","Data":"b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad"}
Sep 11 17:01:12.912344 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:12.912287    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s" podStartSLOduration=1.288194737 podStartE2EDuration="3.912270618s" totalImagesPullingTime="2.624075881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:01:12.908790765 +0000 UTC m=+1083.468182154" watchObservedRunningTime="2026-09-11 17:01:12.912270618 +0000 UTC m=+1083.471662005"
Sep 11 17:01:13.811635 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:13.811593    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:13.817074 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:13.817049    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:13.894790 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:13.894758    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:13.895636 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:13.895619    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:01:28.232970 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.232936    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"]
Sep 11 17:01:28.236770 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.236748    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.239535 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.239503    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-6b6653-serving-cert\""
Sep 11 17:01:28.252729 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.252705    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"]
Sep 11 17:01:28.302571 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.302535    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7xs7\" (UniqueName: \"kubernetes.io/projected/2609bff4-3e7c-49e6-9978-894403249ee5-kube-api-access-q7xs7\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.302733 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.302674    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2609bff4-3e7c-49e6-9978-894403249ee5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.302733 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.302725    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.302877 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.302856    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.404123 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.404075    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2609bff4-3e7c-49e6-9978-894403249ee5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.404123 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.404137    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.404353 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.404178    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.404353 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.404226    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7xs7\" (UniqueName: \"kubernetes.io/projected/2609bff4-3e7c-49e6-9978-894403249ee5-kube-api-access-q7xs7\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.404353 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:01:28.404306    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-serving-cert: secret "maas-api-e2e-shared-a-w2-6b6653-serving-cert" not found
Sep 11 17:01:28.404469 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:01:28.404373    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-maas-api-tls podName:2609bff4-3e7c-49e6-9978-894403249ee5 nodeName:}" failed. No retries permitted until 2026-09-11 17:01:28.904351024 +0000 UTC m=+1099.463742414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-maas-api-tls") pod "maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954" (UID: "2609bff4-3e7c-49e6-9978-894403249ee5") : secret "maas-api-e2e-shared-a-w2-6b6653-serving-cert" not found
Sep 11 17:01:28.404788 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.404765    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2609bff4-3e7c-49e6-9978-894403249ee5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.406808 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.406776    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.413547 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.413517    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7xs7\" (UniqueName: \"kubernetes.io/projected/2609bff4-3e7c-49e6-9978-894403249ee5-kube-api-access-q7xs7\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.905871 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.905844    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"]
Sep 11 17:01:28.909381 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.909358    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.909572 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.909558    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:28.911909 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.911886    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:28.911998 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.911946    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-6b6653\""
Sep 11 17:01:28.911998 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.911960    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-6b6653-dockercfg-r6snq\""
Sep 11 17:01:28.919613 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:28.919589    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"]
Sep 11 17:01:29.010732 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.010700    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6fkx\" (UniqueName: \"kubernetes.io/projected/a3b0652d-de3a-425a-8a33-714fcfbf3470-kube-api-access-l6fkx\") pod \"payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4\" (UID: \"a3b0652d-de3a-425a-8a33-714fcfbf3470\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:29.010954 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.010752    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3b0652d-de3a-425a-8a33-714fcfbf3470-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4\" (UID: \"a3b0652d-de3a-425a-8a33-714fcfbf3470\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:29.111710 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.111676    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6fkx\" (UniqueName: \"kubernetes.io/projected/a3b0652d-de3a-425a-8a33-714fcfbf3470-kube-api-access-l6fkx\") pod \"payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4\" (UID: \"a3b0652d-de3a-425a-8a33-714fcfbf3470\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:29.111929 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.111720    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3b0652d-de3a-425a-8a33-714fcfbf3470-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4\" (UID: \"a3b0652d-de3a-425a-8a33-714fcfbf3470\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:29.112393 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.112373    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3b0652d-de3a-425a-8a33-714fcfbf3470-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4\" (UID: \"a3b0652d-de3a-425a-8a33-714fcfbf3470\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:29.120105 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.120078    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6fkx\" (UniqueName: \"kubernetes.io/projected/a3b0652d-de3a-425a-8a33-714fcfbf3470-kube-api-access-l6fkx\") pod \"payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4\" (UID: \"a3b0652d-de3a-425a-8a33-714fcfbf3470\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:29.147958 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.147931    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:29.233374 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.233333    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:29.425200 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.425172    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"]
Sep 11 17:01:29.426769 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:01:29.426745    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2609bff4_3e7c_49e6_9978_894403249ee5.slice/crio-e927349e1d5d5d68773854fff91a4e6427004c4bf434763c4f585144b5276362 WatchSource:0}: Error finding container e927349e1d5d5d68773854fff91a4e6427004c4bf434763c4f585144b5276362: Status 404 returned error can't find the container with id e927349e1d5d5d68773854fff91a4e6427004c4bf434763c4f585144b5276362
Sep 11 17:01:29.512910 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.512888    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"]
Sep 11 17:01:29.516403 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:01:29.516378    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3b0652d_de3a_425a_8a33_714fcfbf3470.slice/crio-d1cecdc4de7795cc7839ab1d2700352ee6ad4682923e5781c524b6f38160775c WatchSource:0}: Error finding container d1cecdc4de7795cc7839ab1d2700352ee6ad4682923e5781c524b6f38160775c: Status 404 returned error can't find the container with id d1cecdc4de7795cc7839ab1d2700352ee6ad4682923e5781c524b6f38160775c
Sep 11 17:01:29.997138 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.997096    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4" event={"ID":"a3b0652d-de3a-425a-8a33-714fcfbf3470","Type":"ContainerStarted","Data":"2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad"}
Sep 11 17:01:29.997366 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.997160    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4" event={"ID":"a3b0652d-de3a-425a-8a33-714fcfbf3470","Type":"ContainerStarted","Data":"d1cecdc4de7795cc7839ab1d2700352ee6ad4682923e5781c524b6f38160775c"}
Sep 11 17:01:29.997366 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.997288    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:29.998345 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:29.998318    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954" event={"ID":"2609bff4-3e7c-49e6-9978-894403249ee5","Type":"ContainerStarted","Data":"e927349e1d5d5d68773854fff91a4e6427004c4bf434763c4f585144b5276362"}
Sep 11 17:01:30.015457 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:30.015412    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4" podStartSLOduration=2.01539834 podStartE2EDuration="2.01539834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:01:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:01:30.014061498 +0000 UTC m=+1100.573452885" watchObservedRunningTime="2026-09-11 17:01:30.01539834 +0000 UTC m=+1100.574789726"
Sep 11 17:01:33.017301 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:33.017263    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954" event={"ID":"2609bff4-3e7c-49e6-9978-894403249ee5","Type":"ContainerStarted","Data":"40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6"}
Sep 11 17:01:33.017660 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:33.017343    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:33.043446 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:33.043402    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954" podStartSLOduration=1.891816881 podStartE2EDuration="5.043387714s" totalImagesPullingTime="3.151570833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:01:33.040340525 +0000 UTC m=+1103.599731924" watchObservedRunningTime="2026-09-11 17:01:33.043387714 +0000 UTC m=+1103.602779136"
Sep 11 17:01:39.028587 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:39.028562    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:01:41.006020 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:41.005989    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:01:56.342969 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.342936    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"]
Sep 11 17:01:56.352534 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.352504    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.354840 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.354784    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-bff65f-serving-cert\""
Sep 11 17:01:56.356211 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.356182    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"]
Sep 11 17:01:56.474091 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.474057    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llvdc\" (UniqueName: \"kubernetes.io/projected/15ff337a-00d6-449b-aa62-035360fb9ac0-kube-api-access-llvdc\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.474274 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.474151    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.474274 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.474181    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ff337a-00d6-449b-aa62-035360fb9ac0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.474274 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.474201    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.575074 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.575040    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llvdc\" (UniqueName: \"kubernetes.io/projected/15ff337a-00d6-449b-aa62-035360fb9ac0-kube-api-access-llvdc\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.575259 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.575112    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.575330 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.575270    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ff337a-00d6-449b-aa62-035360fb9ac0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.575330 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.575311    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.575960 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.575942    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ff337a-00d6-449b-aa62-035360fb9ac0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.577770 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.577747    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.577889 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.577817    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.584090 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.584068    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llvdc\" (UniqueName: \"kubernetes.io/projected/15ff337a-00d6-449b-aa62-035360fb9ac0-kube-api-access-llvdc\") pod \"maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.665663 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.665595    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:56.941324 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:56.941303    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"]
Sep 11 17:01:56.943573 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:01:56.943541    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ff337a_00d6_449b_aa62_035360fb9ac0.slice/crio-d421240626c6708ec250612b5552cccb39f394df6b6d6fbd7f1e7deb9d8b49e4 WatchSource:0}: Error finding container d421240626c6708ec250612b5552cccb39f394df6b6d6fbd7f1e7deb9d8b49e4: Status 404 returned error can't find the container with id d421240626c6708ec250612b5552cccb39f394df6b6d6fbd7f1e7deb9d8b49e4
Sep 11 17:01:57.164469 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:57.164427    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t" event={"ID":"15ff337a-00d6-449b-aa62-035360fb9ac0","Type":"ContainerStarted","Data":"d421240626c6708ec250612b5552cccb39f394df6b6d6fbd7f1e7deb9d8b49e4"}
Sep 11 17:01:58.171974 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:58.171941    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t" event={"ID":"15ff337a-00d6-449b-aa62-035360fb9ac0","Type":"ContainerStarted","Data":"94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef"}
Sep 11 17:01:58.172344 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:58.172026    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:01:58.190509 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:01:58.190463    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t" podStartSLOduration=1.83051903 podStartE2EDuration="2.190448152s" totalImagesPullingTime="359.929122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:01:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:01:58.188567538 +0000 UTC m=+1128.747958925" watchObservedRunningTime="2026-09-11 17:01:58.190448152 +0000 UTC m=+1128.749839539"
Sep 11 17:02:04.186772 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:04.186745    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:02:20.125449 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:20.125407    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7948-a4f8ac"]
Sep 11 17:02:20.129285 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:20.129263    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-a4f8ac"
Sep 11 17:02:20.132033 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:20.132011    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t2nxk\""
Sep 11 17:02:20.135062 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:20.135039    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7948-a4f8ac"]
Sep 11 17:02:20.207710 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:20.207678    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl6vt\" (UniqueName: \"kubernetes.io/projected/3ed61a63-220d-4af0-998d-86818e306c4c-kube-api-access-nl6vt\") pod \"test-curl-7948-a4f8ac\" (UID: \"3ed61a63-220d-4af0-998d-86818e306c4c\") " pod="opendatahub/test-curl-7948-a4f8ac"
Sep 11 17:02:20.309149 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:20.309117    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl6vt\" (UniqueName: \"kubernetes.io/projected/3ed61a63-220d-4af0-998d-86818e306c4c-kube-api-access-nl6vt\") pod \"test-curl-7948-a4f8ac\" (UID: \"3ed61a63-220d-4af0-998d-86818e306c4c\") " pod="opendatahub/test-curl-7948-a4f8ac"
Sep 11 17:02:20.323030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:20.322994    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl6vt\" (UniqueName: \"kubernetes.io/projected/3ed61a63-220d-4af0-998d-86818e306c4c-kube-api-access-nl6vt\") pod \"test-curl-7948-a4f8ac\" (UID: \"3ed61a63-220d-4af0-998d-86818e306c4c\") " pod="opendatahub/test-curl-7948-a4f8ac"
Sep 11 17:02:20.439390 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:20.439305    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-a4f8ac"
Sep 11 17:02:20.721426 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:20.721393    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7948-a4f8ac"]
Sep 11 17:02:20.723174 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:02:20.723148    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ed61a63_220d_4af0_998d_86818e306c4c.slice/crio-617e41c17e2921854f16143eb2c4440707d6c1baca254fcab16f1e25e785e738 WatchSource:0}: Error finding container 617e41c17e2921854f16143eb2c4440707d6c1baca254fcab16f1e25e785e738: Status 404 returned error can't find the container with id 617e41c17e2921854f16143eb2c4440707d6c1baca254fcab16f1e25e785e738
Sep 11 17:02:21.312767 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:21.312738    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7948-a4f8ac" event={"ID":"3ed61a63-220d-4af0-998d-86818e306c4c","Type":"ContainerStarted","Data":"bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36"}
Sep 11 17:02:21.313160 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:21.312779    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7948-a4f8ac" event={"ID":"3ed61a63-220d-4af0-998d-86818e306c4c","Type":"ContainerStarted","Data":"617e41c17e2921854f16143eb2c4440707d6c1baca254fcab16f1e25e785e738"}
Sep 11 17:02:21.328272 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:21.328219    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7948-a4f8ac" podStartSLOduration=1.328204339 podStartE2EDuration="1.328204339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:02:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:02:21.326998948 +0000 UTC m=+1151.886390336" watchObservedRunningTime="2026-09-11 17:02:21.328204339 +0000 UTC m=+1151.887595727"
Sep 11 17:02:21.929845 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:21.929816    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7948-a4f8ac"]
Sep 11 17:02:21.930792 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:21.930767    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7948-a4f8ac"]
Sep 11 17:02:22.046333 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.046261    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7948-e430ad"]
Sep 11 17:02:22.046685 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.046673    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ed61a63-220d-4af0-998d-86818e306c4c" containerName="test-curl-7948-a4f8ac"
Sep 11 17:02:22.046739 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.046686    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ed61a63-220d-4af0-998d-86818e306c4c" containerName="test-curl-7948-a4f8ac"
Sep 11 17:02:22.046779 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.046753    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ed61a63-220d-4af0-998d-86818e306c4c" containerName="test-curl-7948-a4f8ac"
Sep 11 17:02:22.049886 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.049868    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:22.062006 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.061981    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7948-e430ad"]
Sep 11 17:02:22.127715 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.127683    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzgcz\" (UniqueName: \"kubernetes.io/projected/b12cae90-3a35-4da8-8a43-322823aca96f-kube-api-access-lzgcz\") pod \"test-curl-7948-e430ad\" (UID: \"b12cae90-3a35-4da8-8a43-322823aca96f\") " pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:22.229243 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.229214    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzgcz\" (UniqueName: \"kubernetes.io/projected/b12cae90-3a35-4da8-8a43-322823aca96f-kube-api-access-lzgcz\") pod \"test-curl-7948-e430ad\" (UID: \"b12cae90-3a35-4da8-8a43-322823aca96f\") " pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:22.239979 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.239954    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzgcz\" (UniqueName: \"kubernetes.io/projected/b12cae90-3a35-4da8-8a43-322823aca96f-kube-api-access-lzgcz\") pod \"test-curl-7948-e430ad\" (UID: \"b12cae90-3a35-4da8-8a43-322823aca96f\") " pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:22.319755 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:22.319682    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7948-a4f8ac" container="test-curl-7948-a4f8ac"
Sep 11 17:02:22.367232 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.367205    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:22.641099 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:22.641077    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7948-e430ad"]
Sep 11 17:02:22.643090 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:02:22.643061    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb12cae90_3a35_4da8_8a43_322823aca96f.slice/crio-1b9a1d1c97ef38e5cc7efef0354317de65fff03773bddf2e98d74038606dae81 WatchSource:0}: Error finding container 1b9a1d1c97ef38e5cc7efef0354317de65fff03773bddf2e98d74038606dae81: Status 404 returned error can't find the container with id 1b9a1d1c97ef38e5cc7efef0354317de65fff03773bddf2e98d74038606dae81
Sep 11 17:02:23.326955 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:23.326914    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7948-e430ad" event={"ID":"b12cae90-3a35-4da8-8a43-322823aca96f","Type":"ContainerStarted","Data":"c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921"}
Sep 11 17:02:23.327380 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:23.326967    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7948-e430ad" event={"ID":"b12cae90-3a35-4da8-8a43-322823aca96f","Type":"ContainerStarted","Data":"1b9a1d1c97ef38e5cc7efef0354317de65fff03773bddf2e98d74038606dae81"}
Sep 11 17:02:23.327380 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:23.327163    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7948-a4f8ac" podUID="3ed61a63-220d-4af0-998d-86818e306c4c" containerName="test-curl-7948-a4f8ac" containerID="cri-o://bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36" gracePeriod=2
Sep 11 17:02:23.341665 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:23.341408    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7948-e430ad" podStartSLOduration=1.341391237 podStartE2EDuration="1.341391237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:02:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:02:23.341317431 +0000 UTC m=+1153.900708818" watchObservedRunningTime="2026-09-11 17:02:23.341391237 +0000 UTC m=+1153.900782625"
Sep 11 17:02:23.343226 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:23.343197    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7948-a4f8ac\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="3ed61a63-220d-4af0-998d-86818e306c4c" pod="opendatahub/test-curl-7948-a4f8ac"
Sep 11 17:02:23.966471 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:23.966439    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7948-e430ad"]
Sep 11 17:02:23.970365 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:23.970339    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7948-e430ad"]
Sep 11 17:02:24.080622 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.080545    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7948-a1646d"]
Sep 11 17:02:24.081005 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.080992    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b12cae90-3a35-4da8-8a43-322823aca96f" containerName="test-curl-7948-e430ad"
Sep 11 17:02:24.081058 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.081007    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="b12cae90-3a35-4da8-8a43-322823aca96f" containerName="test-curl-7948-e430ad"
Sep 11 17:02:24.081094 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.081089    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="b12cae90-3a35-4da8-8a43-322823aca96f" containerName="test-curl-7948-e430ad"
Sep 11 17:02:24.084322 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.084305    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-a1646d"
Sep 11 17:02:24.088777 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.088750    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7948-a1646d"]
Sep 11 17:02:24.147614 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.147577    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4627n\" (UniqueName: \"kubernetes.io/projected/acff73f0-c9f5-46a4-8031-d9119dfbea48-kube-api-access-4627n\") pod \"test-curl-7948-a1646d\" (UID: \"acff73f0-c9f5-46a4-8031-d9119dfbea48\") " pod="opendatahub/test-curl-7948-a1646d"
Sep 11 17:02:24.249235 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.249191    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4627n\" (UniqueName: \"kubernetes.io/projected/acff73f0-c9f5-46a4-8031-d9119dfbea48-kube-api-access-4627n\") pod \"test-curl-7948-a1646d\" (UID: \"acff73f0-c9f5-46a4-8031-d9119dfbea48\") " pod="opendatahub/test-curl-7948-a1646d"
Sep 11 17:02:24.256924 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.256899    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4627n\" (UniqueName: \"kubernetes.io/projected/acff73f0-c9f5-46a4-8031-d9119dfbea48-kube-api-access-4627n\") pod \"test-curl-7948-a1646d\" (UID: \"acff73f0-c9f5-46a4-8031-d9119dfbea48\") " pod="opendatahub/test-curl-7948-a1646d"
Sep 11 17:02:24.332734 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:24.332666    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7948-e430ad" container="test-curl-7948-e430ad"
Sep 11 17:02:24.394872 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.394845    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-a1646d"
Sep 11 17:02:24.666260 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:24.666233    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7948-a1646d"]
Sep 11 17:02:24.668243 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:02:24.668216    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacff73f0_c9f5_46a4_8031_d9119dfbea48.slice/crio-ba112a6f263f0b3ec715a2bd30f06ef0c4dbea30e0fc0588afc3fcb9ff47c2e4 WatchSource:0}: Error finding container ba112a6f263f0b3ec715a2bd30f06ef0c4dbea30e0fc0588afc3fcb9ff47c2e4: Status 404 returned error can't find the container with id ba112a6f263f0b3ec715a2bd30f06ef0c4dbea30e0fc0588afc3fcb9ff47c2e4
Sep 11 17:02:25.341277 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.341237    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7948-a1646d" event={"ID":"acff73f0-c9f5-46a4-8031-d9119dfbea48","Type":"ContainerStarted","Data":"df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0"}
Sep 11 17:02:25.341604 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.341289    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7948-a1646d" event={"ID":"acff73f0-c9f5-46a4-8031-d9119dfbea48","Type":"ContainerStarted","Data":"ba112a6f263f0b3ec715a2bd30f06ef0c4dbea30e0fc0588afc3fcb9ff47c2e4"}
Sep 11 17:02:25.341604 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.341352    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7948-e430ad" podUID="b12cae90-3a35-4da8-8a43-322823aca96f" containerName="test-curl-7948-e430ad" containerID="cri-o://c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921" gracePeriod=2
Sep 11 17:02:25.343157 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:25.343131    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7948-e430ad\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="b12cae90-3a35-4da8-8a43-322823aca96f" pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:25.356951 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.356912    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7948-a1646d" podStartSLOduration=1.356895521 podStartE2EDuration="1.356895521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:02:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:02:25.356252693 +0000 UTC m=+1155.915644082" watchObservedRunningTime="2026-09-11 17:02:25.356895521 +0000 UTC m=+1155.916286909"
Sep 11 17:02:25.357970 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:25.357944    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7948-e430ad\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="b12cae90-3a35-4da8-8a43-322823aca96f" pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:25.515103 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.515078    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-a4f8ac"
Sep 11 17:02:25.516971 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:25.516944    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7948-e430ad\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="b12cae90-3a35-4da8-8a43-322823aca96f" pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:25.664111 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.664038    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nl6vt\" (UniqueName: \"kubernetes.io/projected/3ed61a63-220d-4af0-998d-86818e306c4c-kube-api-access-nl6vt\") pod \"3ed61a63-220d-4af0-998d-86818e306c4c\" (UID: \"3ed61a63-220d-4af0-998d-86818e306c4c\") "
Sep 11 17:02:25.666125 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.666096    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ed61a63-220d-4af0-998d-86818e306c4c-kube-api-access-nl6vt" (OuterVolumeSpecName: "kube-api-access-nl6vt") pod "3ed61a63-220d-4af0-998d-86818e306c4c" (UID: "3ed61a63-220d-4af0-998d-86818e306c4c"). InnerVolumeSpecName "kube-api-access-nl6vt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:02:25.765231 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.765208    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nl6vt\" (UniqueName: \"kubernetes.io/projected/3ed61a63-220d-4af0-998d-86818e306c4c-kube-api-access-nl6vt\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:02:25.928423 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.928350    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ed61a63-220d-4af0-998d-86818e306c4c" path="/var/lib/kubelet/pods/3ed61a63-220d-4af0-998d-86818e306c4c/volumes"
Sep 11 17:02:25.949700 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.949667    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7948-a1646d"]
Sep 11 17:02:25.956722 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:25.956699    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7948-a1646d"]
Sep 11 17:02:26.068206 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.068178    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7948-74ba01"]
Sep 11 17:02:26.068614 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.068602    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="acff73f0-c9f5-46a4-8031-d9119dfbea48" containerName="test-curl-7948-a1646d"
Sep 11 17:02:26.068660 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.068616    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="acff73f0-c9f5-46a4-8031-d9119dfbea48" containerName="test-curl-7948-a1646d"
Sep 11 17:02:26.068697 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.068693    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="acff73f0-c9f5-46a4-8031-d9119dfbea48" containerName="test-curl-7948-a1646d"
Sep 11 17:02:26.071922 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.071907    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:26.078191 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.078171    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7948-74ba01"]
Sep 11 17:02:26.168707 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.168682    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgqv4\" (UniqueName: \"kubernetes.io/projected/4166f83f-a08d-424d-b552-07578f6496b4-kube-api-access-pgqv4\") pod \"test-curl-7948-74ba01\" (UID: \"4166f83f-a08d-424d-b552-07578f6496b4\") " pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:26.270126 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.270098    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgqv4\" (UniqueName: \"kubernetes.io/projected/4166f83f-a08d-424d-b552-07578f6496b4-kube-api-access-pgqv4\") pod \"test-curl-7948-74ba01\" (UID: \"4166f83f-a08d-424d-b552-07578f6496b4\") " pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:26.278296 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.278268    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgqv4\" (UniqueName: \"kubernetes.io/projected/4166f83f-a08d-424d-b552-07578f6496b4-kube-api-access-pgqv4\") pod \"test-curl-7948-74ba01\" (UID: \"4166f83f-a08d-424d-b552-07578f6496b4\") " pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:26.348302 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.348272    2569 generic.go:356] "Generic (PLEG): container finished" podID="3ed61a63-220d-4af0-998d-86818e306c4c" containerID="bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36" exitCode=137
Sep 11 17:02:26.348687 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.348321    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-a4f8ac"
Sep 11 17:02:26.348687 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.348375    2569 scope.go:117] "RemoveContainer" containerID="bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36"
Sep 11 17:02:26.348687 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:26.348589    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7948-a1646d" container="test-curl-7948-a1646d"
Sep 11 17:02:26.357280 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.357265    2569 scope.go:117] "RemoveContainer" containerID="bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36"
Sep 11 17:02:26.357568 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:26.357550    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36\": container with ID starting with bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36 not found: ID does not exist" containerID="bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36"
Sep 11 17:02:26.357613 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.357576    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36"} err="failed to get container status \"bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36\": rpc error: code = NotFound desc = could not find container \"bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36\": container with ID starting with bdf9f21d36f7452bfc2b349c53b6345eca74cf5e257c7147da68f31d9951fc36 not found: ID does not exist"
Sep 11 17:02:26.383328 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.383304    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:26.656368 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:26.656341    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7948-74ba01"]
Sep 11 17:02:26.657408 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:02:26.657384    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4166f83f_a08d_424d_b552_07578f6496b4.slice/crio-d36c2813d979a96854cd967532ea346bf0e755b599960def605968c9d52a69d1 WatchSource:0}: Error finding container d36c2813d979a96854cd967532ea346bf0e755b599960def605968c9d52a69d1: Status 404 returned error can't find the container with id d36c2813d979a96854cd967532ea346bf0e755b599960def605968c9d52a69d1
Sep 11 17:02:27.356646 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:27.356617    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7948-74ba01" event={"ID":"4166f83f-a08d-424d-b552-07578f6496b4","Type":"ContainerStarted","Data":"108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233"}
Sep 11 17:02:27.357158 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:27.356662    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7948-74ba01" event={"ID":"4166f83f-a08d-424d-b552-07578f6496b4","Type":"ContainerStarted","Data":"d36c2813d979a96854cd967532ea346bf0e755b599960def605968c9d52a69d1"}
Sep 11 17:02:27.357844 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:27.357774    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7948-a1646d" podUID="acff73f0-c9f5-46a4-8031-d9119dfbea48" containerName="test-curl-7948-a1646d" containerID="cri-o://df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0" gracePeriod=2
Sep 11 17:02:27.371968 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:27.371916    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7948-74ba01" podStartSLOduration=1.371899859 podStartE2EDuration="1.371899859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:02:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:02:27.37034117 +0000 UTC m=+1157.929732575" watchObservedRunningTime="2026-09-11 17:02:27.371899859 +0000 UTC m=+1157.931291245"
Sep 11 17:02:27.372075 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:27.371990    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7948-a1646d\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="acff73f0-c9f5-46a4-8031-d9119dfbea48" pod="opendatahub/test-curl-7948-a1646d"
Sep 11 17:02:27.512672 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:27.512651    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:27.514683 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:27.514657    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7948-a1646d\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="acff73f0-c9f5-46a4-8031-d9119dfbea48" pod="opendatahub/test-curl-7948-a1646d"
Sep 11 17:02:27.584264 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:27.584239    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzgcz\" (UniqueName: \"kubernetes.io/projected/b12cae90-3a35-4da8-8a43-322823aca96f-kube-api-access-lzgcz\") pod \"b12cae90-3a35-4da8-8a43-322823aca96f\" (UID: \"b12cae90-3a35-4da8-8a43-322823aca96f\") "
Sep 11 17:02:27.586277 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:27.586244    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b12cae90-3a35-4da8-8a43-322823aca96f-kube-api-access-lzgcz" (OuterVolumeSpecName: "kube-api-access-lzgcz") pod "b12cae90-3a35-4da8-8a43-322823aca96f" (UID: "b12cae90-3a35-4da8-8a43-322823aca96f"). InnerVolumeSpecName "kube-api-access-lzgcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:02:27.685960 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:27.685882    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzgcz\" (UniqueName: \"kubernetes.io/projected/b12cae90-3a35-4da8-8a43-322823aca96f-kube-api-access-lzgcz\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:02:27.933862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:27.933829    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b12cae90-3a35-4da8-8a43-322823aca96f" path="/var/lib/kubelet/pods/b12cae90-3a35-4da8-8a43-322823aca96f/volumes"
Sep 11 17:02:28.006197 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:28.006166    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7948-74ba01"]
Sep 11 17:02:28.010223 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:28.010201    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7948-74ba01"]
Sep 11 17:02:28.364661 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:28.364586    2569 generic.go:356] "Generic (PLEG): container finished" podID="b12cae90-3a35-4da8-8a43-322823aca96f" containerID="c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921" exitCode=137
Sep 11 17:02:28.364661 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:28.364640    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-e430ad"
Sep 11 17:02:28.365131 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:28.364681    2569 scope.go:117] "RemoveContainer" containerID="c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921"
Sep 11 17:02:28.365131 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:28.364946    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7948-74ba01" container="test-curl-7948-74ba01"
Sep 11 17:02:28.373637 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:28.373621    2569 scope.go:117] "RemoveContainer" containerID="c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921"
Sep 11 17:02:28.373947 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:28.373928    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921\": container with ID starting with c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921 not found: ID does not exist" containerID="c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921"
Sep 11 17:02:28.374020 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:28.373955    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921"} err="failed to get container status \"c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921\": rpc error: code = NotFound desc = could not find container \"c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921\": container with ID starting with c610cb2b81eadaf9b350799abbc7431e67b51d02e136faaa8afce088aa19b921 not found: ID does not exist"
Sep 11 17:02:29.374453 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:29.374425    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7948-74ba01" podUID="4166f83f-a08d-424d-b552-07578f6496b4" containerName="test-curl-7948-74ba01" containerID="cri-o://108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233" gracePeriod=2
Sep 11 17:02:29.376690 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:29.376661    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7948-74ba01\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="4166f83f-a08d-424d-b552-07578f6496b4" pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:29.507441 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:29.507413    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-a1646d"
Sep 11 17:02:29.509441 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:29.509416    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7948-74ba01\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="4166f83f-a08d-424d-b552-07578f6496b4" pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:29.604535 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:29.604511    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4627n\" (UniqueName: \"kubernetes.io/projected/acff73f0-c9f5-46a4-8031-d9119dfbea48-kube-api-access-4627n\") pod \"acff73f0-c9f5-46a4-8031-d9119dfbea48\" (UID: \"acff73f0-c9f5-46a4-8031-d9119dfbea48\") "
Sep 11 17:02:29.606725 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:29.606702    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/acff73f0-c9f5-46a4-8031-d9119dfbea48-kube-api-access-4627n" (OuterVolumeSpecName: "kube-api-access-4627n") pod "acff73f0-c9f5-46a4-8031-d9119dfbea48" (UID: "acff73f0-c9f5-46a4-8031-d9119dfbea48"). InnerVolumeSpecName "kube-api-access-4627n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:02:29.705459 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:29.705429    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4627n\" (UniqueName: \"kubernetes.io/projected/acff73f0-c9f5-46a4-8031-d9119dfbea48-kube-api-access-4627n\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:02:29.926054 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:29.925965    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7948-74ba01\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="4166f83f-a08d-424d-b552-07578f6496b4" pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:29.927594 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:29.927573    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="acff73f0-c9f5-46a4-8031-d9119dfbea48" path="/var/lib/kubelet/pods/acff73f0-c9f5-46a4-8031-d9119dfbea48/volumes"
Sep 11 17:02:30.380987 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:30.380957    2569 generic.go:356] "Generic (PLEG): container finished" podID="acff73f0-c9f5-46a4-8031-d9119dfbea48" containerID="df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0" exitCode=137
Sep 11 17:02:30.381405 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:30.381001    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-a1646d"
Sep 11 17:02:30.381405 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:30.381062    2569 scope.go:117] "RemoveContainer" containerID="df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0"
Sep 11 17:02:30.390396 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:30.390380    2569 scope.go:117] "RemoveContainer" containerID="df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0"
Sep 11 17:02:30.390666 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:30.390647    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0\": container with ID starting with df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0 not found: ID does not exist" containerID="df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0"
Sep 11 17:02:30.390723 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:30.390679    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0"} err="failed to get container status \"df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0\": rpc error: code = NotFound desc = could not find container \"df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0\": container with ID starting with df9cf2fa6d0d2e960100ee10899bb3b569842251ad65ac4bfe851970c38313b0 not found: ID does not exist"
Sep 11 17:02:31.558676 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:31.558646    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:31.724430 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:31.724405    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgqv4\" (UniqueName: \"kubernetes.io/projected/4166f83f-a08d-424d-b552-07578f6496b4-kube-api-access-pgqv4\") pod \"4166f83f-a08d-424d-b552-07578f6496b4\" (UID: \"4166f83f-a08d-424d-b552-07578f6496b4\") "
Sep 11 17:02:31.726607 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:31.726581    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4166f83f-a08d-424d-b552-07578f6496b4-kube-api-access-pgqv4" (OuterVolumeSpecName: "kube-api-access-pgqv4") pod "4166f83f-a08d-424d-b552-07578f6496b4" (UID: "4166f83f-a08d-424d-b552-07578f6496b4"). InnerVolumeSpecName "kube-api-access-pgqv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:02:31.826201 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:31.826171    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgqv4\" (UniqueName: \"kubernetes.io/projected/4166f83f-a08d-424d-b552-07578f6496b4-kube-api-access-pgqv4\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:02:31.927919 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:31.927887    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4166f83f-a08d-424d-b552-07578f6496b4" path="/var/lib/kubelet/pods/4166f83f-a08d-424d-b552-07578f6496b4/volumes"
Sep 11 17:02:32.395258 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:32.395224    2569 generic.go:356] "Generic (PLEG): container finished" podID="4166f83f-a08d-424d-b552-07578f6496b4" containerID="108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233" exitCode=137
Sep 11 17:02:32.395258 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:32.395262    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7948-74ba01"
Sep 11 17:02:32.395516 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:32.395286    2569 scope.go:117] "RemoveContainer" containerID="108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233"
Sep 11 17:02:32.404427 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:32.404402    2569 scope.go:117] "RemoveContainer" containerID="108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233"
Sep 11 17:02:32.404720 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:32.404697    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233\": container with ID starting with 108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233 not found: ID does not exist" containerID="108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233"
Sep 11 17:02:32.404853 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:32.404725    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233"} err="failed to get container status \"108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233\": rpc error: code = NotFound desc = could not find container \"108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233\": container with ID starting with 108427d557cef555aded3a3a58ef506f67de661611f423076dffd34a784f3233 not found: ID does not exist"
Sep 11 17:02:37.887744 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.887707    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"]
Sep 11 17:02:37.888207 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.888194    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4166f83f-a08d-424d-b552-07578f6496b4" containerName="test-curl-7948-74ba01"
Sep 11 17:02:37.888207 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.888207    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4166f83f-a08d-424d-b552-07578f6496b4" containerName="test-curl-7948-74ba01"
Sep 11 17:02:37.888295 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.888285    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4166f83f-a08d-424d-b552-07578f6496b4" containerName="test-curl-7948-74ba01"
Sep 11 17:02:37.891231 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.891211    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:37.893240 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.893219    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-6d422395-serving-cert\""
Sep 11 17:02:37.901507 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.901484    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"]
Sep 11 17:02:37.984888 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.984853    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7bsc\" (UniqueName: \"kubernetes.io/projected/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-kube-api-access-w7bsc\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:37.985061 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.984901    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-openshift-service-ca\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:37.985061 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.985010    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-maas-api-tls\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:37.985061 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:37.985052    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-metrics-certs\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.086313 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.086282    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-openshift-service-ca\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.086492 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.086352    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-maas-api-tls\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.086492 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.086379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-metrics-certs\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.086492 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.086436    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7bsc\" (UniqueName: \"kubernetes.io/projected/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-kube-api-access-w7bsc\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.087073 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.087042    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-openshift-service-ca\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.089074 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.089050    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-metrics-certs\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.089150 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.089077    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-maas-api-tls\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.093846 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.093820    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7bsc\" (UniqueName: \"kubernetes.io/projected/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-kube-api-access-w7bsc\") pod \"maas-api-e2e-mt-6d422395-cddc955b9-n5wbz\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.205510 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.205473    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:38.488264 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.488227    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"]
Sep 11 17:02:38.489647 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:02:38.489616    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f5bbdc_0439_41f0_9080_fbfa6a159e0e.slice/crio-d7e0cf09d4535850bc8405877060506edfa1af45e48f186e21051d8e427d540d WatchSource:0}: Error finding container d7e0cf09d4535850bc8405877060506edfa1af45e48f186e21051d8e427d540d: Status 404 returned error can't find the container with id d7e0cf09d4535850bc8405877060506edfa1af45e48f186e21051d8e427d540d
Sep 11 17:02:38.564069 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.564041    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"]
Sep 11 17:02:38.568875 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.568857    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:38.572011 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.571987    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-6d422395\""
Sep 11 17:02:38.572115 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.571989    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-6d422395-dockercfg-94vtl\""
Sep 11 17:02:38.579163 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.579142    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"]
Sep 11 17:02:38.692381 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.692343    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13b671d-3c86-4c15-9ec5-67c0a07da172-plugins-config-volume\") pod \"payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r\" (UID: \"e13b671d-3c86-4c15-9ec5-67c0a07da172\") " pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:38.692577 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.692486    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6kmr\" (UniqueName: \"kubernetes.io/projected/e13b671d-3c86-4c15-9ec5-67c0a07da172-kube-api-access-f6kmr\") pod \"payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r\" (UID: \"e13b671d-3c86-4c15-9ec5-67c0a07da172\") " pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:38.794108 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.794027    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6kmr\" (UniqueName: \"kubernetes.io/projected/e13b671d-3c86-4c15-9ec5-67c0a07da172-kube-api-access-f6kmr\") pod \"payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r\" (UID: \"e13b671d-3c86-4c15-9ec5-67c0a07da172\") " pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:38.794251 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.794134    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13b671d-3c86-4c15-9ec5-67c0a07da172-plugins-config-volume\") pod \"payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r\" (UID: \"e13b671d-3c86-4c15-9ec5-67c0a07da172\") " pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:38.795079 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.795054    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13b671d-3c86-4c15-9ec5-67c0a07da172-plugins-config-volume\") pod \"payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r\" (UID: \"e13b671d-3c86-4c15-9ec5-67c0a07da172\") " pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:38.803067 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.803041    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6kmr\" (UniqueName: \"kubernetes.io/projected/e13b671d-3c86-4c15-9ec5-67c0a07da172-kube-api-access-f6kmr\") pod \"payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r\" (UID: \"e13b671d-3c86-4c15-9ec5-67c0a07da172\") " pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:38.881009 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:38.880983    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:39.160680 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:39.160649    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"]
Sep 11 17:02:39.162367 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:02:39.162339    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13b671d_3c86_4c15_9ec5_67c0a07da172.slice/crio-c8ed8cd295f5be0c78c7cac770466c089f5f62649172e48713ef9987f106d7ae WatchSource:0}: Error finding container c8ed8cd295f5be0c78c7cac770466c089f5f62649172e48713ef9987f106d7ae: Status 404 returned error can't find the container with id c8ed8cd295f5be0c78c7cac770466c089f5f62649172e48713ef9987f106d7ae
Sep 11 17:02:39.442325 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:39.442285    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz" event={"ID":"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e","Type":"ContainerStarted","Data":"432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2"}
Sep 11 17:02:39.442487 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:39.442346    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:39.442487 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:39.442368    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz" event={"ID":"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e","Type":"ContainerStarted","Data":"d7e0cf09d4535850bc8405877060506edfa1af45e48f186e21051d8e427d540d"}
Sep 11 17:02:39.443887 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:39.443865    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r" event={"ID":"e13b671d-3c86-4c15-9ec5-67c0a07da172","Type":"ContainerStarted","Data":"bbd13465353276fb3fc0dcdb033038eef1018efc42797f2ae6a6ed750da8544d"}
Sep 11 17:02:39.443970 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:39.443910    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r" event={"ID":"e13b671d-3c86-4c15-9ec5-67c0a07da172","Type":"ContainerStarted","Data":"c8ed8cd295f5be0c78c7cac770466c089f5f62649172e48713ef9987f106d7ae"}
Sep 11 17:02:39.444023 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:39.444003    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:39.461160 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:39.461112    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz" podStartSLOduration=2.109787067 podStartE2EDuration="2.461098829s" totalImagesPullingTime="351.311762ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:02:39.458540129 +0000 UTC m=+1170.017931528" watchObservedRunningTime="2026-09-11 17:02:39.461098829 +0000 UTC m=+1170.020490216"
Sep 11 17:02:39.476272 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:39.476230    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r" podStartSLOduration=1.476218474 podStartE2EDuration="1.476218474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:02:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:02:39.473204684 +0000 UTC m=+1170.032596085" watchObservedRunningTime="2026-09-11 17:02:39.476218474 +0000 UTC m=+1170.035609861"
Sep 11 17:02:45.455083 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:45.455052    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:02:50.452552 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:50.452522    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:02:56.002193 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.002164    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"]
Sep 11 17:02:56.002755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.002380    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6" podUID="2fb47338-46db-491b-ad0c-fd9847768b90" containerName="maas-api" containerID="cri-o://5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54" gracePeriod=30
Sep 11 17:02:56.251125 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.251097    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 17:02:56.373942 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.373852    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb47338-46db-491b-ad0c-fd9847768b90-openshift-service-ca\") pod \"2fb47338-46db-491b-ad0c-fd9847768b90\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") "
Sep 11 17:02:56.373942 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.373920    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-st4vk\" (UniqueName: \"kubernetes.io/projected/2fb47338-46db-491b-ad0c-fd9847768b90-kube-api-access-st4vk\") pod \"2fb47338-46db-491b-ad0c-fd9847768b90\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") "
Sep 11 17:02:56.374172 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.373993    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-metrics-certs\") pod \"2fb47338-46db-491b-ad0c-fd9847768b90\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") "
Sep 11 17:02:56.374172 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.374052    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-maas-api-tls\") pod \"2fb47338-46db-491b-ad0c-fd9847768b90\" (UID: \"2fb47338-46db-491b-ad0c-fd9847768b90\") "
Sep 11 17:02:56.374321 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.374285    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fb47338-46db-491b-ad0c-fd9847768b90-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2fb47338-46db-491b-ad0c-fd9847768b90" (UID: "2fb47338-46db-491b-ad0c-fd9847768b90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:02:56.374471 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.374449    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fb47338-46db-491b-ad0c-fd9847768b90-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:02:56.376185 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.376153    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2fb47338-46db-491b-ad0c-fd9847768b90" (UID: "2fb47338-46db-491b-ad0c-fd9847768b90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:02:56.376339 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.376317    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fb47338-46db-491b-ad0c-fd9847768b90-kube-api-access-st4vk" (OuterVolumeSpecName: "kube-api-access-st4vk") pod "2fb47338-46db-491b-ad0c-fd9847768b90" (UID: "2fb47338-46db-491b-ad0c-fd9847768b90"). InnerVolumeSpecName "kube-api-access-st4vk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:02:56.376339 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.376330    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2fb47338-46db-491b-ad0c-fd9847768b90" (UID: "2fb47338-46db-491b-ad0c-fd9847768b90"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:02:56.475387 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.475353    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-st4vk\" (UniqueName: \"kubernetes.io/projected/2fb47338-46db-491b-ad0c-fd9847768b90-kube-api-access-st4vk\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:02:56.475387 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.475382    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:02:56.475387 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.475391    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2fb47338-46db-491b-ad0c-fd9847768b90-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:02:56.549238 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.549205    2569 generic.go:356] "Generic (PLEG): container finished" podID="2fb47338-46db-491b-ad0c-fd9847768b90" containerID="5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54" exitCode=0
Sep 11 17:02:56.549404 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.549257    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"
Sep 11 17:02:56.549404 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.549277    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6" event={"ID":"2fb47338-46db-491b-ad0c-fd9847768b90","Type":"ContainerDied","Data":"5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54"}
Sep 11 17:02:56.549404 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.549331    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6" event={"ID":"2fb47338-46db-491b-ad0c-fd9847768b90","Type":"ContainerDied","Data":"46a0475127875defeeacda202d16041766ac0fa8aaf14e875fe2ea07b86936ca"}
Sep 11 17:02:56.549404 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.549356    2569 scope.go:117] "RemoveContainer" containerID="5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54"
Sep 11 17:02:56.559862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.559844    2569 scope.go:117] "RemoveContainer" containerID="5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54"
Sep 11 17:02:56.560122 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:02:56.560106    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54\": container with ID starting with 5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54 not found: ID does not exist" containerID="5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54"
Sep 11 17:02:56.560169 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.560136    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54"} err="failed to get container status \"5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54\": rpc error: code = NotFound desc = could not find container \"5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54\": container with ID starting with 5302839d2c8285a665831b783478da23015ec0400786aa787164c7f7355fbc54 not found: ID does not exist"
Sep 11 17:02:56.570929 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.570907    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"]
Sep 11 17:02:56.575280 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:56.575260    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-4268e3-74b6774b54-fctv6"]
Sep 11 17:02:57.927444 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:02:57.927416    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fb47338-46db-491b-ad0c-fd9847768b90" path="/var/lib/kubelet/pods/2fb47338-46db-491b-ad0c-fd9847768b90/volumes"
Sep 11 17:03:07.030951 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:07.030917    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"]
Sep 11 17:03:07.031418 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:07.031132    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s" podUID="9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" containerName="istio-proxy" containerID="cri-o://b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad" gracePeriod=30
Sep 11 17:03:12.290161 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.290135    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:03:12.440345 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440309    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-podinfo\") pod \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") "
Sep 11 17:03:12.440531 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440396    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-token\") pod \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") "
Sep 11 17:03:12.440531 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440429    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-certs\") pod \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") "
Sep 11 17:03:12.440531 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440469    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-credential-socket\") pod \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") "
Sep 11 17:03:12.440531 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440522    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-data\") pod \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") "
Sep 11 17:03:12.440747 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440551    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istiod-ca-cert\") pod \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") "
Sep 11 17:03:12.440747 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440584    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-envoy\") pod \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") "
Sep 11 17:03:12.440747 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440612    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmhjv\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-kube-api-access-nmhjv\") pod \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") "
Sep 11 17:03:12.440747 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440663    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-socket\") pod \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\" (UID: \"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8\") "
Sep 11 17:03:12.440977 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440728    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" (UID: "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:03:12.440977 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440842    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" (UID: "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:03:12.440977 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.440946    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" (UID: "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:03:12.441133 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.441075    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" (UID: "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:03:12.441232 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.441092    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" (UID: "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:03:12.441282 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.441250    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-socket\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:12.441282 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.441272    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-workload-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:12.441346 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.441286    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-credential-socket\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:12.441346 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.441301    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istiod-ca-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:12.442704 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.442679    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" (UID: "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:03:12.442704 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.442698    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" (UID: "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:03:12.442879 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.442825    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-kube-api-access-nmhjv" (OuterVolumeSpecName: "kube-api-access-nmhjv") pod "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" (UID: "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8"). InnerVolumeSpecName "kube-api-access-nmhjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:03:12.443222 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.443205    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" (UID: "9ced4443-e6ed-4a7c-a9cd-a678c15ebef8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:03:12.542847 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.542753    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-data\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:12.542847 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.542776    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-envoy\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:12.542847 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.542785    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmhjv\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-kube-api-access-nmhjv\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:12.542847 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.542817    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-podinfo\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:12.542847 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.542826    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8-istio-token\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:12.648641 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.648606    2569 generic.go:356] "Generic (PLEG): container finished" podID="9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" containerID="b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad" exitCode=0
Sep 11 17:03:12.648832 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.648652    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"
Sep 11 17:03:12.648832 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.648692    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s" event={"ID":"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8","Type":"ContainerDied","Data":"b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad"}
Sep 11 17:03:12.648832 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.648745    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s" event={"ID":"9ced4443-e6ed-4a7c-a9cd-a678c15ebef8","Type":"ContainerDied","Data":"f0814a37825edb3d4199ce5c5fc75db56b80b7cf3df41c6ff43860bbe935f2a6"}
Sep 11 17:03:12.648832 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.648767    2569 scope.go:117] "RemoveContainer" containerID="b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad"
Sep 11 17:03:12.658512 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.658497    2569 scope.go:117] "RemoveContainer" containerID="b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad"
Sep 11 17:03:12.658789 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:03:12.658771    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad\": container with ID starting with b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad not found: ID does not exist" containerID="b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad"
Sep 11 17:03:12.658870 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.658816    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad"} err="failed to get container status \"b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad\": rpc error: code = NotFound desc = could not find container \"b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad\": container with ID starting with b9d294f37a5088d75e760e60ab2111f13a9f96997aecbbd4a83494791441d1ad not found: ID does not exist"
Sep 11 17:03:12.670584 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.670563    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"]
Sep 11 17:03:12.674275 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:12.674251    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-9459f0-openshift-default-5b98456494-xxl9s"]
Sep 11 17:03:13.928091 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:13.928059    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" path="/var/lib/kubelet/pods/9ced4443-e6ed-4a7c-a9cd-a678c15ebef8/volumes"
Sep 11 17:03:50.940809 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:50.940760    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"]
Sep 11 17:03:50.941296 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:50.941024    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn" podUID="3d474bfd-a76f-4ab0-817e-cfdc9275bb69" containerName="maas-api" containerID="cri-o://eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3" gracePeriod=30
Sep 11 17:03:51.190306 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.190278    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 17:03:51.209284 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.209223    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7mm7\" (UniqueName: \"kubernetes.io/projected/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-kube-api-access-c7mm7\") pod \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") "
Sep 11 17:03:51.209407 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.209365    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-metrics-certs\") pod \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") "
Sep 11 17:03:51.209459 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.209424    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-maas-api-tls\") pod \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") "
Sep 11 17:03:51.209501 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.209457    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-openshift-service-ca\") pod \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\" (UID: \"3d474bfd-a76f-4ab0-817e-cfdc9275bb69\") "
Sep 11 17:03:51.209903 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.209856    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3d474bfd-a76f-4ab0-817e-cfdc9275bb69" (UID: "3d474bfd-a76f-4ab0-817e-cfdc9275bb69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:03:51.211656 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.211632    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-kube-api-access-c7mm7" (OuterVolumeSpecName: "kube-api-access-c7mm7") pod "3d474bfd-a76f-4ab0-817e-cfdc9275bb69" (UID: "3d474bfd-a76f-4ab0-817e-cfdc9275bb69"). InnerVolumeSpecName "kube-api-access-c7mm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:03:51.212100 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.212057    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3d474bfd-a76f-4ab0-817e-cfdc9275bb69" (UID: "3d474bfd-a76f-4ab0-817e-cfdc9275bb69"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:03:51.212586 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.212550    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3d474bfd-a76f-4ab0-817e-cfdc9275bb69" (UID: "3d474bfd-a76f-4ab0-817e-cfdc9275bb69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:03:51.311429 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.311380    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:51.311429 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.311421    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:51.311671 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.311437    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:51.311671 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.311452    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7mm7\" (UniqueName: \"kubernetes.io/projected/3d474bfd-a76f-4ab0-817e-cfdc9275bb69-kube-api-access-c7mm7\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:03:51.883276 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.883244    2569 generic.go:356] "Generic (PLEG): container finished" podID="3d474bfd-a76f-4ab0-817e-cfdc9275bb69" containerID="eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3" exitCode=0
Sep 11 17:03:51.883486 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.883290    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"
Sep 11 17:03:51.883486 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.883324    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn" event={"ID":"3d474bfd-a76f-4ab0-817e-cfdc9275bb69","Type":"ContainerDied","Data":"eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3"}
Sep 11 17:03:51.883486 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.883383    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn" event={"ID":"3d474bfd-a76f-4ab0-817e-cfdc9275bb69","Type":"ContainerDied","Data":"1e8473d9c693a6ae1663474167dcc115969144784e6c333dc20768bfe5952b64"}
Sep 11 17:03:51.883486 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.883413    2569 scope.go:117] "RemoveContainer" containerID="eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3"
Sep 11 17:03:51.895549 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.895520    2569 scope.go:117] "RemoveContainer" containerID="eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3"
Sep 11 17:03:51.896006 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:03:51.895980    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3\": container with ID starting with eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3 not found: ID does not exist" containerID="eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3"
Sep 11 17:03:51.896109 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.896015    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3"} err="failed to get container status \"eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3\": rpc error: code = NotFound desc = could not find container \"eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3\": container with ID starting with eb7b3ab7f2b18723ee35345582c4e01fc31d89eb6fd42299b4b511c1829bb7e3 not found: ID does not exist"
Sep 11 17:03:51.906077 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.906056    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"]
Sep 11 17:03:51.910276 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.910255    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-32d680-6f8b849f58-hs4vn"]
Sep 11 17:03:51.927125 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:51.927101    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d474bfd-a76f-4ab0-817e-cfdc9275bb69" path="/var/lib/kubelet/pods/3d474bfd-a76f-4ab0-817e-cfdc9275bb69/volumes"
Sep 11 17:03:59.906595 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.906549    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"]
Sep 11 17:03:59.908755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.907168    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fb47338-46db-491b-ad0c-fd9847768b90" containerName="maas-api"
Sep 11 17:03:59.908755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.907184    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fb47338-46db-491b-ad0c-fd9847768b90" containerName="maas-api"
Sep 11 17:03:59.908755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.907209    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" containerName="istio-proxy"
Sep 11 17:03:59.908755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.907218    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" containerName="istio-proxy"
Sep 11 17:03:59.908755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.907235    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d474bfd-a76f-4ab0-817e-cfdc9275bb69" containerName="maas-api"
Sep 11 17:03:59.908755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.907244    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d474bfd-a76f-4ab0-817e-cfdc9275bb69" containerName="maas-api"
Sep 11 17:03:59.908755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.907344    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fb47338-46db-491b-ad0c-fd9847768b90" containerName="maas-api"
Sep 11 17:03:59.908755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.907356    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ced4443-e6ed-4a7c-a9cd-a678c15ebef8" containerName="istio-proxy"
Sep 11 17:03:59.908755 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.907368    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d474bfd-a76f-4ab0-817e-cfdc9275bb69" containerName="maas-api"
Sep 11 17:03:59.910884 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.910859    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:03:59.913233 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.913215    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 17:03:59.913332 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.913224    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-2fae12-openshift-default-dockercfg-jz9dr\""
Sep 11 17:03:59.938997 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.938964    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"]
Sep 11 17:03:59.996680 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.996641    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-socket\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:03:59.996893 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.996852    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpq5z\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-kube-api-access-qpq5z\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:03:59.996982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.996958    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-podinfo\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:03:59.997126 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.997004    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-token\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:03:59.997126 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.997049    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-credential-socket\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:03:59.997126 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.997089    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-certs\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:03:59.997319 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.997164    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-envoy\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:03:59.997319 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.997195    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73583f3e-8aad-4e94-96ce-12218b6307ce-istiod-ca-cert\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:03:59.997319 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:03:59.997274    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-data\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.098560 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.098525    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-envoy\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.098747 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.098569    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73583f3e-8aad-4e94-96ce-12218b6307ce-istiod-ca-cert\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.098747 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.098587    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-data\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.098747 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.098646    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-socket\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.098747 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.098678    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpq5z\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-kube-api-access-qpq5z\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.098747 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.098738    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-podinfo\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.099097 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.098765    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-token\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.099097 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.098827    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-credential-socket\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.099097 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.098854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-certs\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.099250 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.099096    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-data\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.099250 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.099152    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-credential-socket\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.099418 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.099389    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73583f3e-8aad-4e94-96ce-12218b6307ce-istiod-ca-cert\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.099482 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.099423    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-socket\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.099548 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.099526    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-certs\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.101288 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.101262    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-envoy\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.101461 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.101444    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-podinfo\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.107095 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.107069    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpq5z\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-kube-api-access-qpq5z\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.107189 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.107132    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-token\") pod \"e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") " pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.221675 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.221650    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:00.511112 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.511088    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"]
Sep 11 17:04:00.512544 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:04:00.512517    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73583f3e_8aad_4e94_96ce_12218b6307ce.slice/crio-5b01193052cb2e5cb0a3d28beb96454c9991ce6aff4fa25105ca65a157d3f4c8 WatchSource:0}: Error finding container 5b01193052cb2e5cb0a3d28beb96454c9991ce6aff4fa25105ca65a157d3f4c8: Status 404 returned error can't find the container with id 5b01193052cb2e5cb0a3d28beb96454c9991ce6aff4fa25105ca65a157d3f4c8
Sep 11 17:04:00.514826 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.514769    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:04:00.514890 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.514870    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:04:00.514935 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.514901    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:04:00.948643 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.948601    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" event={"ID":"73583f3e-8aad-4e94-96ce-12218b6307ce","Type":"ContainerStarted","Data":"414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859"}
Sep 11 17:04:00.949155 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.948664    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" event={"ID":"73583f3e-8aad-4e94-96ce-12218b6307ce","Type":"ContainerStarted","Data":"5b01193052cb2e5cb0a3d28beb96454c9991ce6aff4fa25105ca65a157d3f4c8"}
Sep 11 17:04:00.977406 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:00.977347    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" podStartSLOduration=1.977325899 podStartE2EDuration="1.977325899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:03:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:04:00.97632048 +0000 UTC m=+1251.535711866" watchObservedRunningTime="2026-09-11 17:04:00.977325899 +0000 UTC m=+1251.536717287"
Sep 11 17:04:01.222888 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:01.222772    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:01.228015 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:01.227990    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:01.959120 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:01.959088    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:01.963312 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:01.963280    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:07.062874 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.062844    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"]
Sep 11 17:04:07.066608 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.066590    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.068778 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.068752    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-2fae12-serving-cert\""
Sep 11 17:04:07.081501 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.081476    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"]
Sep 11 17:04:07.178414 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.178378    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.178414 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.178415    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wpg7\" (UniqueName: \"kubernetes.io/projected/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-kube-api-access-9wpg7\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.178620 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.178470    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.178620 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.178525    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.279248 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.279214    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.279248 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.279248    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wpg7\" (UniqueName: \"kubernetes.io/projected/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-kube-api-access-9wpg7\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.279472 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.279289    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.279472 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.279318    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.279554 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:04:07.279466    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-serving-cert: secret "maas-api-e2e-shared-a-w3-2fae12-serving-cert" not found
Sep 11 17:04:07.279596 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:04:07.279552    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-maas-api-tls podName:7cd5b599-44c4-492e-b8cf-311a4c1b5a92 nodeName:}" failed. No retries permitted until 2026-09-11 17:04:07.779531337 +0000 UTC m=+1258.338922718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-maas-api-tls") pod "maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52" (UID: "7cd5b599-44c4-492e-b8cf-311a4c1b5a92") : secret "maas-api-e2e-shared-a-w3-2fae12-serving-cert" not found
Sep 11 17:04:07.280015 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.279997    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.281997 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.281978    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.289999 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.289974    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wpg7\" (UniqueName: \"kubernetes.io/projected/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-kube-api-access-9wpg7\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.784151 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.784114    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.786835 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.786787    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:07.979095 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:07.979059    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:08.258686 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:08.258664    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"]
Sep 11 17:04:08.261063 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:04:08.261040    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cd5b599_44c4_492e_b8cf_311a4c1b5a92.slice/crio-8e7f6d4586dd96df11c32b95757e3487e7a477b721de016738367cf81af7e923 WatchSource:0}: Error finding container 8e7f6d4586dd96df11c32b95757e3487e7a477b721de016738367cf81af7e923: Status 404 returned error can't find the container with id 8e7f6d4586dd96df11c32b95757e3487e7a477b721de016738367cf81af7e923
Sep 11 17:04:09.001112 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:09.001077    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52" event={"ID":"7cd5b599-44c4-492e-b8cf-311a4c1b5a92","Type":"ContainerStarted","Data":"f93f1d80207e243a43f58f7452faa6efb40c9102e01a84d63355a2f11f5ee05f"}
Sep 11 17:04:09.001292 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:09.001126    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52" event={"ID":"7cd5b599-44c4-492e-b8cf-311a4c1b5a92","Type":"ContainerStarted","Data":"8e7f6d4586dd96df11c32b95757e3487e7a477b721de016738367cf81af7e923"}
Sep 11 17:04:09.001292 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:09.001240    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:09.026335 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:09.026234    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52" podStartSLOduration=1.468065981 podStartE2EDuration="2.026211534s" totalImagesPullingTime="558.145553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:04:09.02573952 +0000 UTC m=+1259.585130908" watchObservedRunningTime="2026-09-11 17:04:09.026211534 +0000 UTC m=+1259.585602999"
Sep 11 17:04:10.134171 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:10.134142    2569 scope.go:117] "RemoveContainer" containerID="e916e980ae8fb60ff87cb9333c6a5772c2c849cb09935a6a928bef42c0663fca"
Sep 11 17:04:15.021349 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:15.021323    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:04:27.120364 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:27.120280    2569 generic.go:356] "Generic (PLEG): container finished" podID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerID="414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859" exitCode=0
Sep 11 17:04:27.120731 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:27.120360    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" event={"ID":"73583f3e-8aad-4e94-96ce-12218b6307ce","Type":"ContainerDied","Data":"414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859"}
Sep 11 17:04:27.120777 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:27.120731    2569 scope.go:117] "RemoveContainer" containerID="414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859"
Sep 11 17:04:27.123181 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:27.122576    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:04:27.123181 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:27.122747    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:04:27.123181 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:27.122866    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:04:28.129060 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:28.129028    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" event={"ID":"73583f3e-8aad-4e94-96ce-12218b6307ce","Type":"ContainerStarted","Data":"4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4"}
Sep 11 17:04:28.222642 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:28.222605    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:28.223824 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:28.223774    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 17:04:28.223952 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:28.223873    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 17:04:29.222424 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:29.222386    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 17:04:29.222851 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:29.222436    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 17:04:30.222823 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:30.222763    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 17:04:30.223252 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:30.222851    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 17:04:31.222468 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:31.222432    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 17:04:31.222652 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:31.222491    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 17:04:31.959528 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:31.959497    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:32.222564 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:32.222482    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 17:04:32.222716 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:32.222553    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 17:04:33.222534 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:33.222494    2569 patch_prober.go:28] interesting pod/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 11 17:04:33.222965 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:33.222565    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 11 17:04:34.226409 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:34.226381    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:34.227508 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:34.227486    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:04:42.120469 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.120438    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"]
Sep 11 17:04:42.124211 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.124191    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.127056 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.127039    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-327a3a-serving-cert\""
Sep 11 17:04:42.153887 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.153853    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"]
Sep 11 17:04:42.224079 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.224049    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/310d540a-bf28-43a4-934e-a43178f7c2bd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.224262 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.224118    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8c5f\" (UniqueName: \"kubernetes.io/projected/310d540a-bf28-43a4-934e-a43178f7c2bd-kube-api-access-v8c5f\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.224262 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.224157    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.224262 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.224249    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.325204 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.325170    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.325393 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.325250    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/310d540a-bf28-43a4-934e-a43178f7c2bd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.325393 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.325293    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8c5f\" (UniqueName: \"kubernetes.io/projected/310d540a-bf28-43a4-934e-a43178f7c2bd-kube-api-access-v8c5f\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.325393 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.325314    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.326001 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.325977    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/310d540a-bf28-43a4-934e-a43178f7c2bd-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.327781 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.327756    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.327909 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.327817    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.334068 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.334043    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8c5f\" (UniqueName: \"kubernetes.io/projected/310d540a-bf28-43a4-934e-a43178f7c2bd-kube-api-access-v8c5f\") pod \"maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.435384 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.435312    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:42.712408 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:42.712382    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"]
Sep 11 17:04:42.714110 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:04:42.714083    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310d540a_bf28_43a4_934e_a43178f7c2bd.slice/crio-58a39e6fc59bb8e2d1d98593920140c585dabd98e03e6ea596aaf3127772896b WatchSource:0}: Error finding container 58a39e6fc59bb8e2d1d98593920140c585dabd98e03e6ea596aaf3127772896b: Status 404 returned error can't find the container with id 58a39e6fc59bb8e2d1d98593920140c585dabd98e03e6ea596aaf3127772896b
Sep 11 17:04:43.221812 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:43.221762    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx" event={"ID":"310d540a-bf28-43a4-934e-a43178f7c2bd","Type":"ContainerStarted","Data":"58a39e6fc59bb8e2d1d98593920140c585dabd98e03e6ea596aaf3127772896b"}
Sep 11 17:04:45.235127 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:45.235090    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx" event={"ID":"310d540a-bf28-43a4-934e-a43178f7c2bd","Type":"ContainerStarted","Data":"3dde16434a6ed1fc5a95b7b5267b06de2eb677650aa015a223b442532353e8d7"}
Sep 11 17:04:45.235500 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:45.235175    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:04:45.256442 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:45.256397    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx" podStartSLOduration=1.668064775 podStartE2EDuration="3.256383435s" totalImagesPullingTime="1.58831866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:04:45.255508119 +0000 UTC m=+1295.814899507" watchObservedRunningTime="2026-09-11 17:04:45.256383435 +0000 UTC m=+1295.815774822"
Sep 11 17:04:51.247263 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:04:51.247233    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:05:11.052206 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.052173    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"]
Sep 11 17:05:11.052828 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.052429    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz" podUID="f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" containerName="maas-api" containerID="cri-o://432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2" gracePeriod=30
Sep 11 17:05:11.108444 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.108411    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"]
Sep 11 17:05:11.108651 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.108624    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r" podUID="e13b671d-3c86-4c15-9ec5-67c0a07da172" containerName="payload-processing" containerID="cri-o://bbd13465353276fb3fc0dcdb033038eef1018efc42797f2ae6a6ed750da8544d" gracePeriod=30
Sep 11 17:05:11.367534 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.367506    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:05:11.400069 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.400043    2569 generic.go:356] "Generic (PLEG): container finished" podID="e13b671d-3c86-4c15-9ec5-67c0a07da172" containerID="bbd13465353276fb3fc0dcdb033038eef1018efc42797f2ae6a6ed750da8544d" exitCode=0
Sep 11 17:05:11.400208 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.400145    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r" event={"ID":"e13b671d-3c86-4c15-9ec5-67c0a07da172","Type":"ContainerDied","Data":"bbd13465353276fb3fc0dcdb033038eef1018efc42797f2ae6a6ed750da8544d"}
Sep 11 17:05:11.400279 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.400214    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r" event={"ID":"e13b671d-3c86-4c15-9ec5-67c0a07da172","Type":"ContainerDied","Data":"c8ed8cd295f5be0c78c7cac770466c089f5f62649172e48713ef9987f106d7ae"}
Sep 11 17:05:11.400279 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.400234    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c8ed8cd295f5be0c78c7cac770466c089f5f62649172e48713ef9987f106d7ae"
Sep 11 17:05:11.401891 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.401864    2569 generic.go:356] "Generic (PLEG): container finished" podID="f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" containerID="432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2" exitCode=0
Sep 11 17:05:11.402030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.401893    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz" event={"ID":"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e","Type":"ContainerDied","Data":"432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2"}
Sep 11 17:05:11.402030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.401919    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"
Sep 11 17:05:11.402030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.401935    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz" event={"ID":"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e","Type":"ContainerDied","Data":"d7e0cf09d4535850bc8405877060506edfa1af45e48f186e21051d8e427d540d"}
Sep 11 17:05:11.402030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.401962    2569 scope.go:117] "RemoveContainer" containerID="432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2"
Sep 11 17:05:11.406140 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.406103    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:05:11.408063 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.408030    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-metrics-certs\") pod \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") "
Sep 11 17:05:11.408188 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.408083    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-maas-api-tls\") pod \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") "
Sep 11 17:05:11.408188 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.408116    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7bsc\" (UniqueName: \"kubernetes.io/projected/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-kube-api-access-w7bsc\") pod \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") "
Sep 11 17:05:11.408188 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.408175    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-openshift-service-ca\") pod \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\" (UID: \"f6f5bbdc-0439-41f0-9080-fbfa6a159e0e\") "
Sep 11 17:05:11.408944 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.408912    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" (UID: "f6f5bbdc-0439-41f0-9080-fbfa6a159e0e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:05:11.411164 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.411134    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" (UID: "f6f5bbdc-0439-41f0-9080-fbfa6a159e0e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:05:11.412216 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.412191    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" (UID: "f6f5bbdc-0439-41f0-9080-fbfa6a159e0e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:05:11.412216 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.412210    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-kube-api-access-w7bsc" (OuterVolumeSpecName: "kube-api-access-w7bsc") pod "f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" (UID: "f6f5bbdc-0439-41f0-9080-fbfa6a159e0e"). InnerVolumeSpecName "kube-api-access-w7bsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:05:11.414139 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.414121    2569 scope.go:117] "RemoveContainer" containerID="432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2"
Sep 11 17:05:11.414422 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:05:11.414405    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2\": container with ID starting with 432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2 not found: ID does not exist" containerID="432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2"
Sep 11 17:05:11.414493 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.414431    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2"} err="failed to get container status \"432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2\": rpc error: code = NotFound desc = could not find container \"432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2\": container with ID starting with 432d126be5d69d4121347f15eb65e6d0027dfe2514adf65f614bcd6eab1ebde2 not found: ID does not exist"
Sep 11 17:05:11.509220 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.509188    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6kmr\" (UniqueName: \"kubernetes.io/projected/e13b671d-3c86-4c15-9ec5-67c0a07da172-kube-api-access-f6kmr\") pod \"e13b671d-3c86-4c15-9ec5-67c0a07da172\" (UID: \"e13b671d-3c86-4c15-9ec5-67c0a07da172\") "
Sep 11 17:05:11.509220 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.509220    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13b671d-3c86-4c15-9ec5-67c0a07da172-plugins-config-volume\") pod \"e13b671d-3c86-4c15-9ec5-67c0a07da172\" (UID: \"e13b671d-3c86-4c15-9ec5-67c0a07da172\") "
Sep 11 17:05:11.509473 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.509370    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:05:11.509473 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.509382    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:05:11.509473 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.509390    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:05:11.509473 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.509399    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7bsc\" (UniqueName: \"kubernetes.io/projected/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e-kube-api-access-w7bsc\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:05:11.509659 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.509557    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e13b671d-3c86-4c15-9ec5-67c0a07da172-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e13b671d-3c86-4c15-9ec5-67c0a07da172" (UID: "e13b671d-3c86-4c15-9ec5-67c0a07da172"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:05:11.511417 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.511392    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e13b671d-3c86-4c15-9ec5-67c0a07da172-kube-api-access-f6kmr" (OuterVolumeSpecName: "kube-api-access-f6kmr") pod "e13b671d-3c86-4c15-9ec5-67c0a07da172" (UID: "e13b671d-3c86-4c15-9ec5-67c0a07da172"). InnerVolumeSpecName "kube-api-access-f6kmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:05:11.610616 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.610543    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6kmr\" (UniqueName: \"kubernetes.io/projected/e13b671d-3c86-4c15-9ec5-67c0a07da172-kube-api-access-f6kmr\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:05:11.610616 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.610569    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e13b671d-3c86-4c15-9ec5-67c0a07da172-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:05:11.726057 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.726025    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"]
Sep 11 17:05:11.732058 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.732026    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-6d422395-cddc955b9-n5wbz"]
Sep 11 17:05:11.928934 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:11.928859    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" path="/var/lib/kubelet/pods/f6f5bbdc-0439-41f0-9080-fbfa6a159e0e/volumes"
Sep 11 17:05:12.409141 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:12.409111    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"
Sep 11 17:05:12.427091 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:12.427052    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"]
Sep 11 17:05:12.435637 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:12.435613    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-6d422395-5777b9b9b5-qsn2r"]
Sep 11 17:05:13.928415 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:05:13.928385    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e13b671d-3c86-4c15-9ec5-67c0a07da172" path="/var/lib/kubelet/pods/e13b671d-3c86-4c15-9ec5-67c0a07da172/volumes"
Sep 11 17:07:14.120356 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.120324    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"]
Sep 11 17:07:14.120901 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.120769    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" containerName="maas-api"
Sep 11 17:07:14.120901 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.120781    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" containerName="maas-api"
Sep 11 17:07:14.120901 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.120828    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e13b671d-3c86-4c15-9ec5-67c0a07da172" containerName="payload-processing"
Sep 11 17:07:14.120901 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.120835    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="e13b671d-3c86-4c15-9ec5-67c0a07da172" containerName="payload-processing"
Sep 11 17:07:14.121134 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.120925    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="e13b671d-3c86-4c15-9ec5-67c0a07da172" containerName="payload-processing"
Sep 11 17:07:14.121134 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.120938    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f5bbdc-0439-41f0-9080-fbfa6a159e0e" containerName="maas-api"
Sep 11 17:07:14.124283 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.124261    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.126569 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.126546    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-935ef2-openshift-default-dockercfg-8kmls\""
Sep 11 17:07:14.135098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.135065    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"]
Sep 11 17:07:14.180572 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.180546    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-token\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.180742 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.180582    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-credential-socket\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.180742 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.180600    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istiod-ca-cert\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.180742 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.180617    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-data\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.180946 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.180750    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-envoy\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.180946 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.180789    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-socket\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.180946 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.180854    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-certs\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.180946 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.180900    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-podinfo\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.180946 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.180940    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5j2f\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-kube-api-access-h5j2f\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.282331 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.282299    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-envoy\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.282517 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.282339    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-socket\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.282517 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.282378    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-certs\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.282517 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.282418    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-podinfo\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.282517 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.282456    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5j2f\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-kube-api-access-h5j2f\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.282735 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.282544    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-token\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.282735 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.282589    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-credential-socket\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.282735 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.282611    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istiod-ca-cert\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.282735 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.282635    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-data\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.283026 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.283000    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-credential-socket\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.283088 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.283060    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-data\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.283263 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.283240    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-socket\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.283359 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.283344    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istiod-ca-cert\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.283454 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.283406    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-certs\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.284939 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.284918    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-envoy\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.285102 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.285085    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-podinfo\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.299630 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.299601    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-token\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.299738 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.299724    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5j2f\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-kube-api-access-h5j2f\") pod \"e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") " pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.436568 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.436488    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:14.717502 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.717477    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"]
Sep 11 17:07:14.718417 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:07:14.718397    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa7a4d33_3004_4e4c_bb73_8a94b55cb074.slice/crio-b008106b4918de8f9d55124839abecd4c6de07fae48665d81e160eaa10b08297 WatchSource:0}: Error finding container b008106b4918de8f9d55124839abecd4c6de07fae48665d81e160eaa10b08297: Status 404 returned error can't find the container with id b008106b4918de8f9d55124839abecd4c6de07fae48665d81e160eaa10b08297
Sep 11 17:07:14.720648 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.720614    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:07:14.720706 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.720681    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:07:14.720742 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:14.720710    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:07:15.104262 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:15.104169    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" event={"ID":"aa7a4d33-3004-4e4c-bb73-8a94b55cb074","Type":"ContainerStarted","Data":"bb7707cd61dbf8c0282f5ccc73919262e3ae6df76aa141c47aa480ebac4d94a5"}
Sep 11 17:07:15.104262 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:15.104243    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" event={"ID":"aa7a4d33-3004-4e4c-bb73-8a94b55cb074","Type":"ContainerStarted","Data":"b008106b4918de8f9d55124839abecd4c6de07fae48665d81e160eaa10b08297"}
Sep 11 17:07:15.125784 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:15.125720    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" podStartSLOduration=1.125700235 podStartE2EDuration="1.125700235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:07:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:07:15.124825151 +0000 UTC m=+1445.684216531" watchObservedRunningTime="2026-09-11 17:07:15.125700235 +0000 UTC m=+1445.685091624"
Sep 11 17:07:15.437633 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:15.437554    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:15.442494 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:15.442472    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:16.110965 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:16.110927    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:16.111971 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:16.111951    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:22.014118 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.014087    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"]
Sep 11 17:07:22.017757 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.017732    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.028714 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.028697    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-935ef2-serving-cert\""
Sep 11 17:07:22.045001 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.044977    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"]
Sep 11 17:07:22.161429 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.161395    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2xdl\" (UniqueName: \"kubernetes.io/projected/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-kube-api-access-q2xdl\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.161429 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.161435    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-maas-api-tls\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.161663 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.161458    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-openshift-service-ca\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.161663 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.161520    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-metrics-certs\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.262327 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.262287    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2xdl\" (UniqueName: \"kubernetes.io/projected/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-kube-api-access-q2xdl\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.262563 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.262344    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-maas-api-tls\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.262563 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.262379    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-openshift-service-ca\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.262696 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.262626    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-metrics-certs\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.263169 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.263146    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-openshift-service-ca\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.265296 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.265237    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-metrics-certs\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.265420 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.265400    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-maas-api-tls\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.270310 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.270286    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2xdl\" (UniqueName: \"kubernetes.io/projected/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-kube-api-access-q2xdl\") pod \"maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.328960 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.328934    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:22.609607 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.609582    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"]
Sep 11 17:07:22.611836 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:07:22.611780    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0494bbf_d00b_4bf4_a0e8_d089ccb2f830.slice/crio-96a3e457c2356553ec4e9c642036ea240a72ba1b62e98a56b719813a2f1ba763 WatchSource:0}: Error finding container 96a3e457c2356553ec4e9c642036ea240a72ba1b62e98a56b719813a2f1ba763: Status 404 returned error can't find the container with id 96a3e457c2356553ec4e9c642036ea240a72ba1b62e98a56b719813a2f1ba763
Sep 11 17:07:22.613832 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:22.613784    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:07:23.154711 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:23.154681    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw" event={"ID":"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830","Type":"ContainerStarted","Data":"20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345"}
Sep 11 17:07:23.155075 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:23.154917    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:23.155075 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:23.154969    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw" event={"ID":"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830","Type":"ContainerStarted","Data":"96a3e457c2356553ec4e9c642036ea240a72ba1b62e98a56b719813a2f1ba763"}
Sep 11 17:07:23.175471 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:23.175428    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw" podStartSLOduration=1.699784094 podStartE2EDuration="2.175413744s" totalImagesPullingTime="475.62965ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:07:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:07:23.173224391 +0000 UTC m=+1453.732615778" watchObservedRunningTime="2026-09-11 17:07:23.175413744 +0000 UTC m=+1453.734805149"
Sep 11 17:07:29.166410 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:29.166383    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:07:52.060016 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.059977    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"]
Sep 11 17:07:52.064155 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.064130    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.067408 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.067386    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-b34361-serving-cert\""
Sep 11 17:07:52.071461 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.071433    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"]
Sep 11 17:07:52.165840 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.165788    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhzxm\" (UniqueName: \"kubernetes.io/projected/89deb2e2-26a3-4f4c-a735-61a20155fcb6-kube-api-access-lhzxm\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.166020 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.165887    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89deb2e2-26a3-4f4c-a735-61a20155fcb6-openshift-service-ca\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.166020 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.165982    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-maas-api-tls\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.166143 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.166053    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-metrics-certs\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.267077 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.267051    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-metrics-certs\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.271177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.267146    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhzxm\" (UniqueName: \"kubernetes.io/projected/89deb2e2-26a3-4f4c-a735-61a20155fcb6-kube-api-access-lhzxm\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.271177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.267205    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89deb2e2-26a3-4f4c-a735-61a20155fcb6-openshift-service-ca\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.271177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.267264    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-maas-api-tls\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.271177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.267928    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89deb2e2-26a3-4f4c-a735-61a20155fcb6-openshift-service-ca\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.271177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.269605    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-metrics-certs\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.271177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.269862    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-maas-api-tls\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.274727 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.274705    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhzxm\" (UniqueName: \"kubernetes.io/projected/89deb2e2-26a3-4f4c-a735-61a20155fcb6-kube-api-access-lhzxm\") pod \"maas-api-e2e-api-b-b34361-dd95997b9-h8t4z\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.377878 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.377845    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:52.660861 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.660827    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"]
Sep 11 17:07:52.661388 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:07:52.661365    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89deb2e2_26a3_4f4c_a735_61a20155fcb6.slice/crio-d61564810212438e360c0dd04373e073965287c473207b6efdca696eda8842ea WatchSource:0}: Error finding container d61564810212438e360c0dd04373e073965287c473207b6efdca696eda8842ea: Status 404 returned error can't find the container with id d61564810212438e360c0dd04373e073965287c473207b6efdca696eda8842ea
Sep 11 17:07:52.769250 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.769211    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"]
Sep 11 17:07:52.772918 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.772898    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:07:52.775553 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.775534    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-b34361\""
Sep 11 17:07:52.775676 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.775534    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-b34361-dockercfg-tvbt2\""
Sep 11 17:07:52.780653 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.780630    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"]
Sep 11 17:07:52.874057 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.874024    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfphz\" (UniqueName: \"kubernetes.io/projected/0078a3a4-1502-4aab-97e4-45b6a04f934d-kube-api-access-nfphz\") pod \"payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw\" (UID: \"0078a3a4-1502-4aab-97e4-45b6a04f934d\") " pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:07:52.874260 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.874231    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0078a3a4-1502-4aab-97e4-45b6a04f934d-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw\" (UID: \"0078a3a4-1502-4aab-97e4-45b6a04f934d\") " pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:07:52.974958 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.974920    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0078a3a4-1502-4aab-97e4-45b6a04f934d-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw\" (UID: \"0078a3a4-1502-4aab-97e4-45b6a04f934d\") " pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:07:52.975135 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.975022    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfphz\" (UniqueName: \"kubernetes.io/projected/0078a3a4-1502-4aab-97e4-45b6a04f934d-kube-api-access-nfphz\") pod \"payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw\" (UID: \"0078a3a4-1502-4aab-97e4-45b6a04f934d\") " pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:07:52.975620 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.975601    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0078a3a4-1502-4aab-97e4-45b6a04f934d-plugins-config-volume\") pod \"payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw\" (UID: \"0078a3a4-1502-4aab-97e4-45b6a04f934d\") " pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:07:52.983134 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:52.983110    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfphz\" (UniqueName: \"kubernetes.io/projected/0078a3a4-1502-4aab-97e4-45b6a04f934d-kube-api-access-nfphz\") pod \"payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw\" (UID: \"0078a3a4-1502-4aab-97e4-45b6a04f934d\") " pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:07:53.085754 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:53.085693    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:07:53.353494 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:53.353417    2569 generic.go:356] "Generic (PLEG): container finished" podID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerID="bb7707cd61dbf8c0282f5ccc73919262e3ae6df76aa141c47aa480ebac4d94a5" exitCode=0
Sep 11 17:07:53.353633 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:53.353494    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" event={"ID":"aa7a4d33-3004-4e4c-bb73-8a94b55cb074","Type":"ContainerDied","Data":"bb7707cd61dbf8c0282f5ccc73919262e3ae6df76aa141c47aa480ebac4d94a5"}
Sep 11 17:07:53.354077 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:53.354055    2569 scope.go:117] "RemoveContainer" containerID="bb7707cd61dbf8c0282f5ccc73919262e3ae6df76aa141c47aa480ebac4d94a5"
Sep 11 17:07:53.354970 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:53.354946    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z" event={"ID":"89deb2e2-26a3-4f4c-a735-61a20155fcb6","Type":"ContainerStarted","Data":"d61564810212438e360c0dd04373e073965287c473207b6efdca696eda8842ea"}
Sep 11 17:07:53.355292 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:53.355266    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:07:53.355344 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:53.355335    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:07:53.355378 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:53.355366    2569 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 11 17:07:53.368116 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:53.368095    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"]
Sep 11 17:07:53.368638 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:07:53.368608    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0078a3a4_1502_4aab_97e4_45b6a04f934d.slice/crio-c089daed616c57e55890c34d5c3380397d49f80c7d6ee2fcdda6a7f1567e2b92 WatchSource:0}: Error finding container c089daed616c57e55890c34d5c3380397d49f80c7d6ee2fcdda6a7f1567e2b92: Status 404 returned error can't find the container with id c089daed616c57e55890c34d5c3380397d49f80c7d6ee2fcdda6a7f1567e2b92
Sep 11 17:07:54.363935 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.363899    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" event={"ID":"aa7a4d33-3004-4e4c-bb73-8a94b55cb074","Type":"ContainerStarted","Data":"2c4000d9838f21584a8a45f99e821741d2ac390a5e2acb9895464580a4c4543e"}
Sep 11 17:07:54.365637 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.365611    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw" event={"ID":"0078a3a4-1502-4aab-97e4-45b6a04f934d","Type":"ContainerStarted","Data":"f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027"}
Sep 11 17:07:54.365793 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.365653    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw" event={"ID":"0078a3a4-1502-4aab-97e4-45b6a04f934d","Type":"ContainerStarted","Data":"c089daed616c57e55890c34d5c3380397d49f80c7d6ee2fcdda6a7f1567e2b92"}
Sep 11 17:07:54.365793 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.365724    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:07:54.367261 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.367236    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z" event={"ID":"89deb2e2-26a3-4f4c-a735-61a20155fcb6","Type":"ContainerStarted","Data":"f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89"}
Sep 11 17:07:54.367365 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.367319    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:07:54.401558 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.401502    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw" podStartSLOduration=2.401482288 podStartE2EDuration="2.401482288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:07:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:07:54.399007691 +0000 UTC m=+1484.958399083" watchObservedRunningTime="2026-09-11 17:07:54.401482288 +0000 UTC m=+1484.960873680"
Sep 11 17:07:54.416254 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.416211    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z" podStartSLOduration=1.675787609 podStartE2EDuration="2.416199834s" totalImagesPullingTime="740.412225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:07:54.413695554 +0000 UTC m=+1484.973086942" watchObservedRunningTime="2026-09-11 17:07:54.416199834 +0000 UTC m=+1484.975591254"
Sep 11 17:07:54.437273 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.437246    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:07:54.437430 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.437410    2569 patch_prober.go:28] interesting pod/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 17:07:54.437487 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:54.437455    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 17:07:55.437417 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:55.437381    2569 patch_prober.go:28] interesting pod/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 17:07:55.437855 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:55.437433    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 17:07:56.437516 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:56.437479    2569 patch_prober.go:28] interesting pod/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 17:07:56.437953 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:56.437533    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 17:07:57.437750 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:57.437706    2569 patch_prober.go:28] interesting pod/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 17:07:57.438159 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:57.437773    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 17:07:58.437373 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:58.437335    2569 patch_prober.go:28] interesting pod/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 17:07:58.437549 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:58.437387    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 17:07:59.436916 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:59.436881    2569 patch_prober.go:28] interesting pod/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Sep 11 17:07:59.437297 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:07:59.436931    2569 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Sep 11 17:08:00.379858 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:00.379829    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:08:00.442600 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:00.442572    2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:08:00.443199 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:00.443177    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:08:00.444187 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:00.444160    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:08:05.375249 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:05.375224    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:08:05.655448 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:05.655368    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"]
Sep 11 17:08:05.655621 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:05.655590    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9" podUID="18055e96-446a-4706-92e6-f97ddfeed865" containerName="maas-api" containerID="cri-o://1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400" gracePeriod=30
Sep 11 17:08:05.723043 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:05.723008    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"]
Sep 11 17:08:05.723631 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:05.723292    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq" podUID="9367e177-a531-4bbd-a838-7692e23ad5d7" containerName="payload-pre-processing" containerID="cri-o://20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0" gracePeriod=30
Sep 11 17:08:06.022330 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.022302    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 17:08:06.126303 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.126278    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9367e177-a531-4bbd-a838-7692e23ad5d7-plugins-config-volume\") pod \"9367e177-a531-4bbd-a838-7692e23ad5d7\" (UID: \"9367e177-a531-4bbd-a838-7692e23ad5d7\") "
Sep 11 17:08:06.126424 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.126408    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkpl5\" (UniqueName: \"kubernetes.io/projected/9367e177-a531-4bbd-a838-7692e23ad5d7-kube-api-access-pkpl5\") pod \"9367e177-a531-4bbd-a838-7692e23ad5d7\" (UID: \"9367e177-a531-4bbd-a838-7692e23ad5d7\") "
Sep 11 17:08:06.126707 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.126681    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9367e177-a531-4bbd-a838-7692e23ad5d7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9367e177-a531-4bbd-a838-7692e23ad5d7" (UID: "9367e177-a531-4bbd-a838-7692e23ad5d7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:08:06.128527 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.128502    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9367e177-a531-4bbd-a838-7692e23ad5d7-kube-api-access-pkpl5" (OuterVolumeSpecName: "kube-api-access-pkpl5") pod "9367e177-a531-4bbd-a838-7692e23ad5d7" (UID: "9367e177-a531-4bbd-a838-7692e23ad5d7"). InnerVolumeSpecName "kube-api-access-pkpl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:08:06.142198 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.142176    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 17:08:06.227005 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.226972    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-metrics-certs\") pod \"18055e96-446a-4706-92e6-f97ddfeed865\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") "
Sep 11 17:08:06.227165 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.227089    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bw8x9\" (UniqueName: \"kubernetes.io/projected/18055e96-446a-4706-92e6-f97ddfeed865-kube-api-access-bw8x9\") pod \"18055e96-446a-4706-92e6-f97ddfeed865\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") "
Sep 11 17:08:06.227165 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.227119    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-maas-api-tls\") pod \"18055e96-446a-4706-92e6-f97ddfeed865\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") "
Sep 11 17:08:06.227165 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.227140    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18055e96-446a-4706-92e6-f97ddfeed865-openshift-service-ca\") pod \"18055e96-446a-4706-92e6-f97ddfeed865\" (UID: \"18055e96-446a-4706-92e6-f97ddfeed865\") "
Sep 11 17:08:06.227569 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.227544    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9367e177-a531-4bbd-a838-7692e23ad5d7-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:06.227569 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.227549    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18055e96-446a-4706-92e6-f97ddfeed865-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18055e96-446a-4706-92e6-f97ddfeed865" (UID: "18055e96-446a-4706-92e6-f97ddfeed865"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:08:06.227569 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.227572    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkpl5\" (UniqueName: \"kubernetes.io/projected/9367e177-a531-4bbd-a838-7692e23ad5d7-kube-api-access-pkpl5\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:06.229221 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.229197    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18055e96-446a-4706-92e6-f97ddfeed865-kube-api-access-bw8x9" (OuterVolumeSpecName: "kube-api-access-bw8x9") pod "18055e96-446a-4706-92e6-f97ddfeed865" (UID: "18055e96-446a-4706-92e6-f97ddfeed865"). InnerVolumeSpecName "kube-api-access-bw8x9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:08:06.229351 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.229331    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18055e96-446a-4706-92e6-f97ddfeed865" (UID: "18055e96-446a-4706-92e6-f97ddfeed865"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:08:06.229423 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.229346    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "18055e96-446a-4706-92e6-f97ddfeed865" (UID: "18055e96-446a-4706-92e6-f97ddfeed865"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:08:06.328252 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.328216    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bw8x9\" (UniqueName: \"kubernetes.io/projected/18055e96-446a-4706-92e6-f97ddfeed865-kube-api-access-bw8x9\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:06.328252 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.328252    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:06.328454 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.328267    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18055e96-446a-4706-92e6-f97ddfeed865-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:06.328454 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.328281    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/18055e96-446a-4706-92e6-f97ddfeed865-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:06.456629 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.456590    2569 generic.go:356] "Generic (PLEG): container finished" podID="9367e177-a531-4bbd-a838-7692e23ad5d7" containerID="20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0" exitCode=0
Sep 11 17:08:06.457108 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.456663    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"
Sep 11 17:08:06.457108 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.456682    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq" event={"ID":"9367e177-a531-4bbd-a838-7692e23ad5d7","Type":"ContainerDied","Data":"20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0"}
Sep 11 17:08:06.457108 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.456782    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq" event={"ID":"9367e177-a531-4bbd-a838-7692e23ad5d7","Type":"ContainerDied","Data":"16f9edbc7b5cad78b0403e5403fdfa2f2b9c36b988a5dd347dcb7c5e8f294784"}
Sep 11 17:08:06.457108 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.456831    2569 scope.go:117] "RemoveContainer" containerID="20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0"
Sep 11 17:08:06.458245 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.458175    2569 generic.go:356] "Generic (PLEG): container finished" podID="18055e96-446a-4706-92e6-f97ddfeed865" containerID="1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400" exitCode=0
Sep 11 17:08:06.458245 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.458201    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9" event={"ID":"18055e96-446a-4706-92e6-f97ddfeed865","Type":"ContainerDied","Data":"1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400"}
Sep 11 17:08:06.458369 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.458247    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9" event={"ID":"18055e96-446a-4706-92e6-f97ddfeed865","Type":"ContainerDied","Data":"d443043cdaae7aa1391e1521c3d658a8b1e5d1e446e079e845ec80c8c12743a1"}
Sep 11 17:08:06.458369 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.458253    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"
Sep 11 17:08:06.468448 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.468427    2569 scope.go:117] "RemoveContainer" containerID="20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0"
Sep 11 17:08:06.468723 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:08:06.468699    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0\": container with ID starting with 20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0 not found: ID does not exist" containerID="20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0"
Sep 11 17:08:06.468792 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.468734    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0"} err="failed to get container status \"20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0\": rpc error: code = NotFound desc = could not find container \"20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0\": container with ID starting with 20210bafd518a789aecea693c2f4060a7988eebe44e21c054c2ada6b2c1fa4d0 not found: ID does not exist"
Sep 11 17:08:06.468792 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.468755    2569 scope.go:117] "RemoveContainer" containerID="1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400"
Sep 11 17:08:06.477764 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.477748    2569 scope.go:117] "RemoveContainer" containerID="1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400"
Sep 11 17:08:06.478041 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:08:06.478022    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400\": container with ID starting with 1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400 not found: ID does not exist" containerID="1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400"
Sep 11 17:08:06.478119 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.478046    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400"} err="failed to get container status \"1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400\": rpc error: code = NotFound desc = could not find container \"1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400\": container with ID starting with 1c5bc5dc0b1727ec16a3b746dddd751a9e23d82cba21de10f91bc3d3ceb0d400 not found: ID does not exist"
Sep 11 17:08:06.483891 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.483873    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"]
Sep 11 17:08:06.487773 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.487754    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-52b0af-76789c7db6-ljwcq"]
Sep 11 17:08:06.498516 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.498499    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"]
Sep 11 17:08:06.503169 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:06.503142    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-52b0af-847b7c69b7-qskn9"]
Sep 11 17:08:07.928956 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:07.928922    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18055e96-446a-4706-92e6-f97ddfeed865" path="/var/lib/kubelet/pods/18055e96-446a-4706-92e6-f97ddfeed865/volumes"
Sep 11 17:08:07.929366 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:07.929310    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9367e177-a531-4bbd-a838-7692e23ad5d7" path="/var/lib/kubelet/pods/9367e177-a531-4bbd-a838-7692e23ad5d7/volumes"
Sep 11 17:08:34.596129 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.596046    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"]
Sep 11 17:08:34.596557 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.596276    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw" podUID="f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" containerName="maas-api" containerID="cri-o://20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345" gracePeriod=30
Sep 11 17:08:34.858241 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.858182    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:08:34.912404 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.912375    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-metrics-certs\") pod \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") "
Sep 11 17:08:34.912588 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.912555    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2xdl\" (UniqueName: \"kubernetes.io/projected/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-kube-api-access-q2xdl\") pod \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") "
Sep 11 17:08:34.912664 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.912599    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-maas-api-tls\") pod \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") "
Sep 11 17:08:34.912730 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.912666    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-openshift-service-ca\") pod \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\" (UID: \"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830\") "
Sep 11 17:08:34.913106 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.913076    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" (UID: "f0494bbf-d00b-4bf4-a0e8-d089ccb2f830"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:08:34.915297 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.915270    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" (UID: "f0494bbf-d00b-4bf4-a0e8-d089ccb2f830"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:08:34.915443 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.915416    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" (UID: "f0494bbf-d00b-4bf4-a0e8-d089ccb2f830"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:08:34.915509 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:34.915434    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-kube-api-access-q2xdl" (OuterVolumeSpecName: "kube-api-access-q2xdl") pod "f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" (UID: "f0494bbf-d00b-4bf4-a0e8-d089ccb2f830"). InnerVolumeSpecName "kube-api-access-q2xdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:08:35.014652 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.014615    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2xdl\" (UniqueName: \"kubernetes.io/projected/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-kube-api-access-q2xdl\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:35.014652 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.014657    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:35.014923 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.014696    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:35.014923 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.014713    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:35.639688 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.639647    2569 generic.go:356] "Generic (PLEG): container finished" podID="f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" containerID="20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345" exitCode=0
Sep 11 17:08:35.640121 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.639704    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw" event={"ID":"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830","Type":"ContainerDied","Data":"20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345"}
Sep 11 17:08:35.640121 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.639712    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"
Sep 11 17:08:35.640121 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.639787    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw" event={"ID":"f0494bbf-d00b-4bf4-a0e8-d089ccb2f830","Type":"ContainerDied","Data":"96a3e457c2356553ec4e9c642036ea240a72ba1b62e98a56b719813a2f1ba763"}
Sep 11 17:08:35.640121 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.639847    2569 scope.go:117] "RemoveContainer" containerID="20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345"
Sep 11 17:08:35.649687 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.649668    2569 scope.go:117] "RemoveContainer" containerID="20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345"
Sep 11 17:08:35.649983 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:08:35.649962    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345\": container with ID starting with 20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345 not found: ID does not exist" containerID="20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345"
Sep 11 17:08:35.650055 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.649993    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345"} err="failed to get container status \"20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345\": rpc error: code = NotFound desc = could not find container \"20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345\": container with ID starting with 20faa8dc193a1971e643fcab72f4731c998c5ddb24399bfeff32f4685f848345 not found: ID does not exist"
Sep 11 17:08:35.680873 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.680849    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"]
Sep 11 17:08:35.692517 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.692497    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-935ef2-75c9d966c5-dwcgw"]
Sep 11 17:08:35.928432 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:35.928353    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" path="/var/lib/kubelet/pods/f0494bbf-d00b-4bf4-a0e8-d089ccb2f830/volumes"
Sep 11 17:08:41.592856 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:41.592824    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"]
Sep 11 17:08:41.593325 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:41.593066    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy" containerID="cri-o://2c4000d9838f21584a8a45f99e821741d2ac390a5e2acb9895464580a4c4543e" gracePeriod=30
Sep 11 17:08:45.445955 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:45.445918    2569 patch_prober.go:28] interesting pod/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 17:08:45.446335 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:45.445989    2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:08:46.712756 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.712728    2569 generic.go:356] "Generic (PLEG): container finished" podID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerID="2c4000d9838f21584a8a45f99e821741d2ac390a5e2acb9895464580a4c4543e" exitCode=0
Sep 11 17:08:46.713130 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.712792    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" event={"ID":"aa7a4d33-3004-4e4c-bb73-8a94b55cb074","Type":"ContainerDied","Data":"2c4000d9838f21584a8a45f99e821741d2ac390a5e2acb9895464580a4c4543e"}
Sep 11 17:08:46.713130 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.712886    2569 scope.go:117] "RemoveContainer" containerID="bb7707cd61dbf8c0282f5ccc73919262e3ae6df76aa141c47aa480ebac4d94a5"
Sep 11 17:08:46.858159 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.858134    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:08:46.935375 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935295    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-token\") pod \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") "
Sep 11 17:08:46.935375 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935360    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-credential-socket\") pod \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") "
Sep 11 17:08:46.935579 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935391    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-data\") pod \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") "
Sep 11 17:08:46.935579 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935427    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-certs\") pod \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") "
Sep 11 17:08:46.935579 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935468    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-podinfo\") pod \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") "
Sep 11 17:08:46.935579 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935497    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-envoy\") pod \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") "
Sep 11 17:08:46.935579 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935531    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5j2f\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-kube-api-access-h5j2f\") pod \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") "
Sep 11 17:08:46.935579 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935560    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-socket\") pod \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") "
Sep 11 17:08:46.935884 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935587    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istiod-ca-cert\") pod \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\" (UID: \"aa7a4d33-3004-4e4c-bb73-8a94b55cb074\") "
Sep 11 17:08:46.935884 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.935679    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa7a4d33-3004-4e4c-bb73-8a94b55cb074" (UID: "aa7a4d33-3004-4e4c-bb73-8a94b55cb074"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:08:46.936577 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.936308    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa7a4d33-3004-4e4c-bb73-8a94b55cb074" (UID: "aa7a4d33-3004-4e4c-bb73-8a94b55cb074"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:08:46.936722 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.936599    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa7a4d33-3004-4e4c-bb73-8a94b55cb074" (UID: "aa7a4d33-3004-4e4c-bb73-8a94b55cb074"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:08:46.936722 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.936642    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa7a4d33-3004-4e4c-bb73-8a94b55cb074" (UID: "aa7a4d33-3004-4e4c-bb73-8a94b55cb074"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:08:46.937869 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.936987    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa7a4d33-3004-4e4c-bb73-8a94b55cb074" (UID: "aa7a4d33-3004-4e4c-bb73-8a94b55cb074"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:08:46.940530 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.938919    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa7a4d33-3004-4e4c-bb73-8a94b55cb074" (UID: "aa7a4d33-3004-4e4c-bb73-8a94b55cb074"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:08:46.940530 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.938927    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa7a4d33-3004-4e4c-bb73-8a94b55cb074" (UID: "aa7a4d33-3004-4e4c-bb73-8a94b55cb074"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:08:46.940530 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.939302    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-kube-api-access-h5j2f" (OuterVolumeSpecName: "kube-api-access-h5j2f") pod "aa7a4d33-3004-4e4c-bb73-8a94b55cb074" (UID: "aa7a4d33-3004-4e4c-bb73-8a94b55cb074"). InnerVolumeSpecName "kube-api-access-h5j2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:08:46.940530 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.939314    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa7a4d33-3004-4e4c-bb73-8a94b55cb074" (UID: "aa7a4d33-3004-4e4c-bb73-8a94b55cb074"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:08:46.946578 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:46.936789    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-credential-socket\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:47.047189 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.047163    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:47.047189 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.047188    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-podinfo\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:47.047189 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.047196    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-envoy\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:47.047397 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.047206    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5j2f\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-kube-api-access-h5j2f\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:47.047397 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.047214    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-workload-socket\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:47.047397 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.047224    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istiod-ca-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:47.047397 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.047231    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-token\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:47.047397 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.047238    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa7a4d33-3004-4e4c-bb73-8a94b55cb074-istio-data\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:47.720177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.720145    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"
Sep 11 17:08:47.720177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.720157    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn" event={"ID":"aa7a4d33-3004-4e4c-bb73-8a94b55cb074","Type":"ContainerDied","Data":"b008106b4918de8f9d55124839abecd4c6de07fae48665d81e160eaa10b08297"}
Sep 11 17:08:47.720649 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.720254    2569 scope.go:117] "RemoveContainer" containerID="2c4000d9838f21584a8a45f99e821741d2ac390a5e2acb9895464580a4c4543e"
Sep 11 17:08:47.744188 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.744165    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"]
Sep 11 17:08:47.750554 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.750529    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-935ef2-openshift-default-7869ff5656-qwmrn"]
Sep 11 17:08:47.928328 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:47.928295    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" path="/var/lib/kubelet/pods/aa7a4d33-3004-4e4c-bb73-8a94b55cb074/volumes"
Sep 11 17:08:57.746108 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:57.746076    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"]
Sep 11 17:08:57.746676 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:57.746281    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z" podUID="89deb2e2-26a3-4f4c-a735-61a20155fcb6" containerName="maas-api" containerID="cri-o://f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89" gracePeriod=30
Sep 11 17:08:57.809133 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:57.809090    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"]
Sep 11 17:08:57.809326 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:57.809301    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw" podUID="0078a3a4-1502-4aab-97e4-45b6a04f934d" containerName="payload-processing" containerID="cri-o://f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027" gracePeriod=30
Sep 11 17:08:58.075456 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.075433    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:08:58.102782 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.102757    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:08:58.150085 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.150058    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-metrics-certs\") pod \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") "
Sep 11 17:08:58.150245 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.150095    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-maas-api-tls\") pod \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") "
Sep 11 17:08:58.150245 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.150142    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nfphz\" (UniqueName: \"kubernetes.io/projected/0078a3a4-1502-4aab-97e4-45b6a04f934d-kube-api-access-nfphz\") pod \"0078a3a4-1502-4aab-97e4-45b6a04f934d\" (UID: \"0078a3a4-1502-4aab-97e4-45b6a04f934d\") "
Sep 11 17:08:58.150245 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.150167    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0078a3a4-1502-4aab-97e4-45b6a04f934d-plugins-config-volume\") pod \"0078a3a4-1502-4aab-97e4-45b6a04f934d\" (UID: \"0078a3a4-1502-4aab-97e4-45b6a04f934d\") "
Sep 11 17:08:58.150245 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.150198    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89deb2e2-26a3-4f4c-a735-61a20155fcb6-openshift-service-ca\") pod \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") "
Sep 11 17:08:58.150245 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.150229    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhzxm\" (UniqueName: \"kubernetes.io/projected/89deb2e2-26a3-4f4c-a735-61a20155fcb6-kube-api-access-lhzxm\") pod \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\" (UID: \"89deb2e2-26a3-4f4c-a735-61a20155fcb6\") "
Sep 11 17:08:58.150616 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.150593    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0078a3a4-1502-4aab-97e4-45b6a04f934d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0078a3a4-1502-4aab-97e4-45b6a04f934d" (UID: "0078a3a4-1502-4aab-97e4-45b6a04f934d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:08:58.150699 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.150628    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89deb2e2-26a3-4f4c-a735-61a20155fcb6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "89deb2e2-26a3-4f4c-a735-61a20155fcb6" (UID: "89deb2e2-26a3-4f4c-a735-61a20155fcb6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:08:58.152632 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.152600    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "89deb2e2-26a3-4f4c-a735-61a20155fcb6" (UID: "89deb2e2-26a3-4f4c-a735-61a20155fcb6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:08:58.152744 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.152668    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89deb2e2-26a3-4f4c-a735-61a20155fcb6-kube-api-access-lhzxm" (OuterVolumeSpecName: "kube-api-access-lhzxm") pod "89deb2e2-26a3-4f4c-a735-61a20155fcb6" (UID: "89deb2e2-26a3-4f4c-a735-61a20155fcb6"). InnerVolumeSpecName "kube-api-access-lhzxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:08:58.152851 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.152833    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "89deb2e2-26a3-4f4c-a735-61a20155fcb6" (UID: "89deb2e2-26a3-4f4c-a735-61a20155fcb6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:08:58.152921 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.152856    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0078a3a4-1502-4aab-97e4-45b6a04f934d-kube-api-access-nfphz" (OuterVolumeSpecName: "kube-api-access-nfphz") pod "0078a3a4-1502-4aab-97e4-45b6a04f934d" (UID: "0078a3a4-1502-4aab-97e4-45b6a04f934d"). InnerVolumeSpecName "kube-api-access-nfphz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:08:58.251003 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.250969    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/89deb2e2-26a3-4f4c-a735-61a20155fcb6-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:58.251003 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.250995    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhzxm\" (UniqueName: \"kubernetes.io/projected/89deb2e2-26a3-4f4c-a735-61a20155fcb6-kube-api-access-lhzxm\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:58.251003 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.251005    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:58.251229 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.251015    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/89deb2e2-26a3-4f4c-a735-61a20155fcb6-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:58.251229 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.251023    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nfphz\" (UniqueName: \"kubernetes.io/projected/0078a3a4-1502-4aab-97e4-45b6a04f934d-kube-api-access-nfphz\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:58.251229 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.251034    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0078a3a4-1502-4aab-97e4-45b6a04f934d-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:08:58.784840 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.784780    2569 generic.go:356] "Generic (PLEG): container finished" podID="0078a3a4-1502-4aab-97e4-45b6a04f934d" containerID="f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027" exitCode=0
Sep 11 17:08:58.785233 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.784849    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"
Sep 11 17:08:58.785233 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.784866    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw" event={"ID":"0078a3a4-1502-4aab-97e4-45b6a04f934d","Type":"ContainerDied","Data":"f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027"}
Sep 11 17:08:58.785233 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.784954    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw" event={"ID":"0078a3a4-1502-4aab-97e4-45b6a04f934d","Type":"ContainerDied","Data":"c089daed616c57e55890c34d5c3380397d49f80c7d6ee2fcdda6a7f1567e2b92"}
Sep 11 17:08:58.785233 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.784978    2569 scope.go:117] "RemoveContainer" containerID="f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027"
Sep 11 17:08:58.786386 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.786362    2569 generic.go:356] "Generic (PLEG): container finished" podID="89deb2e2-26a3-4f4c-a735-61a20155fcb6" containerID="f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89" exitCode=0
Sep 11 17:08:58.786450 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.786406    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z" event={"ID":"89deb2e2-26a3-4f4c-a735-61a20155fcb6","Type":"ContainerDied","Data":"f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89"}
Sep 11 17:08:58.786450 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.786425    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"
Sep 11 17:08:58.786577 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.786454    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z" event={"ID":"89deb2e2-26a3-4f4c-a735-61a20155fcb6","Type":"ContainerDied","Data":"d61564810212438e360c0dd04373e073965287c473207b6efdca696eda8842ea"}
Sep 11 17:08:58.796425 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.796408    2569 scope.go:117] "RemoveContainer" containerID="f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027"
Sep 11 17:08:58.796724 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:08:58.796699    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027\": container with ID starting with f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027 not found: ID does not exist" containerID="f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027"
Sep 11 17:08:58.796856 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.796734    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027"} err="failed to get container status \"f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027\": rpc error: code = NotFound desc = could not find container \"f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027\": container with ID starting with f5a2bf29a0de57b56f8dbe5e9b84e84d99a10a45dd4b5de8ee8df942b924d027 not found: ID does not exist"
Sep 11 17:08:58.796856 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.796753    2569 scope.go:117] "RemoveContainer" containerID="f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89"
Sep 11 17:08:58.805414 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.805399    2569 scope.go:117] "RemoveContainer" containerID="f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89"
Sep 11 17:08:58.805663 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:08:58.805645    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89\": container with ID starting with f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89 not found: ID does not exist" containerID="f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89"
Sep 11 17:08:58.805717 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.805669    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89"} err="failed to get container status \"f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89\": rpc error: code = NotFound desc = could not find container \"f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89\": container with ID starting with f5ea298fe2f98e381a16c0165ebeb672a2a88841cfd73785a6f1ef3f96f66d89 not found: ID does not exist"
Sep 11 17:08:58.812448 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.812428    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"]
Sep 11 17:08:58.817387 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.817368    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-b34361-777d7b6b67-twlmw"]
Sep 11 17:08:58.828376 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.828358    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"]
Sep 11 17:08:58.832652 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:58.832626    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-b34361-dd95997b9-h8t4z"]
Sep 11 17:08:59.927555 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:59.927527    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0078a3a4-1502-4aab-97e4-45b6a04f934d" path="/var/lib/kubelet/pods/0078a3a4-1502-4aab-97e4-45b6a04f934d/volumes"
Sep 11 17:08:59.927956 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:08:59.927942    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89deb2e2-26a3-4f4c-a735-61a20155fcb6" path="/var/lib/kubelet/pods/89deb2e2-26a3-4f4c-a735-61a20155fcb6/volumes"
Sep 11 17:09:10.227337 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:10.227143    2569 scope.go:117] "RemoveContainer" containerID="bbd13465353276fb3fc0dcdb033038eef1018efc42797f2ae6a6ed750da8544d"
Sep 11 17:09:16.297407 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.297354    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"]
Sep 11 17:09:16.298273 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.298234    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954" podUID="2609bff4-3e7c-49e6-9978-894403249ee5" containerName="maas-api" containerID="cri-o://40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6" gracePeriod=30
Sep 11 17:09:16.352916 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.352883    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"]
Sep 11 17:09:16.353199 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.353159    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4" podUID="a3b0652d-de3a-425a-8a33-714fcfbf3470" containerName="payload-processing" containerID="cri-o://2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad" gracePeriod=30
Sep 11 17:09:16.603609 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.603583    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:09:16.645784 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.645758    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:09:16.716159 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.716119    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7xs7\" (UniqueName: \"kubernetes.io/projected/2609bff4-3e7c-49e6-9978-894403249ee5-kube-api-access-q7xs7\") pod \"2609bff4-3e7c-49e6-9978-894403249ee5\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") "
Sep 11 17:09:16.716321 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.716194    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6fkx\" (UniqueName: \"kubernetes.io/projected/a3b0652d-de3a-425a-8a33-714fcfbf3470-kube-api-access-l6fkx\") pod \"a3b0652d-de3a-425a-8a33-714fcfbf3470\" (UID: \"a3b0652d-de3a-425a-8a33-714fcfbf3470\") "
Sep 11 17:09:16.716321 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.716227    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3b0652d-de3a-425a-8a33-714fcfbf3470-plugins-config-volume\") pod \"a3b0652d-de3a-425a-8a33-714fcfbf3470\" (UID: \"a3b0652d-de3a-425a-8a33-714fcfbf3470\") "
Sep 11 17:09:16.716321 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.716285    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-metrics-certs\") pod \"2609bff4-3e7c-49e6-9978-894403249ee5\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") "
Sep 11 17:09:16.716484 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.716323    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-maas-api-tls\") pod \"2609bff4-3e7c-49e6-9978-894403249ee5\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") "
Sep 11 17:09:16.716484 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.716412    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2609bff4-3e7c-49e6-9978-894403249ee5-openshift-service-ca\") pod \"2609bff4-3e7c-49e6-9978-894403249ee5\" (UID: \"2609bff4-3e7c-49e6-9978-894403249ee5\") "
Sep 11 17:09:16.716792 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.716753    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3b0652d-de3a-425a-8a33-714fcfbf3470-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3b0652d-de3a-425a-8a33-714fcfbf3470" (UID: "a3b0652d-de3a-425a-8a33-714fcfbf3470"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:09:16.716995 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.716867    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2609bff4-3e7c-49e6-9978-894403249ee5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2609bff4-3e7c-49e6-9978-894403249ee5" (UID: "2609bff4-3e7c-49e6-9978-894403249ee5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:09:16.718532 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.718503    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2609bff4-3e7c-49e6-9978-894403249ee5-kube-api-access-q7xs7" (OuterVolumeSpecName: "kube-api-access-q7xs7") pod "2609bff4-3e7c-49e6-9978-894403249ee5" (UID: "2609bff4-3e7c-49e6-9978-894403249ee5"). InnerVolumeSpecName "kube-api-access-q7xs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:09:16.718858 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.718837    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3b0652d-de3a-425a-8a33-714fcfbf3470-kube-api-access-l6fkx" (OuterVolumeSpecName: "kube-api-access-l6fkx") pod "a3b0652d-de3a-425a-8a33-714fcfbf3470" (UID: "a3b0652d-de3a-425a-8a33-714fcfbf3470"). InnerVolumeSpecName "kube-api-access-l6fkx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:09:16.719097 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.719082    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2609bff4-3e7c-49e6-9978-894403249ee5" (UID: "2609bff4-3e7c-49e6-9978-894403249ee5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:09:16.719165 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.719141    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2609bff4-3e7c-49e6-9978-894403249ee5" (UID: "2609bff4-3e7c-49e6-9978-894403249ee5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:09:16.817860 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.817772    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2609bff4-3e7c-49e6-9978-894403249ee5-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:16.817860 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.817821    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7xs7\" (UniqueName: \"kubernetes.io/projected/2609bff4-3e7c-49e6-9978-894403249ee5-kube-api-access-q7xs7\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:16.817860 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.817831    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6fkx\" (UniqueName: \"kubernetes.io/projected/a3b0652d-de3a-425a-8a33-714fcfbf3470-kube-api-access-l6fkx\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:16.817860 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.817843    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3b0652d-de3a-425a-8a33-714fcfbf3470-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:16.817860 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.817853    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:16.817860 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.817862    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2609bff4-3e7c-49e6-9978-894403249ee5-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:16.898162 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.898130    2569 generic.go:356] "Generic (PLEG): container finished" podID="a3b0652d-de3a-425a-8a33-714fcfbf3470" containerID="2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad" exitCode=0
Sep 11 17:09:16.898352 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.898183    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"
Sep 11 17:09:16.898352 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.898183    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4" event={"ID":"a3b0652d-de3a-425a-8a33-714fcfbf3470","Type":"ContainerDied","Data":"2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad"}
Sep 11 17:09:16.898352 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.898252    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4" event={"ID":"a3b0652d-de3a-425a-8a33-714fcfbf3470","Type":"ContainerDied","Data":"d1cecdc4de7795cc7839ab1d2700352ee6ad4682923e5781c524b6f38160775c"}
Sep 11 17:09:16.898352 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.898282    2569 scope.go:117] "RemoveContainer" containerID="2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad"
Sep 11 17:09:16.899957 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.899927    2569 generic.go:356] "Generic (PLEG): container finished" podID="2609bff4-3e7c-49e6-9978-894403249ee5" containerID="40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6" exitCode=0
Sep 11 17:09:16.900066 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.899983    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"
Sep 11 17:09:16.900066 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.899961    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954" event={"ID":"2609bff4-3e7c-49e6-9978-894403249ee5","Type":"ContainerDied","Data":"40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6"}
Sep 11 17:09:16.900181 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.900066    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954" event={"ID":"2609bff4-3e7c-49e6-9978-894403249ee5","Type":"ContainerDied","Data":"e927349e1d5d5d68773854fff91a4e6427004c4bf434763c4f585144b5276362"}
Sep 11 17:09:16.908782 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.908763    2569 scope.go:117] "RemoveContainer" containerID="2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad"
Sep 11 17:09:16.909092 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:09:16.909072    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad\": container with ID starting with 2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad not found: ID does not exist" containerID="2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad"
Sep 11 17:09:16.909185 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.909098    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad"} err="failed to get container status \"2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad\": rpc error: code = NotFound desc = could not find container \"2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad\": container with ID starting with 2d18ba1246a8a60453753a54fabebdbd64c579f1e58ff40b1196902fa5bf0cad not found: ID does not exist"
Sep 11 17:09:16.909185 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.909116    2569 scope.go:117] "RemoveContainer" containerID="40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6"
Sep 11 17:09:16.918209 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.918194    2569 scope.go:117] "RemoveContainer" containerID="40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6"
Sep 11 17:09:16.918480 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:09:16.918461    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6\": container with ID starting with 40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6 not found: ID does not exist" containerID="40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6"
Sep 11 17:09:16.918550 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.918487    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6"} err="failed to get container status \"40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6\": rpc error: code = NotFound desc = could not find container \"40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6\": container with ID starting with 40d961ed9a4b54a353c4ebe58705b2f05e15b047fcc4ed2e2f262412ae86b2e6 not found: ID does not exist"
Sep 11 17:09:16.927459 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.927439    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"]
Sep 11 17:09:16.931431 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.931409    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-6b6653-7c6447fbdd-d8954"]
Sep 11 17:09:16.941488 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.941465    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"]
Sep 11 17:09:16.947327 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:16.947305    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-6b6653-84c6c4c6d5-5nxp4"]
Sep 11 17:09:17.926920 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:17.926888    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2609bff4-3e7c-49e6-9978-894403249ee5" path="/var/lib/kubelet/pods/2609bff4-3e7c-49e6-9978-894403249ee5/volumes"
Sep 11 17:09:17.927312 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:17.927259    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3b0652d-de3a-425a-8a33-714fcfbf3470" path="/var/lib/kubelet/pods/a3b0652d-de3a-425a-8a33-714fcfbf3470/volumes"
Sep 11 17:09:35.303571 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.303538    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"]
Sep 11 17:09:35.304060 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.303752    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t" podUID="15ff337a-00d6-449b-aa62-035360fb9ac0" containerName="maas-api" containerID="cri-o://94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef" gracePeriod=30
Sep 11 17:09:35.551749 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.551728    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:09:35.698222 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.698185    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-metrics-certs\") pod \"15ff337a-00d6-449b-aa62-035360fb9ac0\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") "
Sep 11 17:09:35.698531 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.698510    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llvdc\" (UniqueName: \"kubernetes.io/projected/15ff337a-00d6-449b-aa62-035360fb9ac0-kube-api-access-llvdc\") pod \"15ff337a-00d6-449b-aa62-035360fb9ac0\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") "
Sep 11 17:09:35.698840 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.698785    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ff337a-00d6-449b-aa62-035360fb9ac0-openshift-service-ca\") pod \"15ff337a-00d6-449b-aa62-035360fb9ac0\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") "
Sep 11 17:09:35.699007 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.698992    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-maas-api-tls\") pod \"15ff337a-00d6-449b-aa62-035360fb9ac0\" (UID: \"15ff337a-00d6-449b-aa62-035360fb9ac0\") "
Sep 11 17:09:35.699562 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.699524    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15ff337a-00d6-449b-aa62-035360fb9ac0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15ff337a-00d6-449b-aa62-035360fb9ac0" (UID: "15ff337a-00d6-449b-aa62-035360fb9ac0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:09:35.699815 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.699775    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15ff337a-00d6-449b-aa62-035360fb9ac0-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:35.701647 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.701624    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ff337a-00d6-449b-aa62-035360fb9ac0-kube-api-access-llvdc" (OuterVolumeSpecName: "kube-api-access-llvdc") pod "15ff337a-00d6-449b-aa62-035360fb9ac0" (UID: "15ff337a-00d6-449b-aa62-035360fb9ac0"). InnerVolumeSpecName "kube-api-access-llvdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:09:35.701968 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.701936    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "15ff337a-00d6-449b-aa62-035360fb9ac0" (UID: "15ff337a-00d6-449b-aa62-035360fb9ac0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:09:35.702076 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.702039    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15ff337a-00d6-449b-aa62-035360fb9ac0" (UID: "15ff337a-00d6-449b-aa62-035360fb9ac0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:09:35.801120 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.801092    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llvdc\" (UniqueName: \"kubernetes.io/projected/15ff337a-00d6-449b-aa62-035360fb9ac0-kube-api-access-llvdc\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:35.801120 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.801118    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:35.801120 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:35.801127    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15ff337a-00d6-449b-aa62-035360fb9ac0-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:09:36.009694 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:36.009605    2569 generic.go:356] "Generic (PLEG): container finished" podID="15ff337a-00d6-449b-aa62-035360fb9ac0" containerID="94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef" exitCode=0
Sep 11 17:09:36.009694 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:36.009655    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"
Sep 11 17:09:36.009906 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:36.009697    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t" event={"ID":"15ff337a-00d6-449b-aa62-035360fb9ac0","Type":"ContainerDied","Data":"94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef"}
Sep 11 17:09:36.009906 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:36.009756    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t" event={"ID":"15ff337a-00d6-449b-aa62-035360fb9ac0","Type":"ContainerDied","Data":"d421240626c6708ec250612b5552cccb39f394df6b6d6fbd7f1e7deb9d8b49e4"}
Sep 11 17:09:36.009906 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:36.009781    2569 scope.go:117] "RemoveContainer" containerID="94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef"
Sep 11 17:09:36.018643 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:36.018624    2569 scope.go:117] "RemoveContainer" containerID="94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef"
Sep 11 17:09:36.018937 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:09:36.018918    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef\": container with ID starting with 94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef not found: ID does not exist" containerID="94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef"
Sep 11 17:09:36.019024 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:36.018944    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef"} err="failed to get container status \"94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef\": rpc error: code = NotFound desc = could not find container \"94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef\": container with ID starting with 94e8e82f0d4867cc41d9cd296152346efb8b0ab876ecfc169e1a2d186d8586ef not found: ID does not exist"
Sep 11 17:09:36.026286 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:36.026266    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"]
Sep 11 17:09:36.033403 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:36.033383    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-bff65f-747cf9bf74-vvj7t"]
Sep 11 17:09:37.934741 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:09:37.934701    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ff337a-00d6-449b-aa62-035360fb9ac0" path="/var/lib/kubelet/pods/15ff337a-00d6-449b-aa62-035360fb9ac0/volumes"
Sep 11 17:10:17.116453 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116418    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7951-96fc0f"]
Sep 11 17:10:17.116862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116790    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9367e177-a531-4bbd-a838-7692e23ad5d7" containerName="payload-pre-processing"
Sep 11 17:10:17.116862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116822    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="9367e177-a531-4bbd-a838-7692e23ad5d7" containerName="payload-pre-processing"
Sep 11 17:10:17.116862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116832    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89deb2e2-26a3-4f4c-a735-61a20155fcb6" containerName="maas-api"
Sep 11 17:10:17.116862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116837    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="89deb2e2-26a3-4f4c-a735-61a20155fcb6" containerName="maas-api"
Sep 11 17:10:17.116862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116849    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2609bff4-3e7c-49e6-9978-894403249ee5" containerName="maas-api"
Sep 11 17:10:17.116862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116853    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="2609bff4-3e7c-49e6-9978-894403249ee5" containerName="maas-api"
Sep 11 17:10:17.116862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116863    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18055e96-446a-4706-92e6-f97ddfeed865" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116869    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="18055e96-446a-4706-92e6-f97ddfeed865" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116879    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3b0652d-de3a-425a-8a33-714fcfbf3470" containerName="payload-processing"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116885    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3b0652d-de3a-425a-8a33-714fcfbf3470" containerName="payload-processing"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116892    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116897    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116902    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0078a3a4-1502-4aab-97e4-45b6a04f934d" containerName="payload-processing"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116908    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0078a3a4-1502-4aab-97e4-45b6a04f934d" containerName="payload-processing"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116917    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116922    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116928    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ff337a-00d6-449b-aa62-035360fb9ac0" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116933    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ff337a-00d6-449b-aa62-035360fb9ac0" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116941    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.116945    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.117003    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="18055e96-446a-4706-92e6-f97ddfeed865" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.117012    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="2609bff4-3e7c-49e6-9978-894403249ee5" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.117017    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="9367e177-a531-4bbd-a838-7692e23ad5d7" containerName="payload-pre-processing"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.117022    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0494bbf-d00b-4bf4-a0e8-d089ccb2f830" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.117027    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.117032    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0078a3a4-1502-4aab-97e4-45b6a04f934d" containerName="payload-processing"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.117037    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ff337a-00d6-449b-aa62-035360fb9ac0" containerName="maas-api"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.117044    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3b0652d-de3a-425a-8a33-714fcfbf3470" containerName="payload-processing"
Sep 11 17:10:17.117098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.117049    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="89deb2e2-26a3-4f4c-a735-61a20155fcb6" containerName="maas-api"
Sep 11 17:10:17.119982 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.119965    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7951-96fc0f"
Sep 11 17:10:17.122345 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.122323    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-t2nxk\""
Sep 11 17:10:17.128507 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.128485    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7951-96fc0f"]
Sep 11 17:10:17.160248 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.160225    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwf7f\" (UniqueName: \"kubernetes.io/projected/0b39d35b-f295-4e72-8f49-16535f726b14-kube-api-access-bwf7f\") pod \"test-curl-7951-96fc0f\" (UID: \"0b39d35b-f295-4e72-8f49-16535f726b14\") " pod="opendatahub/test-curl-7951-96fc0f"
Sep 11 17:10:17.261115 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.261089    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwf7f\" (UniqueName: \"kubernetes.io/projected/0b39d35b-f295-4e72-8f49-16535f726b14-kube-api-access-bwf7f\") pod \"test-curl-7951-96fc0f\" (UID: \"0b39d35b-f295-4e72-8f49-16535f726b14\") " pod="opendatahub/test-curl-7951-96fc0f"
Sep 11 17:10:17.269645 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.269620    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwf7f\" (UniqueName: \"kubernetes.io/projected/0b39d35b-f295-4e72-8f49-16535f726b14-kube-api-access-bwf7f\") pod \"test-curl-7951-96fc0f\" (UID: \"0b39d35b-f295-4e72-8f49-16535f726b14\") " pod="opendatahub/test-curl-7951-96fc0f"
Sep 11 17:10:17.430051 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.429981    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7951-96fc0f"
Sep 11 17:10:17.702283 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:17.702260    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7951-96fc0f"]
Sep 11 17:10:17.704057 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:10:17.704032    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b39d35b_f295_4e72_8f49_16535f726b14.slice/crio-4ec6bc84b26c1d6264fbcf59444d06b9c031c90105f3e44b10706576ec25258b WatchSource:0}: Error finding container 4ec6bc84b26c1d6264fbcf59444d06b9c031c90105f3e44b10706576ec25258b: Status 404 returned error can't find the container with id 4ec6bc84b26c1d6264fbcf59444d06b9c031c90105f3e44b10706576ec25258b
Sep 11 17:10:18.246997 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:18.246963    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7951-96fc0f" event={"ID":"0b39d35b-f295-4e72-8f49-16535f726b14","Type":"ContainerStarted","Data":"3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428"}
Sep 11 17:10:18.247379 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:18.247008    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7951-96fc0f" event={"ID":"0b39d35b-f295-4e72-8f49-16535f726b14","Type":"ContainerStarted","Data":"4ec6bc84b26c1d6264fbcf59444d06b9c031c90105f3e44b10706576ec25258b"}
Sep 11 17:10:18.264836 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:18.264763    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7951-96fc0f" podStartSLOduration=1.264749136 podStartE2EDuration="1.264749136s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:10:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:10:18.261778044 +0000 UTC m=+1628.821169427" watchObservedRunningTime="2026-09-11 17:10:18.264749136 +0000 UTC m=+1628.824140579"
Sep 11 17:10:18.876153 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:18.876122    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7951-96fc0f"]
Sep 11 17:10:18.880536 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:18.880508    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7951-96fc0f"]
Sep 11 17:10:19.254202 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:10:19.254172    2569 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7951-96fc0f" container="test-curl-7951-96fc0f"
Sep 11 17:10:20.260054 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:20.260010    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7951-96fc0f" podUID="0b39d35b-f295-4e72-8f49-16535f726b14" containerName="test-curl-7951-96fc0f" containerID="cri-o://3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428" gracePeriod=2
Sep 11 17:10:22.437969 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:22.437941    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7951-96fc0f"
Sep 11 17:10:22.509900 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:22.509873    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwf7f\" (UniqueName: \"kubernetes.io/projected/0b39d35b-f295-4e72-8f49-16535f726b14-kube-api-access-bwf7f\") pod \"0b39d35b-f295-4e72-8f49-16535f726b14\" (UID: \"0b39d35b-f295-4e72-8f49-16535f726b14\") "
Sep 11 17:10:22.512084 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:22.512061    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b39d35b-f295-4e72-8f49-16535f726b14-kube-api-access-bwf7f" (OuterVolumeSpecName: "kube-api-access-bwf7f") pod "0b39d35b-f295-4e72-8f49-16535f726b14" (UID: "0b39d35b-f295-4e72-8f49-16535f726b14"). InnerVolumeSpecName "kube-api-access-bwf7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:10:22.611553 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:22.611520    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwf7f\" (UniqueName: \"kubernetes.io/projected/0b39d35b-f295-4e72-8f49-16535f726b14-kube-api-access-bwf7f\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:10:23.278252 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:23.278220    2569 generic.go:356] "Generic (PLEG): container finished" podID="0b39d35b-f295-4e72-8f49-16535f726b14" containerID="3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428" exitCode=137
Sep 11 17:10:23.278470 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:23.278274    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7951-96fc0f"
Sep 11 17:10:23.278470 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:23.278282    2569 scope.go:117] "RemoveContainer" containerID="3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428"
Sep 11 17:10:23.287759 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:23.287744    2569 scope.go:117] "RemoveContainer" containerID="3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428"
Sep 11 17:10:23.288062 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:10:23.288043    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428\": container with ID starting with 3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428 not found: ID does not exist" containerID="3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428"
Sep 11 17:10:23.288118 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:23.288071    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428"} err="failed to get container status \"3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428\": rpc error: code = NotFound desc = could not find container \"3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428\": container with ID starting with 3d71b182d060c66ce6c09b5ab3d1d59528462c8e4c8feaf82e8ac22579436428 not found: ID does not exist"
Sep 11 17:10:23.289713 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:10:23.289687    2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7951-96fc0f\" is forbidden: User \"system:node:ip-10-0-141-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-153.ec2.internal' and this object" podUID="0b39d35b-f295-4e72-8f49-16535f726b14" pod="opendatahub/test-curl-7951-96fc0f"
Sep 11 17:10:23.927623 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:23.927582    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b39d35b-f295-4e72-8f49-16535f726b14" path="/var/lib/kubelet/pods/0b39d35b-f295-4e72-8f49-16535f726b14/volumes"
Sep 11 17:10:44.647477 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:44.647447    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"]
Sep 11 17:10:44.648083 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:44.647757    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww" podUID="0c92104e-e85f-44ca-8456-ca0d8d16e00f" containerName="maas-api" containerID="cri-o://7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e" gracePeriod=30
Sep 11 17:10:45.120907 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.120880    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 17:10:45.228089 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.228057    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c92104e-e85f-44ca-8456-ca0d8d16e00f-openshift-service-ca\") pod \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") "
Sep 11 17:10:45.228089 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.228096    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-metrics-certs\") pod \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") "
Sep 11 17:10:45.228389 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.228118    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4r6v\" (UniqueName: \"kubernetes.io/projected/0c92104e-e85f-44ca-8456-ca0d8d16e00f-kube-api-access-v4r6v\") pod \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") "
Sep 11 17:10:45.228389 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.228141    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-maas-api-tls\") pod \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\" (UID: \"0c92104e-e85f-44ca-8456-ca0d8d16e00f\") "
Sep 11 17:10:45.228508 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.228430    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c92104e-e85f-44ca-8456-ca0d8d16e00f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c92104e-e85f-44ca-8456-ca0d8d16e00f" (UID: "0c92104e-e85f-44ca-8456-ca0d8d16e00f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:10:45.230479 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.230450    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c92104e-e85f-44ca-8456-ca0d8d16e00f-kube-api-access-v4r6v" (OuterVolumeSpecName: "kube-api-access-v4r6v") pod "0c92104e-e85f-44ca-8456-ca0d8d16e00f" (UID: "0c92104e-e85f-44ca-8456-ca0d8d16e00f"). InnerVolumeSpecName "kube-api-access-v4r6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:10:45.230594 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.230490    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0c92104e-e85f-44ca-8456-ca0d8d16e00f" (UID: "0c92104e-e85f-44ca-8456-ca0d8d16e00f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:10:45.230594 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.230501    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c92104e-e85f-44ca-8456-ca0d8d16e00f" (UID: "0c92104e-e85f-44ca-8456-ca0d8d16e00f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:10:45.329223 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.329194    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c92104e-e85f-44ca-8456-ca0d8d16e00f-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:10:45.329223 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.329221    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:10:45.329223 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.329230    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4r6v\" (UniqueName: \"kubernetes.io/projected/0c92104e-e85f-44ca-8456-ca0d8d16e00f-kube-api-access-v4r6v\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:10:45.329452 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.329238    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c92104e-e85f-44ca-8456-ca0d8d16e00f-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:10:45.404462 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.404423    2569 generic.go:356] "Generic (PLEG): container finished" podID="0c92104e-e85f-44ca-8456-ca0d8d16e00f" containerID="7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e" exitCode=0
Sep 11 17:10:45.404631 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.404483    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"
Sep 11 17:10:45.404631 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.404504    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww" event={"ID":"0c92104e-e85f-44ca-8456-ca0d8d16e00f","Type":"ContainerDied","Data":"7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e"}
Sep 11 17:10:45.404631 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.404583    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww" event={"ID":"0c92104e-e85f-44ca-8456-ca0d8d16e00f","Type":"ContainerDied","Data":"be139ad71fdc42cd4fd9c03ae3c624779eacf8bf51b3b2a48ff946469898f612"}
Sep 11 17:10:45.404631 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.404605    2569 scope.go:117] "RemoveContainer" containerID="7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e"
Sep 11 17:10:45.414824 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.414777    2569 scope.go:117] "RemoveContainer" containerID="7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e"
Sep 11 17:10:45.415132 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:10:45.415111    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e\": container with ID starting with 7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e not found: ID does not exist" containerID="7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e"
Sep 11 17:10:45.415181 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.415142    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e"} err="failed to get container status \"7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e\": rpc error: code = NotFound desc = could not find container \"7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e\": container with ID starting with 7fd7a04e3be4c4503b33be4ba531fa0c8684f4225b4ffe2a96d0f0805c20c56e not found: ID does not exist"
Sep 11 17:10:45.430641 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:10:45.430613    2569 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c92104e_e85f_44ca_8456_ca0d8d16e00f.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c92104e_e85f_44ca_8456_ca0d8d16e00f.slice/crio-be139ad71fdc42cd4fd9c03ae3c624779eacf8bf51b3b2a48ff946469898f612\": RecentStats: unable to find data in memory cache]"
Sep 11 17:10:45.431448 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.431076    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"]
Sep 11 17:10:45.435983 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.435963    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-2dc95c-6d97bfc9f-gm4ww"]
Sep 11 17:10:45.927211 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:10:45.927177    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c92104e-e85f-44ca-8456-ca0d8d16e00f" path="/var/lib/kubelet/pods/0c92104e-e85f-44ca-8456-ca0d8d16e00f/volumes"
Sep 11 17:13:34.481726 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.481684    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"]
Sep 11 17:13:34.482396 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.482374    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b39d35b-f295-4e72-8f49-16535f726b14" containerName="test-curl-7951-96fc0f"
Sep 11 17:13:34.482445 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.482402    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b39d35b-f295-4e72-8f49-16535f726b14" containerName="test-curl-7951-96fc0f"
Sep 11 17:13:34.482445 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.482422    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c92104e-e85f-44ca-8456-ca0d8d16e00f" containerName="maas-api"
Sep 11 17:13:34.482445 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.482431    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c92104e-e85f-44ca-8456-ca0d8d16e00f" containerName="maas-api"
Sep 11 17:13:34.482539 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.482528    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa7a4d33-3004-4e4c-bb73-8a94b55cb074" containerName="istio-proxy"
Sep 11 17:13:34.482576 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.482540    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c92104e-e85f-44ca-8456-ca0d8d16e00f" containerName="maas-api"
Sep 11 17:13:34.482576 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.482555    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b39d35b-f295-4e72-8f49-16535f726b14" containerName="test-curl-7951-96fc0f"
Sep 11 17:13:34.486099 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.486080    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.489711 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.489688    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-269ba8-serving-cert\""
Sep 11 17:13:34.493265 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.493242    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"]
Sep 11 17:13:34.546863 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.546830    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-metrics-certs\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.547029 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.546939    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-maas-api-tls\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.547029 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.546963    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/392d674e-2f52-4211-b118-9706b0f25f79-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.547029 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.547025    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9c5t\" (UniqueName: \"kubernetes.io/projected/392d674e-2f52-4211-b118-9706b0f25f79-kube-api-access-c9c5t\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.647966 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.647928    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9c5t\" (UniqueName: \"kubernetes.io/projected/392d674e-2f52-4211-b118-9706b0f25f79-kube-api-access-c9c5t\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.647966 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.647974    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-metrics-certs\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.648228 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.648033    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-maas-api-tls\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.648228 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.648057    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/392d674e-2f52-4211-b118-9706b0f25f79-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.648228 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:13:34.648166    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-serving-cert: secret "maas-api-e2e-ipp-a-269ba8-serving-cert" not found
Sep 11 17:13:34.648389 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:13:34.648248    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-maas-api-tls podName:392d674e-2f52-4211-b118-9706b0f25f79 nodeName:}" failed. No retries permitted until 2026-09-11 17:13:35.14823137 +0000 UTC m=+1825.707622738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-maas-api-tls") pod "maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg" (UID: "392d674e-2f52-4211-b118-9706b0f25f79") : secret "maas-api-e2e-ipp-a-269ba8-serving-cert" not found
Sep 11 17:13:34.648757 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.648740    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/392d674e-2f52-4211-b118-9706b0f25f79-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.650630 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.650613    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-metrics-certs\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:34.657585 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:34.657549    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9c5t\" (UniqueName: \"kubernetes.io/projected/392d674e-2f52-4211-b118-9706b0f25f79-kube-api-access-c9c5t\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:35.153940 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:35.153907    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-maas-api-tls\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:35.156350 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:35.156326    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-maas-api-tls\") pod \"maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:35.399554 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:35.399523    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:35.678608 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:35.678579    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"]
Sep 11 17:13:35.684914 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:13:35.684881    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod392d674e_2f52_4211_b118_9706b0f25f79.slice/crio-985e559ed20fdef3b1dd13ab3cc970a62d228b3510d7967ae7faf086e2266627 WatchSource:0}: Error finding container 985e559ed20fdef3b1dd13ab3cc970a62d228b3510d7967ae7faf086e2266627: Status 404 returned error can't find the container with id 985e559ed20fdef3b1dd13ab3cc970a62d228b3510d7967ae7faf086e2266627
Sep 11 17:13:35.686251 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:35.686235    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:13:36.346200 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:36.346163    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg" event={"ID":"392d674e-2f52-4211-b118-9706b0f25f79","Type":"ContainerStarted","Data":"985e559ed20fdef3b1dd13ab3cc970a62d228b3510d7967ae7faf086e2266627"}
Sep 11 17:13:37.352976 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:37.352940    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg" event={"ID":"392d674e-2f52-4211-b118-9706b0f25f79","Type":"ContainerStarted","Data":"9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752"}
Sep 11 17:13:37.353372 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:37.353027    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:13:37.374098 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:37.374045    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg" podStartSLOduration=2.7105571189999997 podStartE2EDuration="3.374029386s" totalImagesPullingTime="663.472267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:13:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:13:37.370336356 +0000 UTC m=+1827.929727742" watchObservedRunningTime="2026-09-11 17:13:37.374029386 +0000 UTC m=+1827.933420772"
Sep 11 17:13:43.370829 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:13:43.365097    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:14:05.230539 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.230497    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"]
Sep 11 17:14:05.234276 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.234255    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:05.236744 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.236724    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-750358-dockercfg-7k7g9\""
Sep 11 17:14:05.236862 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.236740    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-750358\""
Sep 11 17:14:05.243075 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.243047    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjjbj\" (UniqueName: \"kubernetes.io/projected/95d05175-73e1-4139-906c-d0b1c7743dd3-kube-api-access-gjjbj\") pod \"payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn\" (UID: \"95d05175-73e1-4139-906c-d0b1c7743dd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:05.243212 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.243182    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d05175-73e1-4139-906c-d0b1c7743dd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn\" (UID: \"95d05175-73e1-4139-906c-d0b1c7743dd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:05.244317 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.244294    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"]
Sep 11 17:14:05.344663 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.344616    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjjbj\" (UniqueName: \"kubernetes.io/projected/95d05175-73e1-4139-906c-d0b1c7743dd3-kube-api-access-gjjbj\") pod \"payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn\" (UID: \"95d05175-73e1-4139-906c-d0b1c7743dd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:05.344942 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.344747    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d05175-73e1-4139-906c-d0b1c7743dd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn\" (UID: \"95d05175-73e1-4139-906c-d0b1c7743dd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:05.345503 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.345480    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d05175-73e1-4139-906c-d0b1c7743dd3-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn\" (UID: \"95d05175-73e1-4139-906c-d0b1c7743dd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:05.352657 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.352624    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjjbj\" (UniqueName: \"kubernetes.io/projected/95d05175-73e1-4139-906c-d0b1c7743dd3-kube-api-access-gjjbj\") pod \"payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn\" (UID: \"95d05175-73e1-4139-906c-d0b1c7743dd3\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:05.545654 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.545568    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:05.832988 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:05.832964    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"]
Sep 11 17:14:05.835108 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:14:05.835081    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d05175_73e1_4139_906c_d0b1c7743dd3.slice/crio-4dbb3d3d79ca6654ca935f73ef34d79136eedd1bf5bd2442dcb50c4bbe43025a WatchSource:0}: Error finding container 4dbb3d3d79ca6654ca935f73ef34d79136eedd1bf5bd2442dcb50c4bbe43025a: Status 404 returned error can't find the container with id 4dbb3d3d79ca6654ca935f73ef34d79136eedd1bf5bd2442dcb50c4bbe43025a
Sep 11 17:14:06.514778 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:06.514740    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn" event={"ID":"95d05175-73e1-4139-906c-d0b1c7743dd3","Type":"ContainerStarted","Data":"4e0ae575d01b5dcca3699163c793e30202bd2df3b701ab8f10c599762df648b1"}
Sep 11 17:14:06.515222 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:06.514842    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn" event={"ID":"95d05175-73e1-4139-906c-d0b1c7743dd3","Type":"ContainerStarted","Data":"4dbb3d3d79ca6654ca935f73ef34d79136eedd1bf5bd2442dcb50c4bbe43025a"}
Sep 11 17:14:06.515222 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:06.514864    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:06.532169 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:06.532097    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn" podStartSLOduration=1.5320791059999999 podStartE2EDuration="1.532079106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:14:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:14:06.531462384 +0000 UTC m=+1857.090853772" watchObservedRunningTime="2026-09-11 17:14:06.532079106 +0000 UTC m=+1857.091470495"
Sep 11 17:14:17.522640 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:17.522608    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:14:31.719137 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:31.719021    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5s4b_4e2c7d46-084b-47f8-af94-a6f60302f4ab/payload-processing/0.log"
Sep 11 17:14:57.500043 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:14:57.500012    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5s4b_4e2c7d46-084b-47f8-af94-a6f60302f4ab/payload-processing/0.log"
Sep 11 17:15:04.756910 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.756876    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"]
Sep 11 17:15:04.761421 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.761399    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.763723 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.763703    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-891cc8-serving-cert\""
Sep 11 17:15:04.769593 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.769568    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"]
Sep 11 17:15:04.796084 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.796055    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.796223 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.796087    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mflh9\" (UniqueName: \"kubernetes.io/projected/16ff376c-39c6-496d-9b78-80ddca91a562-kube-api-access-mflh9\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.796223 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.796150    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ff376c-39c6-496d-9b78-80ddca91a562-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.796346 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.796243    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.897116 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.897083    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.897294 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.897132    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.897294 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:15:04.897226    2569 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-serving-cert: secret "maas-api-e2e-ipp-cleanup-891cc8-serving-cert" not found
Sep 11 17:15:04.897294 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.897258    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mflh9\" (UniqueName: \"kubernetes.io/projected/16ff376c-39c6-496d-9b78-80ddca91a562-kube-api-access-mflh9\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.897424 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:15:04.897305    2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-maas-api-tls podName:16ff376c-39c6-496d-9b78-80ddca91a562 nodeName:}" failed. No retries permitted until 2026-09-11 17:15:05.397283872 +0000 UTC m=+1915.956675251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9" (UID: "16ff376c-39c6-496d-9b78-80ddca91a562") : secret "maas-api-e2e-ipp-cleanup-891cc8-serving-cert" not found
Sep 11 17:15:04.897424 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.897384    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ff376c-39c6-496d-9b78-80ddca91a562-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.898042 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.898016    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ff376c-39c6-496d-9b78-80ddca91a562-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.899729 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.899707    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:04.905772 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:04.905752    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mflh9\" (UniqueName: \"kubernetes.io/projected/16ff376c-39c6-496d-9b78-80ddca91a562-kube-api-access-mflh9\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:05.403148 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.403112    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:05.406141 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.406111    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:05.478224 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.478195    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"]
Sep 11 17:15:05.481950 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.481935    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:05.484139 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.484119    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-891cc8\""
Sep 11 17:15:05.484245 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.484121    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-891cc8-dockercfg-lvdsn\""
Sep 11 17:15:05.495413 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.495388    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"]
Sep 11 17:15:05.504482 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.504456    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwspm\" (UniqueName: \"kubernetes.io/projected/f9ea91fd-3233-4bb9-9f58-b617334dabdd-kube-api-access-nwspm\") pod \"payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2\" (UID: \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:05.504585 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.504500    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9ea91fd-3233-4bb9-9f58-b617334dabdd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2\" (UID: \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:05.606073 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.606037    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwspm\" (UniqueName: \"kubernetes.io/projected/f9ea91fd-3233-4bb9-9f58-b617334dabdd-kube-api-access-nwspm\") pod \"payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2\" (UID: \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:05.606242 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.606085    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9ea91fd-3233-4bb9-9f58-b617334dabdd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2\" (UID: \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:05.606735 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.606715    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9ea91fd-3233-4bb9-9f58-b617334dabdd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2\" (UID: \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:05.617030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.617008    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwspm\" (UniqueName: \"kubernetes.io/projected/f9ea91fd-3233-4bb9-9f58-b617334dabdd-kube-api-access-nwspm\") pod \"payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2\" (UID: \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:05.677148 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.677080    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:05.793458 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.793422    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:05.958026 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:05.957988    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"]
Sep 11 17:15:05.964141 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:15:05.964105    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ff376c_39c6_496d_9b78_80ddca91a562.slice/crio-d2218f9d7552972ae86a8e41c7186a18ecdb05749a83721eca29b790f26c07d4 WatchSource:0}: Error finding container d2218f9d7552972ae86a8e41c7186a18ecdb05749a83721eca29b790f26c07d4: Status 404 returned error can't find the container with id d2218f9d7552972ae86a8e41c7186a18ecdb05749a83721eca29b790f26c07d4
Sep 11 17:15:06.069906 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:06.069882    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"]
Sep 11 17:15:06.071718 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:15:06.071689    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9ea91fd_3233_4bb9_9f58_b617334dabdd.slice/crio-64a8cd15b349928e8a71388da1c263903bf06632204420cbb911095604095068 WatchSource:0}: Error finding container 64a8cd15b349928e8a71388da1c263903bf06632204420cbb911095604095068: Status 404 returned error can't find the container with id 64a8cd15b349928e8a71388da1c263903bf06632204420cbb911095604095068
Sep 11 17:15:06.850607 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:06.850512    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9" event={"ID":"16ff376c-39c6-496d-9b78-80ddca91a562","Type":"ContainerStarted","Data":"5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb"}
Sep 11 17:15:06.850607 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:06.850591    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9" event={"ID":"16ff376c-39c6-496d-9b78-80ddca91a562","Type":"ContainerStarted","Data":"d2218f9d7552972ae86a8e41c7186a18ecdb05749a83721eca29b790f26c07d4"}
Sep 11 17:15:06.851115 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:06.850717    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:06.852442 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:06.852412    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2" event={"ID":"f9ea91fd-3233-4bb9-9f58-b617334dabdd","Type":"ContainerStarted","Data":"8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b"}
Sep 11 17:15:06.852582 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:06.852458    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2" event={"ID":"f9ea91fd-3233-4bb9-9f58-b617334dabdd","Type":"ContainerStarted","Data":"64a8cd15b349928e8a71388da1c263903bf06632204420cbb911095604095068"}
Sep 11 17:15:06.852582 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:06.852478    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:06.870092 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:06.870029    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9" podStartSLOduration=2.372603453 podStartE2EDuration="2.870015463s" totalImagesPullingTime="497.41201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:15:06.867535097 +0000 UTC m=+1917.426926484" watchObservedRunningTime="2026-09-11 17:15:06.870015463 +0000 UTC m=+1917.429406840"
Sep 11 17:15:06.885369 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:06.885324    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2" podStartSLOduration=1.8853115809999998 podStartE2EDuration="1.885311581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:15:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:15:06.883317255 +0000 UTC m=+1917.442708661" watchObservedRunningTime="2026-09-11 17:15:06.885311581 +0000 UTC m=+1917.444702968"
Sep 11 17:15:12.863981 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:12.863953    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:17.860979 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:17.860949    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:42.990206 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:42.990173    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"]
Sep 11 17:15:42.990812 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:42.990395    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9" podUID="16ff376c-39c6-496d-9b78-80ddca91a562" containerName="maas-api" containerID="cri-o://5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb" gracePeriod=30
Sep 11 17:15:43.050864 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.050827    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"]
Sep 11 17:15:43.051161 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.051080    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2" podUID="f9ea91fd-3233-4bb9-9f58-b617334dabdd" containerName="payload-pre-processing" containerID="cri-o://8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b" gracePeriod=30
Sep 11 17:15:43.296304 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.296276    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:43.337001 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.336975    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:43.362633 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.362604    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-metrics-certs\") pod \"16ff376c-39c6-496d-9b78-80ddca91a562\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") "
Sep 11 17:15:43.362633 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.362637    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-maas-api-tls\") pod \"16ff376c-39c6-496d-9b78-80ddca91a562\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") "
Sep 11 17:15:43.362889 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.362676    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mflh9\" (UniqueName: \"kubernetes.io/projected/16ff376c-39c6-496d-9b78-80ddca91a562-kube-api-access-mflh9\") pod \"16ff376c-39c6-496d-9b78-80ddca91a562\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") "
Sep 11 17:15:43.362889 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.362738    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9ea91fd-3233-4bb9-9f58-b617334dabdd-plugins-config-volume\") pod \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\" (UID: \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\") "
Sep 11 17:15:43.362889 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.362764    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ff376c-39c6-496d-9b78-80ddca91a562-openshift-service-ca\") pod \"16ff376c-39c6-496d-9b78-80ddca91a562\" (UID: \"16ff376c-39c6-496d-9b78-80ddca91a562\") "
Sep 11 17:15:43.362889 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.362812    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwspm\" (UniqueName: \"kubernetes.io/projected/f9ea91fd-3233-4bb9-9f58-b617334dabdd-kube-api-access-nwspm\") pod \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\" (UID: \"f9ea91fd-3233-4bb9-9f58-b617334dabdd\") "
Sep 11 17:15:43.363463 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.363417    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16ff376c-39c6-496d-9b78-80ddca91a562-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "16ff376c-39c6-496d-9b78-80ddca91a562" (UID: "16ff376c-39c6-496d-9b78-80ddca91a562"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:15:43.363959 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.363931    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9ea91fd-3233-4bb9-9f58-b617334dabdd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f9ea91fd-3233-4bb9-9f58-b617334dabdd" (UID: "f9ea91fd-3233-4bb9-9f58-b617334dabdd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:15:43.365211 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.365180    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "16ff376c-39c6-496d-9b78-80ddca91a562" (UID: "16ff376c-39c6-496d-9b78-80ddca91a562"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:15:43.365211 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.365191    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ff376c-39c6-496d-9b78-80ddca91a562-kube-api-access-mflh9" (OuterVolumeSpecName: "kube-api-access-mflh9") pod "16ff376c-39c6-496d-9b78-80ddca91a562" (UID: "16ff376c-39c6-496d-9b78-80ddca91a562"). InnerVolumeSpecName "kube-api-access-mflh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:15:43.365481 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.365464    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "16ff376c-39c6-496d-9b78-80ddca91a562" (UID: "16ff376c-39c6-496d-9b78-80ddca91a562"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:15:43.365776 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.365753    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9ea91fd-3233-4bb9-9f58-b617334dabdd-kube-api-access-nwspm" (OuterVolumeSpecName: "kube-api-access-nwspm") pod "f9ea91fd-3233-4bb9-9f58-b617334dabdd" (UID: "f9ea91fd-3233-4bb9-9f58-b617334dabdd"). InnerVolumeSpecName "kube-api-access-nwspm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:15:43.463928 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.463897    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:15:43.463928 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.463923    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16ff376c-39c6-496d-9b78-80ddca91a562-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:15:43.463928 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.463932    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mflh9\" (UniqueName: \"kubernetes.io/projected/16ff376c-39c6-496d-9b78-80ddca91a562-kube-api-access-mflh9\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:15:43.464175 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.463942    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f9ea91fd-3233-4bb9-9f58-b617334dabdd-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:15:43.464175 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.463952    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16ff376c-39c6-496d-9b78-80ddca91a562-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:15:43.464175 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:43.463959    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwspm\" (UniqueName: \"kubernetes.io/projected/f9ea91fd-3233-4bb9-9f58-b617334dabdd-kube-api-access-nwspm\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:15:44.069429 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.069398    2569 generic.go:356] "Generic (PLEG): container finished" podID="16ff376c-39c6-496d-9b78-80ddca91a562" containerID="5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb" exitCode=0
Sep 11 17:15:44.069939 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.069463    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"
Sep 11 17:15:44.069939 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.069477    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9" event={"ID":"16ff376c-39c6-496d-9b78-80ddca91a562","Type":"ContainerDied","Data":"5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb"}
Sep 11 17:15:44.069939 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.069529    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9" event={"ID":"16ff376c-39c6-496d-9b78-80ddca91a562","Type":"ContainerDied","Data":"d2218f9d7552972ae86a8e41c7186a18ecdb05749a83721eca29b790f26c07d4"}
Sep 11 17:15:44.069939 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.069555    2569 scope.go:117] "RemoveContainer" containerID="5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb"
Sep 11 17:15:44.071072 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.071049    2569 generic.go:356] "Generic (PLEG): container finished" podID="f9ea91fd-3233-4bb9-9f58-b617334dabdd" containerID="8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b" exitCode=0
Sep 11 17:15:44.071166 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.071099    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"
Sep 11 17:15:44.071166 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.071128    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2" event={"ID":"f9ea91fd-3233-4bb9-9f58-b617334dabdd","Type":"ContainerDied","Data":"8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b"}
Sep 11 17:15:44.071256 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.071174    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2" event={"ID":"f9ea91fd-3233-4bb9-9f58-b617334dabdd","Type":"ContainerDied","Data":"64a8cd15b349928e8a71388da1c263903bf06632204420cbb911095604095068"}
Sep 11 17:15:44.079174 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.079160    2569 scope.go:117] "RemoveContainer" containerID="5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb"
Sep 11 17:15:44.079441 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:15:44.079420    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb\": container with ID starting with 5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb not found: ID does not exist" containerID="5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb"
Sep 11 17:15:44.079487 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.079450    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb"} err="failed to get container status \"5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb\": rpc error: code = NotFound desc = could not find container \"5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb\": container with ID starting with 5c941c3eddc685e96c6b085ec6a685b7b6a03b6a60375395463a5c33921f7dcb not found: ID does not exist"
Sep 11 17:15:44.079487 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.079465    2569 scope.go:117] "RemoveContainer" containerID="8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b"
Sep 11 17:15:44.088431 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.088404    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"]
Sep 11 17:15:44.088641 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.088627    2569 scope.go:117] "RemoveContainer" containerID="8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b"
Sep 11 17:15:44.089019 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:15:44.088989    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b\": container with ID starting with 8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b not found: ID does not exist" containerID="8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b"
Sep 11 17:15:44.089148 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.089025    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b"} err="failed to get container status \"8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b\": rpc error: code = NotFound desc = could not find container \"8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b\": container with ID starting with 8ff9790ce2c4994f4dc8b190641129fcd30de473d14ac197e399656182861c8b not found: ID does not exist"
Sep 11 17:15:44.091159 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.091140    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-891cc8-b5c5867db-bnlk2"]
Sep 11 17:15:44.099407 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.099386    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"]
Sep 11 17:15:44.102679 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:44.102656    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-891cc8-67bf4896c7-lnwk9"]
Sep 11 17:15:45.928212 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:45.928168    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ff376c-39c6-496d-9b78-80ddca91a562" path="/var/lib/kubelet/pods/16ff376c-39c6-496d-9b78-80ddca91a562/volumes"
Sep 11 17:15:45.928728 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:15:45.928706    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9ea91fd-3233-4bb9-9f58-b617334dabdd" path="/var/lib/kubelet/pods/f9ea91fd-3233-4bb9-9f58-b617334dabdd/volumes"
Sep 11 17:16:09.895966 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:09.895930    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"]
Sep 11 17:16:09.896451 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:09.896171    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg" podUID="392d674e-2f52-4211-b118-9706b0f25f79" containerName="maas-api" containerID="cri-o://9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752" gracePeriod=30
Sep 11 17:16:10.154371 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.154310    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:16:10.225060 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.225028    2569 generic.go:356] "Generic (PLEG): container finished" podID="392d674e-2f52-4211-b118-9706b0f25f79" containerID="9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752" exitCode=0
Sep 11 17:16:10.225227 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.225071    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"
Sep 11 17:16:10.225227 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.225118    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg" event={"ID":"392d674e-2f52-4211-b118-9706b0f25f79","Type":"ContainerDied","Data":"9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752"}
Sep 11 17:16:10.225227 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.225165    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg" event={"ID":"392d674e-2f52-4211-b118-9706b0f25f79","Type":"ContainerDied","Data":"985e559ed20fdef3b1dd13ab3cc970a62d228b3510d7967ae7faf086e2266627"}
Sep 11 17:16:10.225227 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.225197    2569 scope.go:117] "RemoveContainer" containerID="9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752"
Sep 11 17:16:10.234113 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.234090    2569 scope.go:117] "RemoveContainer" containerID="9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752"
Sep 11 17:16:10.234461 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:16:10.234425    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752\": container with ID starting with 9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752 not found: ID does not exist" containerID="9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752"
Sep 11 17:16:10.234539 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.234474    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752"} err="failed to get container status \"9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752\": rpc error: code = NotFound desc = could not find container \"9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752\": container with ID starting with 9b18e560c0c0baa0afe2d7478780190056615fbcbeeed0d332bd9c3b3d471752 not found: ID does not exist"
Sep 11 17:16:10.311089 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.311051    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/392d674e-2f52-4211-b118-9706b0f25f79-openshift-service-ca\") pod \"392d674e-2f52-4211-b118-9706b0f25f79\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") "
Sep 11 17:16:10.311292 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.311147    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9c5t\" (UniqueName: \"kubernetes.io/projected/392d674e-2f52-4211-b118-9706b0f25f79-kube-api-access-c9c5t\") pod \"392d674e-2f52-4211-b118-9706b0f25f79\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") "
Sep 11 17:16:10.311292 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.311181    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-maas-api-tls\") pod \"392d674e-2f52-4211-b118-9706b0f25f79\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") "
Sep 11 17:16:10.311292 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.311243    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-metrics-certs\") pod \"392d674e-2f52-4211-b118-9706b0f25f79\" (UID: \"392d674e-2f52-4211-b118-9706b0f25f79\") "
Sep 11 17:16:10.311533 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.311480    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/392d674e-2f52-4211-b118-9706b0f25f79-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "392d674e-2f52-4211-b118-9706b0f25f79" (UID: "392d674e-2f52-4211-b118-9706b0f25f79"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:16:10.313517 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.313487    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "392d674e-2f52-4211-b118-9706b0f25f79" (UID: "392d674e-2f52-4211-b118-9706b0f25f79"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:16:10.313669 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.313633    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/392d674e-2f52-4211-b118-9706b0f25f79-kube-api-access-c9c5t" (OuterVolumeSpecName: "kube-api-access-c9c5t") pod "392d674e-2f52-4211-b118-9706b0f25f79" (UID: "392d674e-2f52-4211-b118-9706b0f25f79"). InnerVolumeSpecName "kube-api-access-c9c5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:16:10.313834 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.313780    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "392d674e-2f52-4211-b118-9706b0f25f79" (UID: "392d674e-2f52-4211-b118-9706b0f25f79"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:16:10.412436 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.412341    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/392d674e-2f52-4211-b118-9706b0f25f79-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:16:10.412436 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.412368    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9c5t\" (UniqueName: \"kubernetes.io/projected/392d674e-2f52-4211-b118-9706b0f25f79-kube-api-access-c9c5t\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:16:10.412436 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.412377    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:16:10.412436 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.412389    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/392d674e-2f52-4211-b118-9706b0f25f79-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:16:10.547237 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.547208    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"]
Sep 11 17:16:10.553233 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:10.553210    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-269ba8-68d77b475b-m7kbg"]
Sep 11 17:16:11.928404 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:16:11.928373    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="392d674e-2f52-4211-b118-9706b0f25f79" path="/var/lib/kubelet/pods/392d674e-2f52-4211-b118-9706b0f25f79/volumes"
Sep 11 17:17:10.313917 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.313881    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"]
Sep 11 17:17:10.314518 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.314162    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn" podUID="95d05175-73e1-4139-906c-d0b1c7743dd3" containerName="payload-pre-processing" containerID="cri-o://4e0ae575d01b5dcca3699163c793e30202bd2df3b701ab8f10c599762df648b1" gracePeriod=30
Sep 11 17:17:10.558169 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.558135    2569 generic.go:356] "Generic (PLEG): container finished" podID="95d05175-73e1-4139-906c-d0b1c7743dd3" containerID="4e0ae575d01b5dcca3699163c793e30202bd2df3b701ab8f10c599762df648b1" exitCode=0
Sep 11 17:17:10.558316 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.558204    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn" event={"ID":"95d05175-73e1-4139-906c-d0b1c7743dd3","Type":"ContainerDied","Data":"4e0ae575d01b5dcca3699163c793e30202bd2df3b701ab8f10c599762df648b1"}
Sep 11 17:17:10.558316 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.558248    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn" event={"ID":"95d05175-73e1-4139-906c-d0b1c7743dd3","Type":"ContainerDied","Data":"4dbb3d3d79ca6654ca935f73ef34d79136eedd1bf5bd2442dcb50c4bbe43025a"}
Sep 11 17:17:10.558316 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.558264    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dbb3d3d79ca6654ca935f73ef34d79136eedd1bf5bd2442dcb50c4bbe43025a"
Sep 11 17:17:10.569237 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.569165    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:17:10.674486 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.674450    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjjbj\" (UniqueName: \"kubernetes.io/projected/95d05175-73e1-4139-906c-d0b1c7743dd3-kube-api-access-gjjbj\") pod \"95d05175-73e1-4139-906c-d0b1c7743dd3\" (UID: \"95d05175-73e1-4139-906c-d0b1c7743dd3\") "
Sep 11 17:17:10.674639 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.674524    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d05175-73e1-4139-906c-d0b1c7743dd3-plugins-config-volume\") pod \"95d05175-73e1-4139-906c-d0b1c7743dd3\" (UID: \"95d05175-73e1-4139-906c-d0b1c7743dd3\") "
Sep 11 17:17:10.674977 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.674950    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95d05175-73e1-4139-906c-d0b1c7743dd3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "95d05175-73e1-4139-906c-d0b1c7743dd3" (UID: "95d05175-73e1-4139-906c-d0b1c7743dd3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:17:10.676887 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.676857    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95d05175-73e1-4139-906c-d0b1c7743dd3-kube-api-access-gjjbj" (OuterVolumeSpecName: "kube-api-access-gjjbj") pod "95d05175-73e1-4139-906c-d0b1c7743dd3" (UID: "95d05175-73e1-4139-906c-d0b1c7743dd3"). InnerVolumeSpecName "kube-api-access-gjjbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:17:10.775960 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.775926    2569 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/95d05175-73e1-4139-906c-d0b1c7743dd3-plugins-config-volume\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:10.775960 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:10.775960    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjjbj\" (UniqueName: \"kubernetes.io/projected/95d05175-73e1-4139-906c-d0b1c7743dd3-kube-api-access-gjjbj\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:11.563817 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:11.563770    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"
Sep 11 17:17:11.586359 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:11.586329    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"]
Sep 11 17:17:11.594578 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:11.594535    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-750358-698f985cf4-lbgmn"]
Sep 11 17:17:11.927996 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:11.927916    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95d05175-73e1-4139-906c-d0b1c7743dd3" path="/var/lib/kubelet/pods/95d05175-73e1-4139-906c-d0b1c7743dd3/volumes"
Sep 11 17:17:29.418740 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.418704    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"]
Sep 11 17:17:29.419200 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.418967    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52" podUID="7cd5b599-44c4-492e-b8cf-311a4c1b5a92" containerName="maas-api" containerID="cri-o://f93f1d80207e243a43f58f7452faa6efb40c9102e01a84d63355a2f11f5ee05f" gracePeriod=30
Sep 11 17:17:29.661818 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.661759    2569 generic.go:356] "Generic (PLEG): container finished" podID="7cd5b599-44c4-492e-b8cf-311a4c1b5a92" containerID="f93f1d80207e243a43f58f7452faa6efb40c9102e01a84d63355a2f11f5ee05f" exitCode=0
Sep 11 17:17:29.661943 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.661844    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52" event={"ID":"7cd5b599-44c4-492e-b8cf-311a4c1b5a92","Type":"ContainerDied","Data":"f93f1d80207e243a43f58f7452faa6efb40c9102e01a84d63355a2f11f5ee05f"}
Sep 11 17:17:29.661943 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.661906    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52" event={"ID":"7cd5b599-44c4-492e-b8cf-311a4c1b5a92","Type":"ContainerDied","Data":"8e7f6d4586dd96df11c32b95757e3487e7a477b721de016738367cf81af7e923"}
Sep 11 17:17:29.661943 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.661930    2569 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e7f6d4586dd96df11c32b95757e3487e7a477b721de016738367cf81af7e923"
Sep 11 17:17:29.670763 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.670705    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:17:29.748338 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.748306    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-maas-api-tls\") pod \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") "
Sep 11 17:17:29.748508 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.748350    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-metrics-certs\") pod \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") "
Sep 11 17:17:29.748508 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.748377    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wpg7\" (UniqueName: \"kubernetes.io/projected/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-kube-api-access-9wpg7\") pod \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") "
Sep 11 17:17:29.748508 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.748477    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-openshift-service-ca\") pod \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\" (UID: \"7cd5b599-44c4-492e-b8cf-311a4c1b5a92\") "
Sep 11 17:17:29.748858 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.748834    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7cd5b599-44c4-492e-b8cf-311a4c1b5a92" (UID: "7cd5b599-44c4-492e-b8cf-311a4c1b5a92"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:17:29.750745 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.750715    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-kube-api-access-9wpg7" (OuterVolumeSpecName: "kube-api-access-9wpg7") pod "7cd5b599-44c4-492e-b8cf-311a4c1b5a92" (UID: "7cd5b599-44c4-492e-b8cf-311a4c1b5a92"). InnerVolumeSpecName "kube-api-access-9wpg7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:17:29.750745 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.750732    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7cd5b599-44c4-492e-b8cf-311a4c1b5a92" (UID: "7cd5b599-44c4-492e-b8cf-311a4c1b5a92"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:17:29.750903 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.750771    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7cd5b599-44c4-492e-b8cf-311a4c1b5a92" (UID: "7cd5b599-44c4-492e-b8cf-311a4c1b5a92"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:17:29.849575 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.849547    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:29.849575 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.849573    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:29.849575 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.849582    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:29.849832 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:29.849590    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wpg7\" (UniqueName: \"kubernetes.io/projected/7cd5b599-44c4-492e-b8cf-311a4c1b5a92-kube-api-access-9wpg7\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:30.667584 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:30.667554    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"
Sep 11 17:17:30.685089 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:30.685064    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"]
Sep 11 17:17:30.689209 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:30.689186    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-2fae12-65f4dd88dd-djm52"]
Sep 11 17:17:31.927489 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:31.927394    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cd5b599-44c4-492e-b8cf-311a4c1b5a92" path="/var/lib/kubelet/pods/7cd5b599-44c4-492e-b8cf-311a4c1b5a92/volumes"
Sep 11 17:17:36.617974 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:36.617939    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"]
Sep 11 17:17:36.618456 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:36.618143    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy" containerID="cri-o://4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4" gracePeriod=30
Sep 11 17:17:41.867653 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.867620    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:17:41.870590 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.870570    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-envoy\") pod \"73583f3e-8aad-4e94-96ce-12218b6307ce\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") "
Sep 11 17:17:41.870705 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.870604    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73583f3e-8aad-4e94-96ce-12218b6307ce-istiod-ca-cert\") pod \"73583f3e-8aad-4e94-96ce-12218b6307ce\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") "
Sep 11 17:17:41.870705 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.870630    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-certs\") pod \"73583f3e-8aad-4e94-96ce-12218b6307ce\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") "
Sep 11 17:17:41.870705 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.870658    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-podinfo\") pod \"73583f3e-8aad-4e94-96ce-12218b6307ce\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") "
Sep 11 17:17:41.870705 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.870693    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-credential-socket\") pod \"73583f3e-8aad-4e94-96ce-12218b6307ce\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") "
Sep 11 17:17:41.870940 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.870712    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-token\") pod \"73583f3e-8aad-4e94-96ce-12218b6307ce\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") "
Sep 11 17:17:41.870940 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.870733    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-socket\") pod \"73583f3e-8aad-4e94-96ce-12218b6307ce\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") "
Sep 11 17:17:41.871048 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.870944    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "73583f3e-8aad-4e94-96ce-12218b6307ce" (UID: "73583f3e-8aad-4e94-96ce-12218b6307ce"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:17:41.871048 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871028    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpq5z\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-kube-api-access-qpq5z\") pod \"73583f3e-8aad-4e94-96ce-12218b6307ce\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") "
Sep 11 17:17:41.871048 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871038    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "73583f3e-8aad-4e94-96ce-12218b6307ce" (UID: "73583f3e-8aad-4e94-96ce-12218b6307ce"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:17:41.871214 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871062    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "73583f3e-8aad-4e94-96ce-12218b6307ce" (UID: "73583f3e-8aad-4e94-96ce-12218b6307ce"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:17:41.871214 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871074    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-data\") pod \"73583f3e-8aad-4e94-96ce-12218b6307ce\" (UID: \"73583f3e-8aad-4e94-96ce-12218b6307ce\") "
Sep 11 17:17:41.871214 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871122    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73583f3e-8aad-4e94-96ce-12218b6307ce-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "73583f3e-8aad-4e94-96ce-12218b6307ce" (UID: "73583f3e-8aad-4e94-96ce-12218b6307ce"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:17:41.871390 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871239    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-data" (OuterVolumeSpecName: "istio-data") pod "73583f3e-8aad-4e94-96ce-12218b6307ce" (UID: "73583f3e-8aad-4e94-96ce-12218b6307ce"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:17:41.871450 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871430    2569 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-credential-socket\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:41.871507 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871457    2569 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-socket\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:41.871507 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871472    2569 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-data\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:41.871507 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871485    2569 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/73583f3e-8aad-4e94-96ce-12218b6307ce-istiod-ca-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:41.871507 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.871497    2569 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-workload-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:41.873049 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.873021    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "73583f3e-8aad-4e94-96ce-12218b6307ce" (UID: "73583f3e-8aad-4e94-96ce-12218b6307ce"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:17:41.873185 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.873161    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-token" (OuterVolumeSpecName: "istio-token") pod "73583f3e-8aad-4e94-96ce-12218b6307ce" (UID: "73583f3e-8aad-4e94-96ce-12218b6307ce"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:17:41.873286 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.873268    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-kube-api-access-qpq5z" (OuterVolumeSpecName: "kube-api-access-qpq5z") pod "73583f3e-8aad-4e94-96ce-12218b6307ce" (UID: "73583f3e-8aad-4e94-96ce-12218b6307ce"). InnerVolumeSpecName "kube-api-access-qpq5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:17:41.873286 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.873278    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "73583f3e-8aad-4e94-96ce-12218b6307ce" (UID: "73583f3e-8aad-4e94-96ce-12218b6307ce"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:17:41.972004 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.971981    2569 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-envoy\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:41.972004 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.972002    2569 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-podinfo\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:41.972179 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.972010    2569 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-istio-token\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:41.972179 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:41.972019    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpq5z\" (UniqueName: \"kubernetes.io/projected/73583f3e-8aad-4e94-96ce-12218b6307ce-kube-api-access-qpq5z\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:42.735995 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.735960    2569 generic.go:356] "Generic (PLEG): container finished" podID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerID="4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4" exitCode=0
Sep 11 17:17:42.736169 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.736013    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"
Sep 11 17:17:42.736169 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.736041    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" event={"ID":"73583f3e-8aad-4e94-96ce-12218b6307ce","Type":"ContainerDied","Data":"4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4"}
Sep 11 17:17:42.736169 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.736094    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr" event={"ID":"73583f3e-8aad-4e94-96ce-12218b6307ce","Type":"ContainerDied","Data":"5b01193052cb2e5cb0a3d28beb96454c9991ce6aff4fa25105ca65a157d3f4c8"}
Sep 11 17:17:42.736169 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.736124    2569 scope.go:117] "RemoveContainer" containerID="4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4"
Sep 11 17:17:42.745386 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.745363    2569 scope.go:117] "RemoveContainer" containerID="414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859"
Sep 11 17:17:42.754009 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.753982    2569 scope.go:117] "RemoveContainer" containerID="4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4"
Sep 11 17:17:42.754343 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:17:42.754321    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4\": container with ID starting with 4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4 not found: ID does not exist" containerID="4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4"
Sep 11 17:17:42.754422 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.754351    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4"} err="failed to get container status \"4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4\": rpc error: code = NotFound desc = could not find container \"4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4\": container with ID starting with 4ca3a5a10e000fbcf0608884cb921590067300e13647f3365b0593f9703ca8c4 not found: ID does not exist"
Sep 11 17:17:42.754422 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.754368    2569 scope.go:117] "RemoveContainer" containerID="414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859"
Sep 11 17:17:42.754605 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:17:42.754580    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859\": container with ID starting with 414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859 not found: ID does not exist" containerID="414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859"
Sep 11 17:17:42.754668 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.754612    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859"} err="failed to get container status \"414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859\": rpc error: code = NotFound desc = could not find container \"414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859\": container with ID starting with 414e4065d1046cad78597db5905484fe4bf0efb3de8a8722e833d0bab6476859 not found: ID does not exist"
Sep 11 17:17:42.756497 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.756474    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"]
Sep 11 17:17:42.759908 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:42.759888    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-2fae12-openshift-default-6c64849794-jg8hr"]
Sep 11 17:17:43.926922 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:43.926890    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" path="/var/lib/kubelet/pods/73583f3e-8aad-4e94-96ce-12218b6307ce/volumes"
Sep 11 17:17:47.583984 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.583920    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"]
Sep 11 17:17:47.584488 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.584257    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx" podUID="310d540a-bf28-43a4-934e-a43178f7c2bd" containerName="maas-api" containerID="cri-o://3dde16434a6ed1fc5a95b7b5267b06de2eb677650aa015a223b442532353e8d7" gracePeriod=30
Sep 11 17:17:47.768440 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.768351    2569 generic.go:356] "Generic (PLEG): container finished" podID="310d540a-bf28-43a4-934e-a43178f7c2bd" containerID="3dde16434a6ed1fc5a95b7b5267b06de2eb677650aa015a223b442532353e8d7" exitCode=0
Sep 11 17:17:47.768440 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.768400    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx" event={"ID":"310d540a-bf28-43a4-934e-a43178f7c2bd","Type":"ContainerDied","Data":"3dde16434a6ed1fc5a95b7b5267b06de2eb677650aa015a223b442532353e8d7"}
Sep 11 17:17:47.830698 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.830675    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:17:47.924645 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.924563    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-metrics-certs\") pod \"310d540a-bf28-43a4-934e-a43178f7c2bd\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") "
Sep 11 17:17:47.924845 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.924641    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/310d540a-bf28-43a4-934e-a43178f7c2bd-openshift-service-ca\") pod \"310d540a-bf28-43a4-934e-a43178f7c2bd\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") "
Sep 11 17:17:47.924845 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.924687    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8c5f\" (UniqueName: \"kubernetes.io/projected/310d540a-bf28-43a4-934e-a43178f7c2bd-kube-api-access-v8c5f\") pod \"310d540a-bf28-43a4-934e-a43178f7c2bd\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") "
Sep 11 17:17:47.924845 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.924749    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-maas-api-tls\") pod \"310d540a-bf28-43a4-934e-a43178f7c2bd\" (UID: \"310d540a-bf28-43a4-934e-a43178f7c2bd\") "
Sep 11 17:17:47.925061 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.925030    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/310d540a-bf28-43a4-934e-a43178f7c2bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "310d540a-bf28-43a4-934e-a43178f7c2bd" (UID: "310d540a-bf28-43a4-934e-a43178f7c2bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:17:47.927114 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.927079    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "310d540a-bf28-43a4-934e-a43178f7c2bd" (UID: "310d540a-bf28-43a4-934e-a43178f7c2bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:17:47.927114 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.927086    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/310d540a-bf28-43a4-934e-a43178f7c2bd-kube-api-access-v8c5f" (OuterVolumeSpecName: "kube-api-access-v8c5f") pod "310d540a-bf28-43a4-934e-a43178f7c2bd" (UID: "310d540a-bf28-43a4-934e-a43178f7c2bd"). InnerVolumeSpecName "kube-api-access-v8c5f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:17:47.927302 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:47.927281    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "310d540a-bf28-43a4-934e-a43178f7c2bd" (UID: "310d540a-bf28-43a4-934e-a43178f7c2bd"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:17:48.025860 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:48.025824    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:48.025860 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:48.025856    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/310d540a-bf28-43a4-934e-a43178f7c2bd-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:48.026052 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:48.025869    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/310d540a-bf28-43a4-934e-a43178f7c2bd-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:48.026052 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:48.025884    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8c5f\" (UniqueName: \"kubernetes.io/projected/310d540a-bf28-43a4-934e-a43178f7c2bd-kube-api-access-v8c5f\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:48.776587 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:48.776554    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"
Sep 11 17:17:48.777076 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:48.776579    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx" event={"ID":"310d540a-bf28-43a4-934e-a43178f7c2bd","Type":"ContainerDied","Data":"58a39e6fc59bb8e2d1d98593920140c585dabd98e03e6ea596aaf3127772896b"}
Sep 11 17:17:48.777076 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:48.776655    2569 scope.go:117] "RemoveContainer" containerID="3dde16434a6ed1fc5a95b7b5267b06de2eb677650aa015a223b442532353e8d7"
Sep 11 17:17:48.793856 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:48.793832    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"]
Sep 11 17:17:48.798899 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:48.798879    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-327a3a-6cddb47479-2qxqx"]
Sep 11 17:17:49.926925 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:49.926882    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="310d540a-bf28-43a4-934e-a43178f7c2bd" path="/var/lib/kubelet/pods/310d540a-bf28-43a4-934e-a43178f7c2bd/volumes"
Sep 11 17:17:57.963369 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:57.963332    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76848564f6-hps52"]
Sep 11 17:17:57.963780 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:57.963546    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76848564f6-hps52" podUID="ccdea22a-6b42-45cb-a78e-9a00bc89f6d9" containerName="manager" containerID="cri-o://aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109" gracePeriod=30
Sep 11 17:17:58.215752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.215698    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 17:17:58.318306 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.318275    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m59pw\" (UniqueName: \"kubernetes.io/projected/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-kube-api-access-m59pw\") pod \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") "
Sep 11 17:17:58.318474 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.318383    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-webhook-cert\") pod \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") "
Sep 11 17:17:58.318474 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.318442    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-metrics-certs\") pod \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\" (UID: \"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9\") "
Sep 11 17:17:58.320388 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.320358    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-kube-api-access-m59pw" (OuterVolumeSpecName: "kube-api-access-m59pw") pod "ccdea22a-6b42-45cb-a78e-9a00bc89f6d9" (UID: "ccdea22a-6b42-45cb-a78e-9a00bc89f6d9"). InnerVolumeSpecName "kube-api-access-m59pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:17:58.320507 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.320418    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ccdea22a-6b42-45cb-a78e-9a00bc89f6d9" (UID: "ccdea22a-6b42-45cb-a78e-9a00bc89f6d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:17:58.320552 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.320540    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ccdea22a-6b42-45cb-a78e-9a00bc89f6d9" (UID: "ccdea22a-6b42-45cb-a78e-9a00bc89f6d9"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:17:58.419560 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.419526    2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-webhook-cert\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:58.419560 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.419553    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:58.419560 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.419563    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m59pw\" (UniqueName: \"kubernetes.io/projected/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9-kube-api-access-m59pw\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:17:58.834096 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.834060    2569 generic.go:356] "Generic (PLEG): container finished" podID="ccdea22a-6b42-45cb-a78e-9a00bc89f6d9" containerID="aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109" exitCode=0
Sep 11 17:17:58.834267 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.834104    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76848564f6-hps52"
Sep 11 17:17:58.834267 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.834149    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76848564f6-hps52" event={"ID":"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9","Type":"ContainerDied","Data":"aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109"}
Sep 11 17:17:58.834267 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.834198    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76848564f6-hps52" event={"ID":"ccdea22a-6b42-45cb-a78e-9a00bc89f6d9","Type":"ContainerDied","Data":"586add84aedc2f8429b3ab51597179ece5eb1313b1e4daefcf035c518f93dc8d"}
Sep 11 17:17:58.834267 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.834220    2569 scope.go:117] "RemoveContainer" containerID="aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109"
Sep 11 17:17:58.844269 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.844254    2569 scope.go:117] "RemoveContainer" containerID="aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109"
Sep 11 17:17:58.844535 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:17:58.844513    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109\": container with ID starting with aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109 not found: ID does not exist" containerID="aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109"
Sep 11 17:17:58.844603 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.844544    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109"} err="failed to get container status \"aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109\": rpc error: code = NotFound desc = could not find container \"aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109\": container with ID starting with aea7db05b5ceac9a79bf2fafd359bebe55de85d25c39f04b67f2b32c9023e109 not found: ID does not exist"
Sep 11 17:17:58.862846 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.862827    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76848564f6-hps52"]
Sep 11 17:17:58.865621 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:58.865601    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76848564f6-hps52"]
Sep 11 17:17:59.927295 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:17:59.927266    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccdea22a-6b42-45cb-a78e-9a00bc89f6d9" path="/var/lib/kubelet/pods/ccdea22a-6b42-45cb-a78e-9a00bc89f6d9/volumes"
Sep 11 17:18:10.370529 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:18:10.364910    2569 scope.go:117] "RemoveContainer" containerID="f93f1d80207e243a43f58f7452faa6efb40c9102e01a84d63355a2f11f5ee05f"
Sep 11 17:20:10.417562 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:20:10.417527    2569 scope.go:117] "RemoveContainer" containerID="4e0ae575d01b5dcca3699163c793e30202bd2df3b701ab8f10c599762df648b1"
Sep 11 17:23:45.104310 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104235    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"]
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104628    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95d05175-73e1-4139-906c-d0b1c7743dd3" containerName="payload-pre-processing"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104641    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="95d05175-73e1-4139-906c-d0b1c7743dd3" containerName="payload-pre-processing"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104651    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9ea91fd-3233-4bb9-9f58-b617334dabdd" containerName="payload-pre-processing"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104657    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9ea91fd-3233-4bb9-9f58-b617334dabdd" containerName="payload-pre-processing"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104671    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104677    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104687    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="392d674e-2f52-4211-b118-9706b0f25f79" containerName="maas-api"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104692    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="392d674e-2f52-4211-b118-9706b0f25f79" containerName="maas-api"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104698    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="310d540a-bf28-43a4-934e-a43178f7c2bd" containerName="maas-api"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104704    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="310d540a-bf28-43a4-934e-a43178f7c2bd" containerName="maas-api"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104713    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccdea22a-6b42-45cb-a78e-9a00bc89f6d9" containerName="manager"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104718    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccdea22a-6b42-45cb-a78e-9a00bc89f6d9" containerName="manager"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104723    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ff376c-39c6-496d-9b78-80ddca91a562" containerName="maas-api"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104728    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ff376c-39c6-496d-9b78-80ddca91a562" containerName="maas-api"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104739    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cd5b599-44c4-492e-b8cf-311a4c1b5a92" containerName="maas-api"
Sep 11 17:23:45.104752 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104744    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cd5b599-44c4-492e-b8cf-311a4c1b5a92" containerName="maas-api"
Sep 11 17:23:45.105269 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104818    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy"
Sep 11 17:23:45.105269 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104826    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="310d540a-bf28-43a4-934e-a43178f7c2bd" containerName="maas-api"
Sep 11 17:23:45.105269 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104832    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="392d674e-2f52-4211-b118-9706b0f25f79" containerName="maas-api"
Sep 11 17:23:45.105269 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104838    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="95d05175-73e1-4139-906c-d0b1c7743dd3" containerName="payload-pre-processing"
Sep 11 17:23:45.105269 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104844    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ff376c-39c6-496d-9b78-80ddca91a562" containerName="maas-api"
Sep 11 17:23:45.105269 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104851    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9ea91fd-3233-4bb9-9f58-b617334dabdd" containerName="payload-pre-processing"
Sep 11 17:23:45.105269 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104857    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cd5b599-44c4-492e-b8cf-311a4c1b5a92" containerName="maas-api"
Sep 11 17:23:45.105269 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.104863    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccdea22a-6b42-45cb-a78e-9a00bc89f6d9" containerName="manager"
Sep 11 17:23:45.107846 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.107829    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.126932 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.126898    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"]
Sep 11 17:23:45.186507 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.186474    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-metrics-certs\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.186693 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.186524    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-openshift-service-ca\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.186693 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.186591    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6btvn\" (UniqueName: \"kubernetes.io/projected/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-kube-api-access-6btvn\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.186693 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.186645    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-maas-api-tls\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.287276 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.287233    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-metrics-certs\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.287468 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.287285    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-openshift-service-ca\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.287468 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.287328    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6btvn\" (UniqueName: \"kubernetes.io/projected/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-kube-api-access-6btvn\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.287468 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.287373    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-maas-api-tls\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.288106 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.288055    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-openshift-service-ca\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.289930 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.289903    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-maas-api-tls\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.290112 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.290093    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-metrics-certs\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.295680 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.295660    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6btvn\" (UniqueName: \"kubernetes.io/projected/6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f-kube-api-access-6btvn\") pod \"maas-api-bf6cf69f6-xlcnk\" (UID: \"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f\") " pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.418366 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.418280    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:45.695382 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.695354    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"]
Sep 11 17:23:45.696656 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:23:45.696620    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6366bdb9_dbe6_4dcf_8ea8_aeca8aecbf8f.slice/crio-9bced84f6d39a326a4a9da4f7b962adce285cca5b88c1613f9da34ac36d81c09 WatchSource:0}: Error finding container 9bced84f6d39a326a4a9da4f7b962adce285cca5b88c1613f9da34ac36d81c09: Status 404 returned error can't find the container with id 9bced84f6d39a326a4a9da4f7b962adce285cca5b88c1613f9da34ac36d81c09
Sep 11 17:23:45.697863 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:45.697846    2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:23:46.673930 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:46.673838    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk" event={"ID":"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f","Type":"ContainerStarted","Data":"a1625cf3472299349dc8740e028f9ac94457f879fe5deed5a72ca279bf92b0a5"}
Sep 11 17:23:46.674281 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:46.673933    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk" event={"ID":"6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f","Type":"ContainerStarted","Data":"9bced84f6d39a326a4a9da4f7b962adce285cca5b88c1613f9da34ac36d81c09"}
Sep 11 17:23:46.674281 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:46.673962    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:23:46.691177 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:46.691128    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk" podStartSLOduration=1.131106472 podStartE2EDuration="1.691110081s" totalImagesPullingTime="560.003609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:23:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:23:46.690060508 +0000 UTC m=+2437.249451895" watchObservedRunningTime="2026-09-11 17:23:46.691110081 +0000 UTC m=+2437.250501469"
Sep 11 17:23:52.685521 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:23:52.685490    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-bf6cf69f6-xlcnk"
Sep 11 17:24:00.035229 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:00.035195    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"]
Sep 11 17:24:00.035692 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:00.035394    2569 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g" podUID="446a72f0-96f1-4402-ac4d-a7d24c5285fe" containerName="maas-api" containerID="cri-o://e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0" gracePeriod=30
Sep 11 17:24:01.284970 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.284944    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 17:24:01.441774 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.441749    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a72f0-96f1-4402-ac4d-a7d24c5285fe-openshift-service-ca\") pod \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") "
Sep 11 17:24:01.441964 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.441780    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5rrk\" (UniqueName: \"kubernetes.io/projected/446a72f0-96f1-4402-ac4d-a7d24c5285fe-kube-api-access-l5rrk\") pod \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") "
Sep 11 17:24:01.441964 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.441906    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-metrics-certs\") pod \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") "
Sep 11 17:24:01.441964 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.441929    2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-maas-api-tls\") pod \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\" (UID: \"446a72f0-96f1-4402-ac4d-a7d24c5285fe\") "
Sep 11 17:24:01.442231 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.442197    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/446a72f0-96f1-4402-ac4d-a7d24c5285fe-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "446a72f0-96f1-4402-ac4d-a7d24c5285fe" (UID: "446a72f0-96f1-4402-ac4d-a7d24c5285fe"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:24:01.444222 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.444190    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "446a72f0-96f1-4402-ac4d-a7d24c5285fe" (UID: "446a72f0-96f1-4402-ac4d-a7d24c5285fe"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:24:01.444222 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.444208    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/446a72f0-96f1-4402-ac4d-a7d24c5285fe-kube-api-access-l5rrk" (OuterVolumeSpecName: "kube-api-access-l5rrk") pod "446a72f0-96f1-4402-ac4d-a7d24c5285fe" (UID: "446a72f0-96f1-4402-ac4d-a7d24c5285fe"). InnerVolumeSpecName "kube-api-access-l5rrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:24:01.444222 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.444209    2569 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "446a72f0-96f1-4402-ac4d-a7d24c5285fe" (UID: "446a72f0-96f1-4402-ac4d-a7d24c5285fe"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:24:01.542815 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.542774    2569 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-metrics-certs\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:24:01.542990 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.542831    2569 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/446a72f0-96f1-4402-ac4d-a7d24c5285fe-maas-api-tls\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:24:01.542990 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.542845    2569 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/446a72f0-96f1-4402-ac4d-a7d24c5285fe-openshift-service-ca\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:24:01.542990 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.542857    2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5rrk\" (UniqueName: \"kubernetes.io/projected/446a72f0-96f1-4402-ac4d-a7d24c5285fe-kube-api-access-l5rrk\") on node \"ip-10-0-141-153.ec2.internal\" DevicePath \"\""
Sep 11 17:24:01.753730 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.753645    2569 generic.go:356] "Generic (PLEG): container finished" podID="446a72f0-96f1-4402-ac4d-a7d24c5285fe" containerID="e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0" exitCode=0
Sep 11 17:24:01.753730 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.753690    2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"
Sep 11 17:24:01.753947 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.753680    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g" event={"ID":"446a72f0-96f1-4402-ac4d-a7d24c5285fe","Type":"ContainerDied","Data":"e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0"}
Sep 11 17:24:01.753947 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.753844    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g" event={"ID":"446a72f0-96f1-4402-ac4d-a7d24c5285fe","Type":"ContainerDied","Data":"d6fde2fa7873a64587c8a27a1579a6e944c88b1dbd2dc41a0a3d7edfbf49dcc2"}
Sep 11 17:24:01.753947 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.753871    2569 scope.go:117] "RemoveContainer" containerID="e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0"
Sep 11 17:24:01.763597 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.763580    2569 scope.go:117] "RemoveContainer" containerID="e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0"
Sep 11 17:24:01.763903 ip-10-0-141-153 kubenswrapper[2569]: E0911 17:24:01.763885    2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0\": container with ID starting with e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0 not found: ID does not exist" containerID="e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0"
Sep 11 17:24:01.763983 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.763917    2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0"} err="failed to get container status \"e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0\": rpc error: code = NotFound desc = could not find container \"e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0\": container with ID starting with e54bd0162af6dddf9943c2802d6e293e6a7be0c560325a7e142bfbe7369ee3b0 not found: ID does not exist"
Sep 11 17:24:01.775554 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.775527    2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"]
Sep 11 17:24:01.779333 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.779310    2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-67d5b455cb-tfj4g"]
Sep 11 17:24:01.927263 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:01.927225    2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="446a72f0-96f1-4402-ac4d-a7d24c5285fe" path="/var/lib/kubelet/pods/446a72f0-96f1-4402-ac4d-a7d24c5285fe/volumes"
Sep 11 17:24:14.986343 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:14.986314    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f75f57858-8gjcs_5959daf5-9528-47b1-bfd6-ff0c87958429/authorino/0.log"
Sep 11 17:24:21.534654 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:21.534625    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d67cb4f96-jdqj2_7ed7d727-98f0-41b3-a4e4-66cd0591d617/copy-manifests/0.log"
Sep 11 17:24:21.548486 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:21.548460    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d67cb4f96-jdqj2_7ed7d727-98f0-41b3-a4e4-66cd0591d617/manager/0.log"
Sep 11 17:24:22.302094 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:22.302068    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-bf6cf69f6-xlcnk_6366bdb9-dbe6-4dcf-8ea8-aeca8aecbf8f/maas-api/0.log"
Sep 11 17:24:22.670181 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:22.670099    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-7f9kc_b3210624-30e9-4186-9bca-d66bf46caa71/postgres/0.log"
Sep 11 17:24:23.528061 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:23.528035    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f75f57858-8gjcs_5959daf5-9528-47b1-bfd6-ff0c87958429/authorino/0.log"
Sep 11 17:24:23.773335 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:23.773308    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-xzf47_f0ab266b-6798-4080-ab76-d8e111848b37/manager/0.log"
Sep 11 17:24:23.899466 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:23.899389    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-zvbkg_d421d759-1129-4a5d-8cff-1a64870c963c/kuadrant-console-plugin/0.log"
Sep 11 17:24:24.943591 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:24.943559    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75dc676c8d-f6b82_fd3eed86-d6d9-4fac-9a91-993a06d2c0c1/kube-auth-proxy/0.log"
Sep 11 17:24:25.445375 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:25.445349    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5s4b_4e2c7d46-084b-47f8-af94-a6f60302f4ab/payload-processing/0.log"
Sep 11 17:24:26.063113 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:26.063083    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-cld26_af98d97a-7eef-4a98-9750-87d3de761e87/main/0.log"
Sep 11 17:24:26.699764 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:26.699741    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-p6sfl_0d8a93a2-693a-4b64-9509-d1fbaf4bff1b/main/0.log"
Sep 11 17:24:35.253235 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:35.253204    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xxksk_f761960a-5ee4-4ce3-a071-2ac47c95f963/global-pull-secret-syncer/0.log"
Sep 11 17:24:35.344296 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:35.344272    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-v64tp_880d46a9-faf3-4a41-94aa-67a41da118ea/konnectivity-agent/0.log"
Sep 11 17:24:35.416657 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:35.416633    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-153.ec2.internal_1032e07a96b02bfcfeb61cb48d83063d/haproxy/0.log"
Sep 11 17:24:39.643096 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:39.643054    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6f75f57858-8gjcs_5959daf5-9528-47b1-bfd6-ff0c87958429/authorino/0.log"
Sep 11 17:24:39.719187 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:39.719160    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-xzf47_f0ab266b-6798-4080-ab76-d8e111848b37/manager/0.log"
Sep 11 17:24:39.744282 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:39.744258    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-zvbkg_d421d759-1129-4a5d-8cff-1a64870c963c/kuadrant-console-plugin/0.log"
Sep 11 17:24:41.414161 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.414130    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb4a28d4-19ab-4bc4-bafd-e873723e32fd/alertmanager/0.log"
Sep 11 17:24:41.434558 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.434531    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb4a28d4-19ab-4bc4-bafd-e873723e32fd/config-reloader/0.log"
Sep 11 17:24:41.462046 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.462023    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb4a28d4-19ab-4bc4-bafd-e873723e32fd/kube-rbac-proxy-web/0.log"
Sep 11 17:24:41.485689 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.485669    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb4a28d4-19ab-4bc4-bafd-e873723e32fd/kube-rbac-proxy/0.log"
Sep 11 17:24:41.506365 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.506347    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb4a28d4-19ab-4bc4-bafd-e873723e32fd/kube-rbac-proxy-metric/0.log"
Sep 11 17:24:41.533589 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.533573    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb4a28d4-19ab-4bc4-bafd-e873723e32fd/prom-label-proxy/0.log"
Sep 11 17:24:41.550770 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.550753    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_cb4a28d4-19ab-4bc4-bafd-e873723e32fd/init-config-reloader/0.log"
Sep 11 17:24:41.618713 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.618688    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-5jpz5_25d1cc38-84b2-4411-91d8-e6e84c23f922/kube-state-metrics/0.log"
Sep 11 17:24:41.636870 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.636848    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-5jpz5_25d1cc38-84b2-4411-91d8-e6e84c23f922/kube-rbac-proxy-main/0.log"
Sep 11 17:24:41.658633 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.658610    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-5jpz5_25d1cc38-84b2-4411-91d8-e6e84c23f922/kube-rbac-proxy-self/0.log"
Sep 11 17:24:41.689935 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.689881    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-59cb5dd857-tpc8h_a50fe3bf-e56b-4088-b9e1-d496fbad1465/metrics-server/0.log"
Sep 11 17:24:41.971987 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:41.971965    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mn29k_17e74aef-6d15-4a65-957a-ab0fbb614b9a/node-exporter/0.log"
Sep 11 17:24:42.000608 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:42.000583    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mn29k_17e74aef-6d15-4a65-957a-ab0fbb614b9a/kube-rbac-proxy/0.log"
Sep 11 17:24:42.031240 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:42.031212    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mn29k_17e74aef-6d15-4a65-957a-ab0fbb614b9a/init-textfile/0.log"
Sep 11 17:24:42.463402 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:42.463372    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-747fd97f8b-54d8h_d3626dc1-e536-4891-9e47-a74700143b8d/telemeter-client/0.log"
Sep 11 17:24:42.489924 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:42.489902    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-747fd97f8b-54d8h_d3626dc1-e536-4891-9e47-a74700143b8d/reload/0.log"
Sep 11 17:24:42.514349 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:42.514326    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-747fd97f8b-54d8h_d3626dc1-e536-4891-9e47-a74700143b8d/kube-rbac-proxy/0.log"
Sep 11 17:24:45.433492 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.433462    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-568bd898f4-ls4m7_f6a7466a-4802-4788-94be-247ec53abb6a/console/0.log"
Sep 11 17:24:45.813759 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.813719    2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"]
Sep 11 17:24:45.814134 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.814121    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy"
Sep 11 17:24:45.814190 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.814136    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy"
Sep 11 17:24:45.814190 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.814145    2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="446a72f0-96f1-4402-ac4d-a7d24c5285fe" containerName="maas-api"
Sep 11 17:24:45.814190 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.814150    2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="446a72f0-96f1-4402-ac4d-a7d24c5285fe" containerName="maas-api"
Sep 11 17:24:45.814286 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.814205    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="73583f3e-8aad-4e94-96ce-12218b6307ce" containerName="istio-proxy"
Sep 11 17:24:45.814286 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.814212    2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="446a72f0-96f1-4402-ac4d-a7d24c5285fe" containerName="maas-api"
Sep 11 17:24:45.816952 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.816935    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:45.819740 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.819717    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wcq9\"/\"openshift-service-ca.crt\""
Sep 11 17:24:45.819865 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.819746    2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wcq9\"/\"kube-root-ca.crt\""
Sep 11 17:24:45.819938 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.819744    2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4wcq9\"/\"default-dockercfg-g5zvq\""
Sep 11 17:24:45.826355 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.826329    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"]
Sep 11 17:24:45.942215 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.942184    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdnvx\" (UniqueName: \"kubernetes.io/projected/3a073457-2de7-4a4b-84d5-50f31f858dec-kube-api-access-jdnvx\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:45.942399 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.942229    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-sys\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:45.942399 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.942261    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-proc\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:45.942399 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.942312    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-podres\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:45.942399 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:45.942342    2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-lib-modules\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.042843 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.042783    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-proc\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.043030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.042854    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-podres\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.043030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.042888    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-lib-modules\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.043030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.042916    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-proc\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.043030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.042983    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-podres\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.043030 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.043005    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdnvx\" (UniqueName: \"kubernetes.io/projected/3a073457-2de7-4a4b-84d5-50f31f858dec-kube-api-access-jdnvx\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.043230 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.043040    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-lib-modules\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.043230 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.043079    2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-sys\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.043230 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.043143    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a073457-2de7-4a4b-84d5-50f31f858dec-sys\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.050409 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.050387    2569 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdnvx\" (UniqueName: \"kubernetes.io/projected/3a073457-2de7-4a4b-84d5-50f31f858dec-kube-api-access-jdnvx\") pod \"perf-node-gather-daemonset-bxnz5\" (UID: \"3a073457-2de7-4a4b-84d5-50f31f858dec\") " pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.127679 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.127597    2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:46.400212 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.400184    2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"]
Sep 11 17:24:46.402149 ip-10-0-141-153 kubenswrapper[2569]: W0911 17:24:46.402118    2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a073457_2de7_4a4b_84d5_50f31f858dec.slice/crio-f1d6857240809b1b91c1792f791447171d3b775ead2ebc1835722560f7e9a847 WatchSource:0}: Error finding container f1d6857240809b1b91c1792f791447171d3b775ead2ebc1835722560f7e9a847: Status 404 returned error can't find the container with id f1d6857240809b1b91c1792f791447171d3b775ead2ebc1835722560f7e9a847
Sep 11 17:24:46.993574 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.993533    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5" event={"ID":"3a073457-2de7-4a4b-84d5-50f31f858dec","Type":"ContainerStarted","Data":"803037cb2349206b75310fc435512244283d65fe1b1be577563112a40d7742bd"}
Sep 11 17:24:46.993976 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.993590    2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5" event={"ID":"3a073457-2de7-4a4b-84d5-50f31f858dec","Type":"ContainerStarted","Data":"f1d6857240809b1b91c1792f791447171d3b775ead2ebc1835722560f7e9a847"}
Sep 11 17:24:46.993976 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:46.993669    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:47.016694 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:47.016647    2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5" podStartSLOduration=2.016630366 podStartE2EDuration="2.016630366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:24:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:24:47.014155786 +0000 UTC m=+2497.573547173" watchObservedRunningTime="2026-09-11 17:24:47.016630366 +0000 UTC m=+2497.576021753"
Sep 11 17:24:47.603130 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:47.603098    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zpks4_8a9bb07f-b6d4-4857-8275-0379dc808b2b/dns/0.log"
Sep 11 17:24:47.622942 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:47.622914    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zpks4_8a9bb07f-b6d4-4857-8275-0379dc808b2b/kube-rbac-proxy/0.log"
Sep 11 17:24:47.708161 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:47.708129    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vztfz_6449cf0d-f5e1-4b0e-bc8e-d489ab5f68e5/dns-node-resolver/0.log"
Sep 11 17:24:48.307703 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:48.307676    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dqgwp_61af0db4-55a1-48f1-9f49-d97573ee4ebf/node-ca/0.log"
Sep 11 17:24:49.860806 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:49.860777    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75dc676c8d-f6b82_fd3eed86-d6d9-4fac-9a91-993a06d2c0c1/kube-auth-proxy/0.log"
Sep 11 17:24:49.983243 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:49.983219    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5s4b_4e2c7d46-084b-47f8-af94-a6f60302f4ab/payload-processing/0.log"
Sep 11 17:24:50.939001 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:50.938965    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vhxk6_0a39c11e-d284-48e4-a93d-ee72a2f106a1/serve-healthcheck-canary/0.log"
Sep 11 17:24:51.641291 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:51.641264    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hxlzb_31d9734e-3785-4700-84ab-fd7599cd1f4a/kube-rbac-proxy/0.log"
Sep 11 17:24:51.663453 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:51.663431    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hxlzb_31d9734e-3785-4700-84ab-fd7599cd1f4a/exporter/0.log"
Sep 11 17:24:51.683000 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:51.682978    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hxlzb_31d9734e-3785-4700-84ab-fd7599cd1f4a/extractor/0.log"
Sep 11 17:24:53.009334 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:53.009305    2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4wcq9/perf-node-gather-daemonset-bxnz5"
Sep 11 17:24:54.351371 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:54.351345    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d67cb4f96-jdqj2_7ed7d727-98f0-41b3-a4e4-66cd0591d617/manager/0.log"
Sep 11 17:24:54.371768 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:54.371743    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d67cb4f96-jdqj2_7ed7d727-98f0-41b3-a4e4-66cd0591d617/copy-manifests/0.log"
Sep 11 17:24:56.099238 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:56.099201    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67c876df9b-rtdxw_5b6f717a-5cf1-4b95-b84d-444dca5f36ac/manager/0.log"
Sep 11 17:24:56.683104 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:56.683072    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75dc676c8d-f6b82_fd3eed86-d6d9-4fac-9a91-993a06d2c0c1/kube-auth-proxy/0.log"
Sep 11 17:24:56.763576 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:56.763545    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5s4b_4e2c7d46-084b-47f8-af94-a6f60302f4ab/payload-processing/0.log"
Sep 11 17:24:58.766864 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:58.766833    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75dc676c8d-f6b82_fd3eed86-d6d9-4fac-9a91-993a06d2c0c1/kube-auth-proxy/0.log"
Sep 11 17:24:58.860838 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:24:58.860789    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-d5s4b_4e2c7d46-084b-47f8-af94-a6f60302f4ab/payload-processing/0.log"
Sep 11 17:25:01.362231 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:01.362151    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-llgdq_7a23f8fd-95ac-4629-8848-519384e530a3/migrator/0.log"
Sep 11 17:25:01.383906 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:01.383870    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-llgdq_7a23f8fd-95ac-4629-8848-519384e530a3/graceful-termination/0.log"
Sep 11 17:25:03.141031 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.140998    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtvm7_93a162ce-a718-4a34-9b4a-426bd6cdcca0/kube-multus-additional-cni-plugins/0.log"
Sep 11 17:25:03.162972 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.162952    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtvm7_93a162ce-a718-4a34-9b4a-426bd6cdcca0/egress-router-binary-copy/0.log"
Sep 11 17:25:03.184593 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.184571    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtvm7_93a162ce-a718-4a34-9b4a-426bd6cdcca0/cni-plugins/0.log"
Sep 11 17:25:03.204592 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.204570    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtvm7_93a162ce-a718-4a34-9b4a-426bd6cdcca0/bond-cni-plugin/0.log"
Sep 11 17:25:03.225300 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.225281    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtvm7_93a162ce-a718-4a34-9b4a-426bd6cdcca0/routeoverride-cni/0.log"
Sep 11 17:25:03.249748 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.249724    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtvm7_93a162ce-a718-4a34-9b4a-426bd6cdcca0/whereabouts-cni-bincopy/0.log"
Sep 11 17:25:03.271237 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.271219    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtvm7_93a162ce-a718-4a34-9b4a-426bd6cdcca0/whereabouts-cni/0.log"
Sep 11 17:25:03.321748 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.321720    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-f75n6_b584b1ae-e14f-4576-989a-eeb7a53eaf15/kube-multus/0.log"
Sep 11 17:25:03.496341 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.496315    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xgtkk_e2d1bde7-0bee-4822-bb66-0c75f276c565/network-metrics-daemon/0.log"
Sep 11 17:25:03.515825 ip-10-0-141-153 kubenswrapper[2569]: I0911 17:25:03.515788    2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xgtkk_e2d1bde7-0bee-4822-bb66-0c75f276c565/kube-rbac-proxy/0.log"