Sep 17 00:09:58.779218 ip-10-0-135-192 systemd[1]: Starting Kubernetes Kubelet...
Sep 17 00:09:59.173031 ip-10-0-135-192 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 00:09:59.173031 ip-10-0-135-192 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 17 00:09:59.173031 ip-10-0-135-192 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 00:09:59.173031 ip-10-0-135-192 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 17 00:09:59.173031 ip-10-0-135-192 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 17 00:09:59.175208 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.175123    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 17 00:09:59.178740 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178724    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:59.178740 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178741    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178746    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178749    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178752    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178755    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178758    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178761    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178764    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178767    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178770    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178772    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178775    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178778    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178780    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178783    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178785    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178788    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178797    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178799    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178802    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:59.178804 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178805    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178808    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178811    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178814    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178817    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178820    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178823    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178825    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178828    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178831    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178833    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178836    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178838    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178841    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178844    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178846    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178849    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178851    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178854    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178857    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:59.179335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178859    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178862    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178865    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178867    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178870    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178872    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178874    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178877    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178880    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178882    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178884    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178887    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178890    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178892    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178906    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178909    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178913    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178916    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178918    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178921    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:59.179826 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178923    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178926    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178929    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178931    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178934    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178936    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178939    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178941    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178944    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178946    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178950    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178952    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178955    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178957    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178960    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178963    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178965    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178968    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178971    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:59.180344 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178973    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178976    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178978    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178982    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178984    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178987    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178989    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178994    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.178998    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179001    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179004    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179008    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179011    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179014    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179017    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179020    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179023    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179026    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179029    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:59.180824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179716    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179723    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179726    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179728    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179731    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179735    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179737    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179740    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179742    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179745    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179748    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179751    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179753    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179756    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179758    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179761    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179764    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179766    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179769    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179771    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179776    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:59.181314 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179778    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179781    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179784    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179787    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179790    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179793    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179795    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179798    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179800    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179803    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179805    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179808    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179810    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179813    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179816    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179820    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179824    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179828    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179831    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:59.181869 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179834    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179837    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179840    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179843    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179845    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179848    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179850    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179854    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179857    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179859    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179862    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179864    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179867    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179870    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179872    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179875    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179877    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179879    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179882    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179885    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:59.182362 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179887    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179890    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179892    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179910    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179913    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179916    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179918    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179921    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179923    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179927    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179929    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179936    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179939    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179948    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179952    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179955    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179958    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179960    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179963    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179965    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:59.182863 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179968    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179971    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179973    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179976    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179979    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179983    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179987    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179989    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179992    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179995    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.179999    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180003    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180006    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180009    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180012    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180015    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180017    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180020    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180023    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:59.183369 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180433    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180437    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180441    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180444    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180452    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180455    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180458    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180460    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180463    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180465    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180468    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180471    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180473    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180476    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180478    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180481    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180484    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180486    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180489    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180492    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:59.183832 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180495    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180497    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180500    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180503    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180505    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180508    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180510    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180513    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180517    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180521    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180523    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180526    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180528    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180531    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180534    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180536    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180539    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180547    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180550    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:59.184354 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180552    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180555    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180557    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180561    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180564    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180567    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180569    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180573    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180576    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180578    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180582    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180585    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180587    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180590    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180594    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180597    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180600    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180603    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180606    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180608    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:59.184822 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180611    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180613    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180616    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180618    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180621    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180623    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180626    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180628    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180631    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180633    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180637    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180646    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180649    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180652    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180654    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180657    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180659    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180662    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180664    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180667    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:59.185318 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180670    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180672    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180678    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180681    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180683    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180686    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180689    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180692    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180694    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180697    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180699    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180708    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180711    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180713    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180715    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180718    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180720    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180723    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180725    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.180728    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180803    2565 flags.go:64] FLAG: --address="0.0.0.0"
Sep 17 00:09:59.185810 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180835    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180846    2565 flags.go:64] FLAG: --anonymous-auth="true"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180850    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180862    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180866    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180870    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180874    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180877    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180880    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180883    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180886    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180889    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180892    2565 flags.go:64] FLAG: --cgroup-root=""
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180910    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180913    2565 flags.go:64] FLAG: --client-ca-file=""
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180917    2565 flags.go:64] FLAG: --cloud-provider="external"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180920    2565 flags.go:64] FLAG: --cluster-dns="[]"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180926    2565 flags.go:64] FLAG: --cluster-domain=""
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180929    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180932    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180935    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180938    2565 flags.go:64] FLAG: --container-log-max-files="5"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180942    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 17 00:09:59.186335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180945    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180948    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180951    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180954    2565 flags.go:64] FLAG: --contention-profiling="false"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180957    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180960    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180963    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180966    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180969    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180972    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180975    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180978    2565 flags.go:64] FLAG: --enable-load-reader="false"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180982    2565 flags.go:64] FLAG: --enable-server="true"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180986    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180991    2565 flags.go:64] FLAG: --event-burst="100"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180994    2565 flags.go:64] FLAG: --event-qps="50"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.180997    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181000    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181003    2565 flags.go:64] FLAG: --eviction-hard=""
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181006    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181009    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181012    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181016    2565 flags.go:64] FLAG: --eviction-soft=""
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181019    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181022    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 17 00:09:59.186936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181025    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181028    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181031    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181033    2565 flags.go:64] FLAG: --fail-swap-on="true"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181036    2565 flags.go:64] FLAG: --feature-gates=""
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181040    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181043    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181046    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181049    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181052    2565 flags.go:64] FLAG: --healthz-port="10248"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181055    2565 flags.go:64] FLAG: --help="false"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181058    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181061    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181064    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181067    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181070    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181073    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181076    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181079    2565 flags.go:64] FLAG: --image-service-endpoint=""
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181082    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181085    2565 flags.go:64] FLAG: --kube-api-burst="100"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181088    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181091    2565 flags.go:64] FLAG: --kube-api-qps="50"
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181094    2565 flags.go:64] FLAG: --kube-reserved=""
Sep 17 00:09:59.187601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181097    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181100    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181103    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181105    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181108    2565 flags.go:64] FLAG: --lock-file=""
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181112    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181115    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181118    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181124    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181126    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181129    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181132    2565 flags.go:64] FLAG: --logging-format="text"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181134    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181138    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181141    2565 flags.go:64] FLAG: --manifest-url=""
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181144    2565 flags.go:64] FLAG: --manifest-url-header=""
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181148    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181151    2565 flags.go:64] FLAG: --max-open-files="1000000"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181154    2565 flags.go:64] FLAG: --max-pods="110"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181157    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181160    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181163    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181166    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181169    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181172    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 17 00:09:59.188227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181175    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181182    2565 flags.go:64] FLAG: --node-status-max-images="50"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181185    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181189    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181192    2565 flags.go:64] FLAG: --pod-cidr=""
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181195    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181200    2565 flags.go:64] FLAG: --pod-manifest-path=""
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181203    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181206    2565 flags.go:64] FLAG: --pods-per-core="0"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181209    2565 flags.go:64] FLAG: --port="10250"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181212    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181215    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0718f3d4b228c8775"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181218    2565 flags.go:64] FLAG: --qos-reserved=""
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181222    2565 flags.go:64] FLAG: --read-only-port="10255"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181225    2565 flags.go:64] FLAG: --register-node="true"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181228    2565 flags.go:64] FLAG: --register-with-taints=""
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181231    2565 flags.go:64] FLAG: --registry-burst="10"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181235    2565 flags.go:64] FLAG: --registry-qps="5"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181238    2565 flags.go:64] FLAG: --reserved-cpus=""
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181241    2565 flags.go:64] FLAG: --reserved-memory=""
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181244    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181247    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181250    2565 flags.go:64] FLAG: --rotate-certificates="false"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181253    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181256    2565 flags.go:64] FLAG: --runonce="false"
Sep 17 00:09:59.188936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181258    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181261    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181264    2565 flags.go:64] FLAG: --seccomp-default="false"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181267    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181270    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181273    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181276    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181279    2565 flags.go:64] FLAG: --storage-driver-password="root"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181282    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181286    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181289    2565 flags.go:64] FLAG: --storage-driver-user="root"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181291    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181294    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181309    2565 flags.go:64] FLAG: --system-cgroups=""
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181312    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181317    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181320    2565 flags.go:64] FLAG: --tls-cert-file=""
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181323    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181327    2565 flags.go:64] FLAG: --tls-min-version=""
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181331    2565 flags.go:64] FLAG: --tls-private-key-file=""
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181335    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181337    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181340    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181343    2565 flags.go:64] FLAG: --v="2"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181351    2565 flags.go:64] FLAG: --version="false"
Sep 17 00:09:59.189552 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181355    2565 flags.go:64] FLAG: --vmodule=""
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181358    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.181361    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181495    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181499    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181503    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181505    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181508    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181511    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181515    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181518    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181520    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181523    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181525    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181528    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181531    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181534    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181536    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181539    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181541    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:59.190173 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181544    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181552    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181555    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181558    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181560    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181563    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181565    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181569    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181572    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181574    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181577    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181580    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181582    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181585    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181588    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181590    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181592    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181595    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181598    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181600    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:59.190799 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181603    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181606    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181608    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181611    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181613    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181616    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181618    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181621    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181624    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181626    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181629    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181632    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181634    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181637    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181645    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181648    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181651    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181654    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181656    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:59.191627 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181660    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181664    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181668    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181671    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181674    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181677    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181680    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181683    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181686    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181689    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181691    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181694    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181696    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181699    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181702    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181704    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181706    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181709    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181712    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181714    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:59.192123 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181717    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181719    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181722    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181725    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181727    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181729    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181732    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181734    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181742    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181745    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181748    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181750    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181754    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181757    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181759    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181762    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181764    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181767    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181771    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181775    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:59.192629 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181778    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181782    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.181785    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.182522    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.191917    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.191932    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.192996    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.193004    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193062    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193067    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193070    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193073    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193077    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193080    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:59.193133 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193082    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193085    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193088    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193090    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193095    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193098    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193102    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193106    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193109    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193112    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193115    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193118    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193121    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193124    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193127    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193129    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193132    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193135    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193138    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:59.193481 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193141    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193145    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193148    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193151    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193154    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193157    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193160    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193162    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193165    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193168    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193170    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193173    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193175    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193177    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193180    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193184    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193187    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193189    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193192    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193195    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:59.193966 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193198    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193201    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193205    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193209    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193211    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193214    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193216    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193219    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193221    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193224    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193226    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193229    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193231    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193234    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193236    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193239    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193241    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193244    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193246    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193249    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:59.194491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193251    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193254    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193256    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193259    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193261    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193264    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193266    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193269    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193272    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193274    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193277    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193279    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193282    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193285    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193295    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193298    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193300    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193303    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193306    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193308    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:59.194989 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193311    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193313    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193316    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193318    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193321    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193323    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193326    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193328    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193331    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193333    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193336    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193338    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193341    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193344    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.193349    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 00:09:59.195482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193455    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193460    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193463    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193466    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193468    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193471    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193474    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193477    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193479    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193482    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193485    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193488    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193498    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193501    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193504    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193507    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193510    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193512    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193515    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 17 00:09:59.195850 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193518    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193520    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193523    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193525    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193528    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193530    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193533    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193536    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193538    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193541    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193543    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193546    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193548    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193551    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193553    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193556    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193559    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193561    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193564    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193566    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 17 00:09:59.196335 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193569    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193571    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193575    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193578    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193581    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193584    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193593    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193596    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193598    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193601    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193603    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193606    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193608    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193612    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193616    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193618    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193621    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193624    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193627    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 17 00:09:59.196810 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193630    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193632    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193635    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193638    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193640    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193643    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193645    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193647    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193650    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193653    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193656    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193659    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193661    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193664    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193666    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193669    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193671    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193674    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193676    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193679    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 17 00:09:59.197294 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193683    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193687    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193689    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193692    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193695    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193697    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193700    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193702    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193705    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193707    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193710    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193712    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193715    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193717    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193720    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193722    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193725    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193727    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193729    2565 feature_gate.go:328] unrecognized feature gate: Example2
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193732    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 17 00:09:59.197778 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:09:59.193735    2565 feature_gate.go:328] unrecognized feature gate: Example
Sep 17 00:09:59.198295 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.193741    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 17 00:09:59.198295 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.193848    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 17 00:09:59.198295 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.195950    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 17 00:09:59.198295 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.196806    2565 server.go:1019] "Starting client certificate rotation"
Sep 17 00:09:59.198295 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.196920    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 00:09:59.198295 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.196952    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 17 00:09:59.199292 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.199278    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 00:09:59.203058 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.203042    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 17 00:09:59.213930 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.213910    2565 log.go:25] "Validated CRI v1 runtime API"
Sep 17 00:09:59.217227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.217213    2565 log.go:25] "Validated CRI v1 image API"
Sep 17 00:09:59.218130 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.218107    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 17 00:09:59.221803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.221785    2565 fs.go:135] Filesystem UUIDs: map[3f0ae430-12f5-4085-9644-63299dbc0f5c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b00b0a46-acab-4fad-9098-e36e28f4178c:/dev/nvme0n1p4]
Sep 17 00:09:59.221872 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.221802    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 17 00:09:59.227990 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.227972    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 00:09:59.228572 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.228467    2565 manager.go:216] Machine: {Timestamp:2026-09-17 00:09:59.227117257 +0000 UTC m=+0.335893162 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100067 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29a0833eaa0c09003942118e97f900 SystemUUID:ec29a083-3eaa-0c09-0039-42118e97f900 BootID:ca46c16d-1cac-4803-ae8a-6e863c698271 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ec:66:5d:d9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ec:66:5d:d9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:54:62:71:d0:73 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 17 00:09:59.228572 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.228569    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 17 00:09:59.228672 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.228653    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 17 00:09:59.231674 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.231648    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 17 00:09:59.231795 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.231676    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 17 00:09:59.232778 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.232768    2565 topology_manager.go:138] "Creating topology manager with none policy"
Sep 17 00:09:59.232818 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.232781    2565 container_manager_linux.go:309] "Creating device plugin manager"
Sep 17 00:09:59.232818 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.232789    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 00:09:59.233430 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.233420    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 17 00:09:59.234112 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.234103    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 17 00:09:59.237750 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.237739    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 00:09:59.237867 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.237858    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 17 00:09:59.237911 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.237886    2565 kubelet.go:486] "Attempting to sync node with API server"
Sep 17 00:09:59.237947 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.237912    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 17 00:09:59.237947 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.237924    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 17 00:09:59.237947 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.237934    2565 kubelet.go:398] "Adding apiserver pod source"
Sep 17 00:09:59.237947 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.237942    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 17 00:09:59.238951 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.238932    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 00:09:59.239025 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.238964    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 17 00:09:59.241326 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.241303    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 17 00:09:59.243016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.243000    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 17 00:09:59.243091 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.243044    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 17 00:09:59.244521 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244508    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 17 00:09:59.244599 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244527    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 17 00:09:59.244599 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244536    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 17 00:09:59.244599 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244543    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 17 00:09:59.244599 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244554    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 17 00:09:59.244599 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244562    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 17 00:09:59.244599 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244581    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 17 00:09:59.244599 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244589    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 17 00:09:59.244599 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244599    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 17 00:09:59.244840 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244607    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 17 00:09:59.244840 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244620    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 17 00:09:59.244840 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.244628    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 17 00:09:59.245757 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.245746    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 17 00:09:59.245813 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.245758    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 17 00:09:59.248615 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.248594    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-192.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 17 00:09:59.249128 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.249106    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-192.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 17 00:09:59.249199 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.249103    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 00:09:59.249364 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.249351    2565 server.go:1268] "Started kubelet"
Sep 17 00:09:59.249456 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.249428    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 17 00:09:59.249517 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.249480    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 17 00:09:59.249557 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.249420    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 17 00:09:59.249653 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.249638    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nhkgm"
Sep 17 00:09:59.250170 ip-10-0-135-192 systemd[1]: Started Kubernetes Kubelet.
Sep 17 00:09:59.251280 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.251266    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 17 00:09:59.252333 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.252320    2565 server.go:310] "Adding debug handlers to kubelet server"
Sep 17 00:09:59.254511 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.254494    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 17 00:09:59.255029 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.253974    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-192.ec2.internal.18d5f32c76f206ea  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-192.ec2.internal,UID:ip-10-0-135-192.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-192.ec2.internal,},FirstTimestamp:2026-09-17 00:09:59.249323754 +0000 UTC m=+0.358099659,LastTimestamp:2026-09-17 00:09:59.249323754 +0000 UTC m=+0.358099659,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-192.ec2.internal,}"
Sep 17 00:09:59.255202 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.255187    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 17 00:09:59.255784 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.255759    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 17 00:09:59.255879 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.255856    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:09:59.256322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256304    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 17 00:09:59.256322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256324    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 17 00:09:59.256433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256308    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 17 00:09:59.256433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256426    2565 reconstruct.go:97] "Volume reconstruction finished"
Sep 17 00:09:59.256433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256433    2565 reconciler.go:29] "Reconciler: start to sync state"
Sep 17 00:09:59.256678 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256664    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 17 00:09:59.256678 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256678    2565 factory.go:55] Registering systemd factory
Sep 17 00:09:59.256759 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256685    2565 factory.go:223] Registration of the systemd container factory successfully
Sep 17 00:09:59.256875 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256862    2565 factory.go:153] Registering CRI-O factory
Sep 17 00:09:59.256956 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256879    2565 factory.go:223] Registration of the crio container factory successfully
Sep 17 00:09:59.256956 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.256912    2565 factory.go:103] Registering Raw factory
Sep 17 00:09:59.257310 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.257299    2565 manager.go:1196] Started watching for new ooms in manager
Sep 17 00:09:59.257588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.257575    2565 manager.go:349] Starting recovery of all containers
Sep 17 00:09:59.257648 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.257592    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nhkgm"
Sep 17 00:09:59.265997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.265980    2565 manager.go:354] Recovery completed
Sep 17 00:09:59.269251 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.269231    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:09:59.271670 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.271657    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:59.271985 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.271969    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-192.ec2.internal\" not found" node="ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.273798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.273743    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:59.273798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.273781    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:59.273798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.273797    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:59.274800 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.274786    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 17 00:09:59.274800 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.274798    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 17 00:09:59.274925 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.274804    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:59.274925 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.274812    2565 state_mem.go:36] "Initialized new in-memory state store"
Sep 17 00:09:59.275499 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.275481    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:59.275595 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.275514    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:59.275595 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.275526    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:59.276952 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.276939    2565 policy_none.go:49] "None policy: Start"
Sep 17 00:09:59.276952 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.276953    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 17 00:09:59.277049 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.276964    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 17 00:09:59.279029 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.279013    2565 policy_none.go:47] "Start"
Sep 17 00:09:59.309548 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.309444    2565 manager.go:337] "Starting Device Plugin manager"
Sep 17 00:09:59.330928 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.309571    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 17 00:09:59.330928 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.309584    2565 server.go:87] "Starting device plugin registration server"
Sep 17 00:09:59.330928 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.309816    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 17 00:09:59.330928 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.309828    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 17 00:09:59.330928 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.309968    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 17 00:09:59.330928 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.310058    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 17 00:09:59.330928 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.310074    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 17 00:09:59.330928 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.310601    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 17 00:09:59.330928 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.310647    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:09:59.381380 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.381359    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 17 00:09:59.382515 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.382492    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 17 00:09:59.382593 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.382545    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 17 00:09:59.382593 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.382569    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 17 00:09:59.382692 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.382642    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 17 00:09:59.384642 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.384622    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:09:59.410466 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.410447    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:59.411432 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.411411    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:59.411523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.411438    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:59.411523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.411451    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:59.411523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.411491    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.419168 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.419152    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.419246 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.419171    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-192.ec2.internal\": node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:09:59.434241 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.434185    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:09:59.482703 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.482676    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"]
Sep 17 00:09:59.482790 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.482753    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:59.483516 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.483497    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:59.483583 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.483521    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:59.483583 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.483530    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:59.485746 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.485734    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:59.485878 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.485865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.485941 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.485926    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:59.486362 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.486348    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:59.486415 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.486378    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:59.486415 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.486388    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:59.486474 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.486348    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:59.486474 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.486448    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:59.486474 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.486462    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:59.488447 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.488434    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.488495 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.488456    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 17 00:09:59.489122 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.489108    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientMemory"
Sep 17 00:09:59.489175 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.489133    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasNoDiskPressure"
Sep 17 00:09:59.489175 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.489143    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeHasSufficientPID"
Sep 17 00:09:59.510530 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.510515    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-192.ec2.internal\" not found" node="ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.515020 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.515006    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-192.ec2.internal\" not found" node="ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.534275 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.534255    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:09:59.558150 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.558130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27c8d28f5cb0400d0af03df25605044-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"d27c8d28f5cb0400d0af03df25605044\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.558227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.558153    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7c6efec3d953df3c8f862ee842d933e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-192.ec2.internal\" (UID: \"d7c6efec3d953df3c8f862ee842d933e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.558227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.558169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d27c8d28f5cb0400d0af03df25605044-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"d27c8d28f5cb0400d0af03df25605044\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.634933 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.634912    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:09:59.659253 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.659231    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d27c8d28f5cb0400d0af03df25605044-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"d27c8d28f5cb0400d0af03df25605044\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.659332 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.659263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27c8d28f5cb0400d0af03df25605044-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"d27c8d28f5cb0400d0af03df25605044\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.659332 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.659296    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7c6efec3d953df3c8f862ee842d933e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-192.ec2.internal\" (UID: \"d7c6efec3d953df3c8f862ee842d933e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.659414 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.659334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d27c8d28f5cb0400d0af03df25605044-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"d27c8d28f5cb0400d0af03df25605044\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.659414 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.659348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27c8d28f5cb0400d0af03df25605044-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal\" (UID: \"d27c8d28f5cb0400d0af03df25605044\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.659414 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.659349    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d7c6efec3d953df3c8f862ee842d933e-config\") pod \"kube-apiserver-proxy-ip-10-0-135-192.ec2.internal\" (UID: \"d7c6efec3d953df3c8f862ee842d933e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.735537 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.735488    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:09:59.813066 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.813037    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.818079 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:09:59.817657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 17 00:09:59.836103 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.836081    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:09:59.936607 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:09:59.936579    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:10:00.040051 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.040017    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-192.ec2.internal\" not found"
Sep 17 00:10:00.137263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.137235    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:10:00.156154 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.156129    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal"
Sep 17 00:10:00.169219 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.169202    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 00:10:00.170902 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.170889    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal"
Sep 17 00:10:00.177111 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.177097    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 17 00:10:00.197061 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.197041    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 17 00:10:00.197172 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.197150    2565 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.135.192:37830->100.56.186.99:6443: use of closed network connection"
Sep 17 00:10:00.197228 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.197174    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 00:10:00.197228 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.197184    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 00:10:00.197228 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.197212    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 17 00:10:00.197339 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.197227    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.135.192:37830->100.56.186.99:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 17 00:10:00.240628 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.240575    2565 apiserver.go:52] "Watching apiserver"
Sep 17 00:10:00.256182 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.256160    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 17 00:10:00.262540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.262509    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-16 00:04:59 +0000 UTC" deadline="2028-04-18 15:48:17.634096421 +0000 UTC"
Sep 17 00:10:00.262540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.262540    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13911h38m17.37156024s"
Sep 17 00:10:00.262738 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.262727    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 17 00:10:00.263753 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.263733    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-spzhv","openshift-cluster-node-tuning-operator/tuned-22dn7","openshift-image-registry/node-ca-lpbnb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal","openshift-multus/multus-additional-cni-plugins-8v566","openshift-multus/multus-cpqcg","openshift-network-operator/iptables-alerter-f8tg5","kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j","openshift-dns/node-resolver-6kvtx","openshift-multus/network-metrics-daemon-8wnd2","openshift-network-diagnostics/network-check-target-d5ff8","openshift-ovn-kubernetes/ovnkube-node-kn9vs","kube-system/global-pull-secret-syncer-9gcbh"]
Sep 17 00:10:00.266664 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.266645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.268793 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.268776    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.269384 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.269362    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vxflv\""
Sep 17 00:10:00.269496 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.269422    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 17 00:10:00.269496 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.269423    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 17 00:10:00.269893 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.269877    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 17 00:10:00.271078 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.271047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.271211 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.271160    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 17 00:10:00.271336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.271223    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 17 00:10:00.271587 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.271564    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 17 00:10:00.271587 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.271573    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nnvdv\""
Sep 17 00:10:00.272603 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.272586    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 17 00:10:00.272691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.272585    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 17 00:10:00.272691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.272591    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 17 00:10:00.273322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.273302    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.273501 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.273368    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:00.273752 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.273572    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 17 00:10:00.273752 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.273644    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 17 00:10:00.273752 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.273651    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 17 00:10:00.273752 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.273701    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-fzlgm\""
Sep 17 00:10:00.275614 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.275597    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.277763 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.277732    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.277893 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.277773    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 17 00:10:00.277893 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.277857    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 17 00:10:00.278073 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.277989    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 17 00:10:00.278265 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.278247    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kk6np\""
Sep 17 00:10:00.278319 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.278268    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 17 00:10:00.278319 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.278279    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 17 00:10:00.280047 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.280031    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 17 00:10:00.280288 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.280275    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4vvkc\""
Sep 17 00:10:00.280781 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.280763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.283392 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.283368    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.283765 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.283743    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9c6pv\""
Sep 17 00:10:00.283866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.283791    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 17 00:10:00.283866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.283819    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 17 00:10:00.283866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.283858    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 17 00:10:00.285852 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.285834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.288405 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.288386    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:00.292465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.292443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:00.292588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.292473    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 17 00:10:00.292588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.292564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 17 00:10:00.292729 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.292677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j4phn\""
Sep 17 00:10:00.292729 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.292563    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:00.292729 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.292453    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:10:00.292976 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.292794    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-smh58\""
Sep 17 00:10:00.292976 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.292832    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:10:00.294065 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.294042    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 17 00:10:00.294166 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.294064    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 17 00:10:00.294166 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.294098    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hvbsm\""
Sep 17 00:10:00.294166 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.294049    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 17 00:10:00.294334 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.294195    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xc9vf"
Sep 17 00:10:00.296332 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.296314    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:00.296420 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.296382    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:00.302069 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.302050    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xc9vf"
Sep 17 00:10:00.357563 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.357541    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 17 00:10:00.362825 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.362806    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-device-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.362895 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.362833    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6abf865-61c4-4424-99d0-ec707d13f6b5-tmp\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.362895 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.362851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdtsg\" (UniqueName: \"kubernetes.io/projected/e6abf865-61c4-4424-99d0-ec707d13f6b5-kube-api-access-tdtsg\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.362895 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.362868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnscc\" (UniqueName: \"kubernetes.io/projected/ca6b8957-62ac-403c-a400-1b3c00462448-kube-api-access-pnscc\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:00.362895 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.362890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-cni-bin\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363094 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.362936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6t7j\" (UniqueName: \"kubernetes.io/projected/ca4b4402-4647-489c-a25a-c162803e2e42-kube-api-access-x6t7j\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.363094 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.362966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-var-lib-kubelet\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.363094 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-run-netns\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363094 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-run-systemd\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363094 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363057    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c94c8d6-997a-47ee-a301-a3219e468b73-ovn-node-metrics-cert\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363094 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c94c8d6-997a-47ee-a301-a3219e468b73-ovnkube-script-lib\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363119    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-lib-modules\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97txq\" (UniqueName: \"kubernetes.io/projected/f1e60d13-d6b3-43f8-af0e-2865438288f9-kube-api-access-97txq\") pod \"node-ca-lpbnb\" (UID: \"f1e60d13-d6b3-43f8-af0e-2865438288f9\") " pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79c3d307-c5ec-454d-ab28-c16840b8acef-system-cni-dir\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363229    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79c3d307-c5ec-454d-ab28-c16840b8acef-cni-binary-copy\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-kubernetes\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363282    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-sysctl-conf\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-slash\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-dbus\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-var-lib-kubelet\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.363389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-hostroot\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr2dl\" (UniqueName: \"kubernetes.io/projected/a0951f71-9f3e-4292-a2e7-cf9cf1b4546f-kube-api-access-pr2dl\") pod \"iptables-alerter-f8tg5\" (UID: \"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f\") " pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-run-ovn\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363442    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79c3d307-c5ec-454d-ab28-c16840b8acef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3cf7de5-498a-482d-b451-a55de2469bb3-cni-binary-copy\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-run-multus-certs\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363502    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-tuned\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-etc-openvswitch\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c94c8d6-997a-47ee-a301-a3219e468b73-env-overrides\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1e60d13-d6b3-43f8-af0e-2865438288f9-host\") pod \"node-ca-lpbnb\" (UID: \"f1e60d13-d6b3-43f8-af0e-2865438288f9\") " pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1e60d13-d6b3-43f8-af0e-2865438288f9-serviceca\") pod \"node-ca-lpbnb\" (UID: \"f1e60d13-d6b3-43f8-af0e-2865438288f9\") " pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0951f71-9f3e-4292-a2e7-cf9cf1b4546f-iptables-alerter-script\") pod \"iptables-alerter-f8tg5\" (UID: \"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f\") " pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a46a1a11-4cc1-4a28-b604-6c409d181e54-konnectivity-ca\") pod \"konnectivity-agent-spzhv\" (UID: \"a46a1a11-4cc1-4a28-b604-6c409d181e54\") " pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363714    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-kubelet\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.363807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw4hw\" (UniqueName: \"kubernetes.io/projected/d3cf7de5-498a-482d-b451-a55de2469bb3-kube-api-access-hw4hw\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-etc-selinux\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-sys\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05a14f42-47c1-4c0e-b6a9-82a6ee4eb899-hosts-file\") pod \"node-resolver-6kvtx\" (UID: \"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899\") " pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-run-openvswitch\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-cni-dir\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-run-k8s-cni-cncf-io\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-sysctl-d\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.363982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364008    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79c3d307-c5ec-454d-ab28-c16840b8acef-cnibin\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364030    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0951f71-9f3e-4292-a2e7-cf9cf1b4546f-host-slash\") pod \"iptables-alerter-f8tg5\" (UID: \"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f\") " pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-node-log\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-log-socket\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364112    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x44cb\" (UniqueName: \"kubernetes.io/projected/1c94c8d6-997a-47ee-a301-a3219e468b73-kube-api-access-x44cb\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.364465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79c3d307-c5ec-454d-ab28-c16840b8acef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7lzf\" (UniqueName: \"kubernetes.io/projected/79c3d307-c5ec-454d-ab28-c16840b8acef-kube-api-access-j7lzf\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364238    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-systemd\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfs6l\" (UniqueName: \"kubernetes.io/projected/05a14f42-47c1-4c0e-b6a9-82a6ee4eb899-kube-api-access-xfs6l\") pod \"node-resolver-6kvtx\" (UID: \"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899\") " pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-cni-netd\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364303    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-kubelet-config\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364323    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-var-lib-cni-multus\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-etc-kubernetes\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-run-ovn-kubernetes\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-system-cni-dir\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-modprobe-d\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-sysconfig\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-systemd-units\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364459    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79c3d307-c5ec-454d-ab28-c16840b8acef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-var-lib-cni-bin\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-daemon-config\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.365233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-sys-fs\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-run\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-host\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a14f42-47c1-4c0e-b6a9-82a6ee4eb899-tmp-dir\") pod \"node-resolver-6kvtx\" (UID: \"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899\") " pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-var-lib-openvswitch\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-socket-dir-parent\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-registration-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a46a1a11-4cc1-4a28-b604-6c409d181e54-agent-certs\") pod \"konnectivity-agent-spzhv\" (UID: \"a46a1a11-4cc1-4a28-b604-6c409d181e54\") " pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c94c8d6-997a-47ee-a301-a3219e468b73-ovnkube-config\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364753    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-cnibin\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364776    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-socket-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-run-netns\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.365849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.364809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-conf-dir\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.465196 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1e60d13-d6b3-43f8-af0e-2865438288f9-host\") pod \"node-ca-lpbnb\" (UID: \"f1e60d13-d6b3-43f8-af0e-2865438288f9\") " pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.465324 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1e60d13-d6b3-43f8-af0e-2865438288f9-serviceca\") pod \"node-ca-lpbnb\" (UID: \"f1e60d13-d6b3-43f8-af0e-2865438288f9\") " pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.465324 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0951f71-9f3e-4292-a2e7-cf9cf1b4546f-iptables-alerter-script\") pod \"iptables-alerter-f8tg5\" (UID: \"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f\") " pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.465324 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a46a1a11-4cc1-4a28-b604-6c409d181e54-konnectivity-ca\") pod \"konnectivity-agent-spzhv\" (UID: \"a46a1a11-4cc1-4a28-b604-6c409d181e54\") " pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:00.465324 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465251    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-kubelet\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.465324 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw4hw\" (UniqueName: \"kubernetes.io/projected/d3cf7de5-498a-482d-b451-a55de2469bb3-kube-api-access-hw4hw\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.465608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465321    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f1e60d13-d6b3-43f8-af0e-2865438288f9-host\") pod \"node-ca-lpbnb\" (UID: \"f1e60d13-d6b3-43f8-af0e-2865438288f9\") " pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.465608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465345    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-kubelet\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.465608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-etc-selinux\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.465608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-sys\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.465608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05a14f42-47c1-4c0e-b6a9-82a6ee4eb899-hosts-file\") pod \"node-resolver-6kvtx\" (UID: \"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899\") " pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.465608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-run-openvswitch\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.465608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465511    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-sys\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.465608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-cni-dir\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.465608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465587    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-cni-dir\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-run-k8s-cni-cncf-io\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05a14f42-47c1-4c0e-b6a9-82a6ee4eb899-hosts-file\") pod \"node-resolver-6kvtx\" (UID: \"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899\") " pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-etc-selinux\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-run-openvswitch\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-sysctl-d\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465725    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465732    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-run-k8s-cni-cncf-io\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79c3d307-c5ec-454d-ab28-c16840b8acef-cnibin\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465765    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0951f71-9f3e-4292-a2e7-cf9cf1b4546f-host-slash\") pod \"iptables-alerter-f8tg5\" (UID: \"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f\") " pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-node-log\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-log-socket\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.465836    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x44cb\" (UniqueName: \"kubernetes.io/projected/1c94c8d6-997a-47ee-a301-a3219e468b73-kube-api-access-x44cb\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-sysctl-d\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-node-log\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.466145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-kubelet-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-log-socket\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465829    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/79c3d307-c5ec-454d-ab28-c16840b8acef-cnibin\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465869    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a0951f71-9f3e-4292-a2e7-cf9cf1b4546f-host-slash\") pod \"iptables-alerter-f8tg5\" (UID: \"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f\") " pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465939    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a46a1a11-4cc1-4a28-b604-6c409d181e54-konnectivity-ca\") pod \"konnectivity-agent-spzhv\" (UID: \"a46a1a11-4cc1-4a28-b604-6c409d181e54\") " pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a0951f71-9f3e-4292-a2e7-cf9cf1b4546f-iptables-alerter-script\") pod \"iptables-alerter-f8tg5\" (UID: \"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f\") " pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.465851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f1e60d13-d6b3-43f8-af0e-2865438288f9-serviceca\") pod \"node-ca-lpbnb\" (UID: \"f1e60d13-d6b3-43f8-af0e-2865438288f9\") " pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.465937    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs podName:ca6b8957-62ac-403c-a400-1b3c00462448 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:00.965891705 +0000 UTC m=+2.074667604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs") pod "network-metrics-daemon-8wnd2" (UID: "ca6b8957-62ac-403c-a400-1b3c00462448") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.465972    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466062    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79c3d307-c5ec-454d-ab28-c16840b8acef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.466075    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret podName:f964a8dc-ec08-49f3-9c5e-a427f7fd695b nodeName:}" failed. No retries permitted until 2026-09-17 00:10:00.966061835 +0000 UTC m=+2.074837729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret") pod "global-pull-secret-syncer-9gcbh" (UID: "f964a8dc-ec08-49f3-9c5e-a427f7fd695b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466109    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7lzf\" (UniqueName: \"kubernetes.io/projected/79c3d307-c5ec-454d-ab28-c16840b8acef-kube-api-access-j7lzf\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-systemd\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466159    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfs6l\" (UniqueName: \"kubernetes.io/projected/05a14f42-47c1-4c0e-b6a9-82a6ee4eb899-kube-api-access-xfs6l\") pod \"node-resolver-6kvtx\" (UID: \"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899\") " pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466187    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-cni-netd\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-kubelet-config\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.466967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-var-lib-cni-multus\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-systemd\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-etc-kubernetes\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466301    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-cni-netd\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466321    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-run-ovn-kubernetes\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466346    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-var-lib-cni-multus\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466355    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-system-cni-dir\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466361    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-etc-kubernetes\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466326    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-kubelet-config\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-modprobe-d\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-run-ovn-kubernetes\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-sysconfig\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-systemd-units\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79c3d307-c5ec-454d-ab28-c16840b8acef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-system-cni-dir\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-systemd-units\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466497    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-sysconfig\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466499    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-var-lib-cni-bin\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.467817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466548    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-daemon-config\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466552    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/79c3d307-c5ec-454d-ab28-c16840b8acef-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-sys-fs\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-modprobe-d\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-run\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-var-lib-cni-bin\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-host\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a14f42-47c1-4c0e-b6a9-82a6ee4eb899-tmp-dir\") pod \"node-resolver-6kvtx\" (UID: \"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899\") " pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466655    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-run\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-sys-fs\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466700    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-host\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-var-lib-openvswitch\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466750    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-socket-dir-parent\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-registration-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466788    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-var-lib-openvswitch\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466817    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-socket-dir-parent\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466831    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a46a1a11-4cc1-4a28-b604-6c409d181e54-agent-certs\") pod \"konnectivity-agent-spzhv\" (UID: \"a46a1a11-4cc1-4a28-b604-6c409d181e54\") " pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c94c8d6-997a-47ee-a301-a3219e468b73-ovnkube-config\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.468719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466886    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-cnibin\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-socket-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466962    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-run-netns\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05a14f42-47c1-4c0e-b6a9-82a6ee4eb899-tmp-dir\") pod \"node-resolver-6kvtx\" (UID: \"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899\") " pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-conf-dir\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466996    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/79c3d307-c5ec-454d-ab28-c16840b8acef-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467006    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-cnibin\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467015    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-device-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.466959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-registration-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467043    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-run-netns\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6abf865-61c4-4424-99d0-ec707d13f6b5-tmp\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467071    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-conf-dir\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdtsg\" (UniqueName: \"kubernetes.io/projected/e6abf865-61c4-4424-99d0-ec707d13f6b5-kube-api-access-tdtsg\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467110    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-socket-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnscc\" (UniqueName: \"kubernetes.io/projected/ca6b8957-62ac-403c-a400-1b3c00462448-kube-api-access-pnscc\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467140    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d3cf7de5-498a-482d-b451-a55de2469bb3-multus-daemon-config\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ca4b4402-4647-489c-a25a-c162803e2e42-device-dir\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.469665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467166    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-cni-bin\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6t7j\" (UniqueName: \"kubernetes.io/projected/ca4b4402-4647-489c-a25a-c162803e2e42-kube-api-access-x6t7j\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-var-lib-kubelet\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-run-netns\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-cni-bin\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467282    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-run-systemd\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c94c8d6-997a-47ee-a301-a3219e468b73-ovn-node-metrics-cert\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467317    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-var-lib-kubelet\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c94c8d6-997a-47ee-a301-a3219e468b73-ovnkube-script-lib\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-run-systemd\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-lib-modules\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467383    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97txq\" (UniqueName: \"kubernetes.io/projected/f1e60d13-d6b3-43f8-af0e-2865438288f9-kube-api-access-97txq\") pod \"node-ca-lpbnb\" (UID: \"f1e60d13-d6b3-43f8-af0e-2865438288f9\") " pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467429    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79c3d307-c5ec-454d-ab28-c16840b8acef-system-cni-dir\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79c3d307-c5ec-454d-ab28-c16840b8acef-cni-binary-copy\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-kubernetes\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1c94c8d6-997a-47ee-a301-a3219e468b73-ovnkube-config\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.470567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467501    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-lib-modules\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-sysctl-conf\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467538    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-slash\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467544    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/79c3d307-c5ec-454d-ab28-c16840b8acef-system-cni-dir\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-kubernetes\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-dbus\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-var-lib-kubelet\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-hostroot\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467644    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr2dl\" (UniqueName: \"kubernetes.io/projected/a0951f71-9f3e-4292-a2e7-cf9cf1b4546f-kube-api-access-pr2dl\") pod \"iptables-alerter-f8tg5\" (UID: \"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f\") " pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467652    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-sysctl-conf\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467674    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467696    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-run-netns\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-run-ovn\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467751    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-var-lib-kubelet\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-run-ovn\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79c3d307-c5ec-454d-ab28-c16840b8acef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.471403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3cf7de5-498a-482d-b451-a55de2469bb3-cni-binary-copy\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1c94c8d6-997a-47ee-a301-a3219e468b73-ovnkube-script-lib\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467884    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-run-multus-certs\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467912    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-tuned\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467928    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-slash\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-etc-openvswitch\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-hostroot\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.467965    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c94c8d6-997a-47ee-a301-a3219e468b73-env-overrides\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.468002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d3cf7de5-498a-482d-b451-a55de2469bb3-host-run-multus-certs\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.468052    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/79c3d307-c5ec-454d-ab28-c16840b8acef-cni-binary-copy\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.468070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-etc-openvswitch\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.468076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-dbus\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.468201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/79c3d307-c5ec-454d-ab28-c16840b8acef-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.468252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1c94c8d6-997a-47ee-a301-a3219e468b73-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.468430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1c94c8d6-997a-47ee-a301-a3219e468b73-env-overrides\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.468517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3cf7de5-498a-482d-b451-a55de2469bb3-cni-binary-copy\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.471478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e6abf865-61c4-4424-99d0-ec707d13f6b5-etc-tuned\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.471576    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c94c8d6-997a-47ee-a301-a3219e468b73-ovn-node-metrics-cert\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.472177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.471771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a46a1a11-4cc1-4a28-b604-6c409d181e54-agent-certs\") pod \"konnectivity-agent-spzhv\" (UID: \"a46a1a11-4cc1-4a28-b604-6c409d181e54\") " pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:00.473342 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.471941    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e6abf865-61c4-4424-99d0-ec707d13f6b5-tmp\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.475950 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.475909    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7c6efec3d953df3c8f862ee842d933e.slice/crio-6538f21171b814a641d1f5688b839316f3dd1a0cf36773a9cbbe96f5ba83aa60 WatchSource:0}: Error finding container 6538f21171b814a641d1f5688b839316f3dd1a0cf36773a9cbbe96f5ba83aa60: Status 404 returned error can't find the container with id 6538f21171b814a641d1f5688b839316f3dd1a0cf36773a9cbbe96f5ba83aa60
Sep 17 00:10:00.476293 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.476271    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27c8d28f5cb0400d0af03df25605044.slice/crio-1e6374a1e1d725324064e52a68f52589523d0dcd0b85604545273e6b41d909bf WatchSource:0}: Error finding container 1e6374a1e1d725324064e52a68f52589523d0dcd0b85604545273e6b41d909bf: Status 404 returned error can't find the container with id 1e6374a1e1d725324064e52a68f52589523d0dcd0b85604545273e6b41d909bf
Sep 17 00:10:00.477171 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.476809    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:00.477171 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.476833    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:00.477171 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.476847    2565 projected.go:196] Error preparing data for projected volume kube-api-access-n9mw4 for pod openshift-network-diagnostics/network-check-target-d5ff8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:00.477171 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.476941    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4 podName:f3f6541d-f62a-4f35-8337-6a79c593386a nodeName:}" failed. No retries permitted until 2026-09-17 00:10:00.976898027 +0000 UTC m=+2.085673923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-n9mw4" (UniqueName: "kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4") pod "network-check-target-d5ff8" (UID: "f3f6541d-f62a-4f35-8337-6a79c593386a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:00.477459 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.477336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw4hw\" (UniqueName: \"kubernetes.io/projected/d3cf7de5-498a-482d-b451-a55de2469bb3-kube-api-access-hw4hw\") pod \"multus-cpqcg\" (UID: \"d3cf7de5-498a-482d-b451-a55de2469bb3\") " pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.479263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.479236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdtsg\" (UniqueName: \"kubernetes.io/projected/e6abf865-61c4-4424-99d0-ec707d13f6b5-kube-api-access-tdtsg\") pod \"tuned-22dn7\" (UID: \"e6abf865-61c4-4424-99d0-ec707d13f6b5\") " pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.480406 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.480306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfs6l\" (UniqueName: \"kubernetes.io/projected/05a14f42-47c1-4c0e-b6a9-82a6ee4eb899-kube-api-access-xfs6l\") pod \"node-resolver-6kvtx\" (UID: \"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899\") " pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.480406 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.480341    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6t7j\" (UniqueName: \"kubernetes.io/projected/ca4b4402-4647-489c-a25a-c162803e2e42-kube-api-access-x6t7j\") pod \"aws-ebs-csi-driver-node-85j7j\" (UID: \"ca4b4402-4647-489c-a25a-c162803e2e42\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.480406 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.480363    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnscc\" (UniqueName: \"kubernetes.io/projected/ca6b8957-62ac-403c-a400-1b3c00462448-kube-api-access-pnscc\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:00.480602 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.480407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr2dl\" (UniqueName: \"kubernetes.io/projected/a0951f71-9f3e-4292-a2e7-cf9cf1b4546f-kube-api-access-pr2dl\") pod \"iptables-alerter-f8tg5\" (UID: \"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f\") " pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.481219 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.481192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97txq\" (UniqueName: \"kubernetes.io/projected/f1e60d13-d6b3-43f8-af0e-2865438288f9-kube-api-access-97txq\") pod \"node-ca-lpbnb\" (UID: \"f1e60d13-d6b3-43f8-af0e-2865438288f9\") " pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.481593 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.481573    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x44cb\" (UniqueName: \"kubernetes.io/projected/1c94c8d6-997a-47ee-a301-a3219e468b73-kube-api-access-x44cb\") pod \"ovnkube-node-kn9vs\" (UID: \"1c94c8d6-997a-47ee-a301-a3219e468b73\") " pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.481664 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.481648    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:10:00.482192 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.482170    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7lzf\" (UniqueName: \"kubernetes.io/projected/79c3d307-c5ec-454d-ab28-c16840b8acef-kube-api-access-j7lzf\") pod \"multus-additional-cni-plugins-8v566\" (UID: \"79c3d307-c5ec-454d-ab28-c16840b8acef\") " pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.599021 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.598938    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6kvtx"
Sep 17 00:10:00.609576 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.609556    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a14f42_47c1_4c0e_b6a9_82a6ee4eb899.slice/crio-706440e8966a13584f5cccdcddd1559a4cc6722e2c52a441fc205970e8a59b73 WatchSource:0}: Error finding container 706440e8966a13584f5cccdcddd1559a4cc6722e2c52a441fc205970e8a59b73: Status 404 returned error can't find the container with id 706440e8966a13584f5cccdcddd1559a4cc6722e2c52a441fc205970e8a59b73
Sep 17 00:10:00.612842 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.612827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:00.620351 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.620334    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-lpbnb"
Sep 17 00:10:00.620639 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.620620    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c94c8d6_997a_47ee_a301_a3219e468b73.slice/crio-c4b986b8ed3738adae2b663e9d69ee24c010166c53e92801030498dcee529ee1 WatchSource:0}: Error finding container c4b986b8ed3738adae2b663e9d69ee24c010166c53e92801030498dcee529ee1: Status 404 returned error can't find the container with id c4b986b8ed3738adae2b663e9d69ee24c010166c53e92801030498dcee529ee1
Sep 17 00:10:00.628668 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.628650    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1e60d13_d6b3_43f8_af0e_2865438288f9.slice/crio-b362eed35f7c0498fed41ff758563060c376e239594495136a884189f52fa2df WatchSource:0}: Error finding container b362eed35f7c0498fed41ff758563060c376e239594495136a884189f52fa2df: Status 404 returned error can't find the container with id b362eed35f7c0498fed41ff758563060c376e239594495136a884189f52fa2df
Sep 17 00:10:00.642854 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.642834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8v566"
Sep 17 00:10:00.651114 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.651091    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c3d307_c5ec_454d_ab28_c16840b8acef.slice/crio-44ff2f65d77496721f0223964b4144824e5cbe363b3802a78623637297815904 WatchSource:0}: Error finding container 44ff2f65d77496721f0223964b4144824e5cbe363b3802a78623637297815904: Status 404 returned error can't find the container with id 44ff2f65d77496721f0223964b4144824e5cbe363b3802a78623637297815904
Sep 17 00:10:00.653549 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.653527    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cpqcg"
Sep 17 00:10:00.661824 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.661803    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cf7de5_498a_482d_b451_a55de2469bb3.slice/crio-e5a426c18a74180be4cf2b3334596daf2b5cee994930e3a59e0cc15074fc1d62 WatchSource:0}: Error finding container e5a426c18a74180be4cf2b3334596daf2b5cee994930e3a59e0cc15074fc1d62: Status 404 returned error can't find the container with id e5a426c18a74180be4cf2b3334596daf2b5cee994930e3a59e0cc15074fc1d62
Sep 17 00:10:00.669169 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.669150    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j"
Sep 17 00:10:00.677507 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.677485    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4b4402_4647_489c_a25a_c162803e2e42.slice/crio-21557f4d536cdc1ed5ddeed01d174fc844701e93fa8ddca1356a4a822ad12f26 WatchSource:0}: Error finding container 21557f4d536cdc1ed5ddeed01d174fc844701e93fa8ddca1356a4a822ad12f26: Status 404 returned error can't find the container with id 21557f4d536cdc1ed5ddeed01d174fc844701e93fa8ddca1356a4a822ad12f26
Sep 17 00:10:00.680565 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.680540    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-f8tg5"
Sep 17 00:10:00.689085 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.689062    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0951f71_9f3e_4292_a2e7_cf9cf1b4546f.slice/crio-b8059ffdc0ca9ecf52aad5d603c43ff8043440e87755e5063fdc4760baf168a4 WatchSource:0}: Error finding container b8059ffdc0ca9ecf52aad5d603c43ff8043440e87755e5063fdc4760baf168a4: Status 404 returned error can't find the container with id b8059ffdc0ca9ecf52aad5d603c43ff8043440e87755e5063fdc4760baf168a4
Sep 17 00:10:00.698479 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.698459    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-22dn7"
Sep 17 00:10:00.703354 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.703333    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:00.708490 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.708200    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6abf865_61c4_4424_99d0_ec707d13f6b5.slice/crio-d9ef868cb7b6e4306b195d92fac02a10b8341fd9680a6b94e083f78118943b59 WatchSource:0}: Error finding container d9ef868cb7b6e4306b195d92fac02a10b8341fd9680a6b94e083f78118943b59: Status 404 returned error can't find the container with id d9ef868cb7b6e4306b195d92fac02a10b8341fd9680a6b94e083f78118943b59
Sep 17 00:10:00.714644 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:00.714619    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46a1a11_4cc1_4a28_b604_6c409d181e54.slice/crio-28496fb9cd7c19169c71af6576c0e140513fdd56b330104fc63bea5c40a868a9 WatchSource:0}: Error finding container 28496fb9cd7c19169c71af6576c0e140513fdd56b330104fc63bea5c40a868a9: Status 404 returned error can't find the container with id 28496fb9cd7c19169c71af6576c0e140513fdd56b330104fc63bea5c40a868a9
Sep 17 00:10:00.971436 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.971349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:00.971436 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:00.971414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:00.971606 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.971441    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:00.971606 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.971504    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs podName:ca6b8957-62ac-403c-a400-1b3c00462448 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:01.971488654 +0000 UTC m=+3.080264548 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs") pod "network-metrics-daemon-8wnd2" (UID: "ca6b8957-62ac-403c-a400-1b3c00462448") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:00.971606 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.971503    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:00.971606 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:00.971550    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret podName:f964a8dc-ec08-49f3-9c5e-a427f7fd695b nodeName:}" failed. No retries permitted until 2026-09-17 00:10:01.971539169 +0000 UTC m=+3.080315078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret") pod "global-pull-secret-syncer-9gcbh" (UID: "f964a8dc-ec08-49f3-9c5e-a427f7fd695b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:01.072336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.072302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:01.072493 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:01.072467    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:01.072493 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:01.072487    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:01.072560 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:01.072497    2565 projected.go:196] Error preparing data for projected volume kube-api-access-n9mw4 for pod openshift-network-diagnostics/network-check-target-d5ff8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:01.072560 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:01.072549    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4 podName:f3f6541d-f62a-4f35-8337-6a79c593386a nodeName:}" failed. No retries permitted until 2026-09-17 00:10:02.072535876 +0000 UTC m=+3.181311770 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9mw4" (UniqueName: "kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4") pod "network-check-target-d5ff8" (UID: "f3f6541d-f62a-4f35-8337-6a79c593386a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:01.199371 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.199341    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:10:01.306330 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.306164    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 00:05:00 +0000 UTC" deadline="2028-02-23 02:10:22.618815617 +0000 UTC"
Sep 17 00:10:01.306330 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.306230    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12578h0m21.312590695s"
Sep 17 00:10:01.386937 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.386306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:01.386937 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:01.386442    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:01.393584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.393314    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-spzhv" event={"ID":"a46a1a11-4cc1-4a28-b604-6c409d181e54","Type":"ContainerStarted","Data":"28496fb9cd7c19169c71af6576c0e140513fdd56b330104fc63bea5c40a868a9"}
Sep 17 00:10:01.406208 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.406170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22dn7" event={"ID":"e6abf865-61c4-4424-99d0-ec707d13f6b5","Type":"ContainerStarted","Data":"d9ef868cb7b6e4306b195d92fac02a10b8341fd9680a6b94e083f78118943b59"}
Sep 17 00:10:01.416543 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.416502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f8tg5" event={"ID":"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f","Type":"ContainerStarted","Data":"b8059ffdc0ca9ecf52aad5d603c43ff8043440e87755e5063fdc4760baf168a4"}
Sep 17 00:10:01.422484 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.422453    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j" event={"ID":"ca4b4402-4647-489c-a25a-c162803e2e42","Type":"ContainerStarted","Data":"21557f4d536cdc1ed5ddeed01d174fc844701e93fa8ddca1356a4a822ad12f26"}
Sep 17 00:10:01.425780 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.425753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cpqcg" event={"ID":"d3cf7de5-498a-482d-b451-a55de2469bb3","Type":"ContainerStarted","Data":"e5a426c18a74180be4cf2b3334596daf2b5cee994930e3a59e0cc15074fc1d62"}
Sep 17 00:10:01.428916 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.428889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lpbnb" event={"ID":"f1e60d13-d6b3-43f8-af0e-2865438288f9","Type":"ContainerStarted","Data":"b362eed35f7c0498fed41ff758563060c376e239594495136a884189f52fa2df"}
Sep 17 00:10:01.441308 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.441279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6kvtx" event={"ID":"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899","Type":"ContainerStarted","Data":"706440e8966a13584f5cccdcddd1559a4cc6722e2c52a441fc205970e8a59b73"}
Sep 17 00:10:01.451824 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.451794    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal" event={"ID":"d7c6efec3d953df3c8f862ee842d933e","Type":"ContainerStarted","Data":"6538f21171b814a641d1f5688b839316f3dd1a0cf36773a9cbbe96f5ba83aa60"}
Sep 17 00:10:01.457413 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.457383    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v566" event={"ID":"79c3d307-c5ec-454d-ab28-c16840b8acef","Type":"ContainerStarted","Data":"44ff2f65d77496721f0223964b4144824e5cbe363b3802a78623637297815904"}
Sep 17 00:10:01.460108 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.459999    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerStarted","Data":"c4b986b8ed3738adae2b663e9d69ee24c010166c53e92801030498dcee529ee1"}
Sep 17 00:10:01.471500 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.471442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal" event={"ID":"d27c8d28f5cb0400d0af03df25605044","Type":"ContainerStarted","Data":"1e6374a1e1d725324064e52a68f52589523d0dcd0b85604545273e6b41d909bf"}
Sep 17 00:10:01.761701 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.761624    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:10:01.982474 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.982432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:01.982687 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:01.982490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:01.982687 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:01.982622    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:01.982825 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:01.982691    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret podName:f964a8dc-ec08-49f3-9c5e-a427f7fd695b nodeName:}" failed. No retries permitted until 2026-09-17 00:10:03.982672123 +0000 UTC m=+5.091448042 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret") pod "global-pull-secret-syncer-9gcbh" (UID: "f964a8dc-ec08-49f3-9c5e-a427f7fd695b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:01.983127 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:01.983108    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:01.983228 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:01.983164    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs podName:ca6b8957-62ac-403c-a400-1b3c00462448 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:03.983146741 +0000 UTC m=+5.091922638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs") pod "network-metrics-daemon-8wnd2" (UID: "ca6b8957-62ac-403c-a400-1b3c00462448") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:02.084008 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:02.083900    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:02.084174 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:02.084116    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:02.084174 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:02.084147    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:02.084174 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:02.084160    2565 projected.go:196] Error preparing data for projected volume kube-api-access-n9mw4 for pod openshift-network-diagnostics/network-check-target-d5ff8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:02.084334 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:02.084221    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4 podName:f3f6541d-f62a-4f35-8337-6a79c593386a nodeName:}" failed. No retries permitted until 2026-09-17 00:10:04.084201191 +0000 UTC m=+5.192977092 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9mw4" (UniqueName: "kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4") pod "network-check-target-d5ff8" (UID: "f3f6541d-f62a-4f35-8337-6a79c593386a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:02.188025 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:02.187760    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:10:02.307124 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:02.307079    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-16 00:05:00 +0000 UTC" deadline="2028-03-25 21:34:35.413851262 +0000 UTC"
Sep 17 00:10:02.307124 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:02.307122    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13341h24m33.10673366s"
Sep 17 00:10:02.383583 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:02.383499    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:02.383754 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:02.383652    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:02.384122 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:02.384100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:02.384258 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:02.384206    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:02.997503 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:02.997170    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 17 00:10:03.383860 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:03.383787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:03.384305 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:03.383944    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:03.999350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:03.999314    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:03.999504 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:03.999367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:03.999504 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:03.999488    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:03.999621 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:03.999528    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:03.999621 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:03.999563    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs podName:ca6b8957-62ac-403c-a400-1b3c00462448 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:07.999542472 +0000 UTC m=+9.108318365 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs") pod "network-metrics-daemon-8wnd2" (UID: "ca6b8957-62ac-403c-a400-1b3c00462448") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:03.999621 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:03.999583    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret podName:f964a8dc-ec08-49f3-9c5e-a427f7fd695b nodeName:}" failed. No retries permitted until 2026-09-17 00:10:07.999573643 +0000 UTC m=+9.108349545 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret") pod "global-pull-secret-syncer-9gcbh" (UID: "f964a8dc-ec08-49f3-9c5e-a427f7fd695b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:04.100951 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:04.100161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:04.100951 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:04.100374    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:04.100951 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:04.100398    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:04.100951 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:04.100411    2565 projected.go:196] Error preparing data for projected volume kube-api-access-n9mw4 for pod openshift-network-diagnostics/network-check-target-d5ff8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:04.100951 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:04.100470    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4 podName:f3f6541d-f62a-4f35-8337-6a79c593386a nodeName:}" failed. No retries permitted until 2026-09-17 00:10:08.100452721 +0000 UTC m=+9.209228628 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9mw4" (UniqueName: "kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4") pod "network-check-target-d5ff8" (UID: "f3f6541d-f62a-4f35-8337-6a79c593386a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:04.383082 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:04.383047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:04.383254 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:04.383199    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:04.383601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:04.383576    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:04.383717 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:04.383695    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:05.384550 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:05.384026    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:05.384550 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:05.384154    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:06.383927 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:06.383424    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:06.383927 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:06.383564    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:06.383927 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:06.383636    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:06.383927 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:06.383768    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:07.386571 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:07.386536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:07.387080 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:07.386654    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:08.034099 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:08.034065    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:08.034273 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:08.034111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:08.034273 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.034243    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:08.034439 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.034311    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret podName:f964a8dc-ec08-49f3-9c5e-a427f7fd695b nodeName:}" failed. No retries permitted until 2026-09-17 00:10:16.034291941 +0000 UTC m=+17.143067848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret") pod "global-pull-secret-syncer-9gcbh" (UID: "f964a8dc-ec08-49f3-9c5e-a427f7fd695b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:08.034439 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.034307    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:08.034439 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.034350    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs podName:ca6b8957-62ac-403c-a400-1b3c00462448 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:16.034339804 +0000 UTC m=+17.143115699 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs") pod "network-metrics-daemon-8wnd2" (UID: "ca6b8957-62ac-403c-a400-1b3c00462448") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:08.135011 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:08.134916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:08.135183 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.135089    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:08.135183 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.135111    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:08.135183 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.135123    2565 projected.go:196] Error preparing data for projected volume kube-api-access-n9mw4 for pod openshift-network-diagnostics/network-check-target-d5ff8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:08.135183 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.135173    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4 podName:f3f6541d-f62a-4f35-8337-6a79c593386a nodeName:}" failed. No retries permitted until 2026-09-17 00:10:16.13515721 +0000 UTC m=+17.243933116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9mw4" (UniqueName: "kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4") pod "network-check-target-d5ff8" (UID: "f3f6541d-f62a-4f35-8337-6a79c593386a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:08.384009 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:08.383907    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:08.384009 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:08.383951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:08.384236 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.384061    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:08.384236 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:08.384132    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:09.384791 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:09.384751    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:09.385267 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:09.384873    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:10.383612 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:10.383579    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:10.383805 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:10.383704    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:10.383805 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:10.383758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:10.383890 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:10.383872    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:11.383542 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:11.383513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:11.384034 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:11.383620    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:12.383304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:12.383267    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:12.383456 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:12.383322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:12.383456 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:12.383390    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:12.383537 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:12.383519    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:13.383289 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:13.383251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:13.383761 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:13.383411    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:14.383818 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:14.383574    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:14.384294 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:14.383585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:14.384294 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:14.383909    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:14.384294 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:14.384032    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:15.383745 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:15.383705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:15.383941 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:15.383850    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:16.092401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:16.092368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:16.092401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:16.092407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:16.092684 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.092524    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:16.092684 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.092581    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret podName:f964a8dc-ec08-49f3-9c5e-a427f7fd695b nodeName:}" failed. No retries permitted until 2026-09-17 00:10:32.092564832 +0000 UTC m=+33.201340726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret") pod "global-pull-secret-syncer-9gcbh" (UID: "f964a8dc-ec08-49f3-9c5e-a427f7fd695b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:16.092684 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.092525    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:16.092684 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.092669    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs podName:ca6b8957-62ac-403c-a400-1b3c00462448 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:32.092649532 +0000 UTC m=+33.201425429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs") pod "network-metrics-daemon-8wnd2" (UID: "ca6b8957-62ac-403c-a400-1b3c00462448") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:16.192968 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:16.192940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:16.193116 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.193059    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:16.193116 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.193075    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:16.193116 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.193083    2565 projected.go:196] Error preparing data for projected volume kube-api-access-n9mw4 for pod openshift-network-diagnostics/network-check-target-d5ff8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:16.193213 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.193125    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4 podName:f3f6541d-f62a-4f35-8337-6a79c593386a nodeName:}" failed. No retries permitted until 2026-09-17 00:10:32.193113051 +0000 UTC m=+33.301888944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9mw4" (UniqueName: "kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4") pod "network-check-target-d5ff8" (UID: "f3f6541d-f62a-4f35-8337-6a79c593386a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:16.382786 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:16.382760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:16.382961 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.382875    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:16.382961 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:16.382931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:16.383069 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:16.383052    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:17.383691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:17.383662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:17.384116 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:17.383800    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:18.383875 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:18.383822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:18.384348 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:18.383822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:18.384348 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:18.383981    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:18.384348 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:18.384071    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:19.384392 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:19.384358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:19.384828 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:19.384454    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:20.383306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.383023    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:20.383428 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.383098    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:20.383428 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:20.383328    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:20.383428 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:20.383409    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:20.522516 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.522251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-22dn7" event={"ID":"e6abf865-61c4-4424-99d0-ec707d13f6b5","Type":"ContainerStarted","Data":"9020d31ccecf486b377291e2b56bc6c741b496e12953cb6334ace31b1f68fa33"}
Sep 17 00:10:20.529747 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.529651    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cpqcg" event={"ID":"d3cf7de5-498a-482d-b451-a55de2469bb3","Type":"ContainerStarted","Data":"c1619319d0158f1368c63489d638abdfce36e0832a4bee07049b46aa682d2f19"}
Sep 17 00:10:20.537223 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.537163    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-22dn7" podStartSLOduration=2.4482345309999998 podStartE2EDuration="21.537142494s" totalImagesPullingTime="19.088907963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:20.536927731 +0000 UTC m=+21.645703646" watchObservedRunningTime="2026-09-17 00:10:20.537142494 +0000 UTC m=+21.645918475"
Sep 17 00:10:20.547707 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.547637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal" event={"ID":"d7c6efec3d953df3c8f862ee842d933e","Type":"ContainerStarted","Data":"e52e525bb082bafe84d5d88ad59cedef5e17d3a0d7bfd76ad3e08b2c43be89e7"}
Sep 17 00:10:20.560469 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.560446    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:10:20.561154 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.561118    2565 generic.go:356] "Generic (PLEG): container finished" podID="1c94c8d6-997a-47ee-a301-a3219e468b73" containerID="efac6bcf0c111056d62336836e02e6a3891cd914640db4347322a79052ed4cce" exitCode=1
Sep 17 00:10:20.561370 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.561164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerStarted","Data":"f9648240a6cbd3aa3a8f577c36c555c1e440fd6a14523ec4fe9512505cc96489"}
Sep 17 00:10:20.561370 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.561235    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerStarted","Data":"c4b9fcb00838413712cbb166ec946f5fa9e3496fb3c310dc51e1e4d1b51136ad"}
Sep 17 00:10:20.561370 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.561285    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerStarted","Data":"0a3e1cbddb9f67917d055fde21a45a0da4e7d4471810653cd1166e5e443c20d3"}
Sep 17 00:10:20.561370 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.561333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerDied","Data":"efac6bcf0c111056d62336836e02e6a3891cd914640db4347322a79052ed4cce"}
Sep 17 00:10:20.561595 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.561382    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerStarted","Data":"41ea872e94d74621b352124b3330f6a627b2231c4bfaea6036b2a4902158ddd5"}
Sep 17 00:10:20.566999 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.566945    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cpqcg" podStartSLOduration=1.92409741 podStartE2EDuration="21.566925757s" totalImagesPullingTime="19.642828347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:20.554582167 +0000 UTC m=+21.663358083" watchObservedRunningTime="2026-09-17 00:10:20.566925757 +0000 UTC m=+21.675701673"
Sep 17 00:10:20.567260 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:20.567137    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal" podStartSLOduration=20.567124177 podStartE2EDuration="20.567124177s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:20.56666239 +0000 UTC m=+21.675438306" watchObservedRunningTime="2026-09-17 00:10:20.567124177 +0000 UTC m=+21.675900093"
Sep 17 00:10:21.383085 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.383060    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:21.383220 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:21.383150    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:21.564951 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.564853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-spzhv" event={"ID":"a46a1a11-4cc1-4a28-b604-6c409d181e54","Type":"ContainerStarted","Data":"ba112eace5abd72c608407ec197cc5f3c541b57a6f1522cc760543c1ddfd284b"}
Sep 17 00:10:21.567127 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.567097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-f8tg5" event={"ID":"a0951f71-9f3e-4292-a2e7-cf9cf1b4546f","Type":"ContainerStarted","Data":"79bd4e3f7bd7791740aa23fd4b70cde723ab9ec9f11a46159c08bb596529781c"}
Sep 17 00:10:21.568851 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.568826    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j" event={"ID":"ca4b4402-4647-489c-a25a-c162803e2e42","Type":"ContainerStarted","Data":"e0b39e8b2eeec0263d535a6edb572f4dbf4f85586d427ee7cb58d4217be8faa1"}
Sep 17 00:10:21.570646 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.570514    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-lpbnb" event={"ID":"f1e60d13-d6b3-43f8-af0e-2865438288f9","Type":"ContainerStarted","Data":"6f8edff0c9bec14f86ba1429f8f2aac290272e43bd860b372616fd74fea11431"}
Sep 17 00:10:21.572165 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.572143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6kvtx" event={"ID":"05a14f42-47c1-4c0e-b6a9-82a6ee4eb899","Type":"ContainerStarted","Data":"740abcfcf1058a8f9daecd09bc3a2ca0acc6bd8426474e4e3a6caeae77edc5e6"}
Sep 17 00:10:21.573981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.573958    2565 generic.go:356] "Generic (PLEG): container finished" podID="79c3d307-c5ec-454d-ab28-c16840b8acef" containerID="61c05100eaa07441994c769e2421d00a23adac520e8bb762d601ec1fb3e07d28" exitCode=0
Sep 17 00:10:21.574057 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.574036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v566" event={"ID":"79c3d307-c5ec-454d-ab28-c16840b8acef","Type":"ContainerDied","Data":"61c05100eaa07441994c769e2421d00a23adac520e8bb762d601ec1fb3e07d28"}
Sep 17 00:10:21.579515 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.579471    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-spzhv" podStartSLOduration=3.5301397039999998 podStartE2EDuration="22.579453954s" totalImagesPullingTime="19.04931425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.578547593 +0000 UTC m=+22.687323506" watchObservedRunningTime="2026-09-17 00:10:21.579453954 +0000 UTC m=+22.688229870"
Sep 17 00:10:21.580798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.580778    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:10:21.581209 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.581186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerStarted","Data":"6b3aa57e3bcd3408a7a5fb7e4c57f8b87cba420d3e784791dc6c7b12fec6eb62"}
Sep 17 00:10:21.582918 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.582829    2565 generic.go:356] "Generic (PLEG): container finished" podID="d27c8d28f5cb0400d0af03df25605044" containerID="a669a8fc919f1f3ee3f11e7536a70a25344f93673a39fdc117a8edb554aac28d" exitCode=0
Sep 17 00:10:21.582918 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.582911    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal" event={"ID":"d27c8d28f5cb0400d0af03df25605044","Type":"ContainerDied","Data":"a669a8fc919f1f3ee3f11e7536a70a25344f93673a39fdc117a8edb554aac28d"}
Sep 17 00:10:21.611835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.611794    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-lpbnb" podStartSLOduration=3.4762672820000002 podStartE2EDuration="22.611778875s" totalImagesPullingTime="19.135511593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.591217307 +0000 UTC m=+22.699993222" watchObservedRunningTime="2026-09-17 00:10:21.611778875 +0000 UTC m=+22.720554792"
Sep 17 00:10:21.627453 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.627408    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-f8tg5" podStartSLOduration=3.552431464 podStartE2EDuration="22.627391171s" totalImagesPullingTime="19.074959707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.627092516 +0000 UTC m=+22.735868435" watchObservedRunningTime="2026-09-17 00:10:21.627391171 +0000 UTC m=+22.736167087"
Sep 17 00:10:21.641828 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:21.641795    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6kvtx" podStartSLOduration=3.452893508 podStartE2EDuration="22.641780577s" totalImagesPullingTime="19.188887069s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:21.641491177 +0000 UTC m=+22.750267093" watchObservedRunningTime="2026-09-17 00:10:21.641780577 +0000 UTC m=+22.750556493"
Sep 17 00:10:22.153241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:22.153217    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 17 00:10:22.323487 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:22.323385    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-17T00:10:22.153237275Z","UUID":"fce2cac7-ceca-4c72-9ec5-88a251605763","Handler":null,"Name":"","Endpoint":""}
Sep 17 00:10:22.325534 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:22.325515    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 17 00:10:22.325654 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:22.325550    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 17 00:10:22.382952 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:22.382925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:22.383107 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:22.382929    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:22.383107 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:22.383042    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:22.383215 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:22.383134    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:22.587792 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:22.587704    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal" event={"ID":"d27c8d28f5cb0400d0af03df25605044","Type":"ContainerStarted","Data":"7062d93ac267b33d31d71f5fc72f7158574d3f47bcbfb8750490a1e9132d4429"}
Sep 17 00:10:22.589889 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:22.589855    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j" event={"ID":"ca4b4402-4647-489c-a25a-c162803e2e42","Type":"ContainerStarted","Data":"8acbe4ebc20ac52d7c2f968d5a3e9be4dfaaf2912775e9e78dc725bc5eb95de1"}
Sep 17 00:10:22.602214 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:22.602167    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-192.ec2.internal" podStartSLOduration=22.602149317 podStartE2EDuration="22.602149317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:10:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:22.601719673 +0000 UTC m=+23.710495588" watchObservedRunningTime="2026-09-17 00:10:22.602149317 +0000 UTC m=+23.710925229"
Sep 17 00:10:23.383691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:23.383665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:23.383840 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:23.383815    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:23.595780 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:23.595697    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:10:23.596192 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:23.596151    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerStarted","Data":"e7f069d92020cbc30daec2264d19dc4f3e4a30f4f1779b37f360920181077c50"}
Sep 17 00:10:23.598603 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:23.598559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j" event={"ID":"ca4b4402-4647-489c-a25a-c162803e2e42","Type":"ContainerStarted","Data":"7fa2ed59845d32fef167daa944fd6270184d0fad37f85882834f0fbcbd03ba84"}
Sep 17 00:10:23.617732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:23.617691    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-85j7j" podStartSLOduration=3.001431473 podStartE2EDuration="24.617678821s" totalImagesPullingTime="21.616247348s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:23.615876277 +0000 UTC m=+24.724652191" watchObservedRunningTime="2026-09-17 00:10:23.617678821 +0000 UTC m=+24.726454779"
Sep 17 00:10:24.383166 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:24.383135    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:24.383337 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:24.383137    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:24.383337 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:24.383260    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:24.383454 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:24.383402    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:25.383638 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:25.383606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:25.384103 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:25.383713    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:26.239635 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:26.239474    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:26.240028 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:26.240009    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:26.382980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:26.382951    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:26.383069 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:26.382992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:26.383069 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:26.383055    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:26.383188 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:26.383171    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:26.606714 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:26.606681    2565 generic.go:356] "Generic (PLEG): container finished" podID="79c3d307-c5ec-454d-ab28-c16840b8acef" containerID="a73e52678d0ba3c819d0e3157bc65fb08f21a5da21b1591a9b3d39bfd3eb8e0d" exitCode=0
Sep 17 00:10:26.607121 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:26.606744    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v566" event={"ID":"79c3d307-c5ec-454d-ab28-c16840b8acef","Type":"ContainerDied","Data":"a73e52678d0ba3c819d0e3157bc65fb08f21a5da21b1591a9b3d39bfd3eb8e0d"}
Sep 17 00:10:26.610575 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:26.610559    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:10:26.610953 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:26.610930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerStarted","Data":"0df32274b6f29a7b2dc1ceffbf5e70b0ceb65b347bf4ed05ded0e126884bb23c"}
Sep 17 00:10:26.611745 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:26.611667    2565 scope.go:117] "RemoveContainer" containerID="efac6bcf0c111056d62336836e02e6a3891cd914640db4347322a79052ed4cce"
Sep 17 00:10:27.383346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.383321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:27.383469 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:27.383447    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:27.617518 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.617493    2565 generic.go:356] "Generic (PLEG): container finished" podID="79c3d307-c5ec-454d-ab28-c16840b8acef" containerID="b74116c66aff8552c15c4d0fc68ed0fc4b1bd8a2b973e563b49c54bf3aa52e3f" exitCode=0
Sep 17 00:10:27.618379 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.617585    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v566" event={"ID":"79c3d307-c5ec-454d-ab28-c16840b8acef","Type":"ContainerDied","Data":"b74116c66aff8552c15c4d0fc68ed0fc4b1bd8a2b973e563b49c54bf3aa52e3f"}
Sep 17 00:10:27.622150 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.622128    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:10:27.622551 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.622529    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" event={"ID":"1c94c8d6-997a-47ee-a301-a3219e468b73","Type":"ContainerStarted","Data":"61aa1264efa14e1a564dad354fdb8bfec4c91d277ed63098e12f1432ef35e249"}
Sep 17 00:10:27.622764 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.622738    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:27.622875 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.622802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:27.622875 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.622852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:27.637706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.637685    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:27.638161 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.638138    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:10:27.656719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.656698    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:27.656819 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.656809    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 17 00:10:27.657254 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.657237    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-spzhv"
Sep 17 00:10:27.663378 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.663346    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs" podStartSLOduration=9.452877512 podStartE2EDuration="28.663334624s" totalImagesPullingTime="19.210457112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:27.661873406 +0000 UTC m=+28.770649320" watchObservedRunningTime="2026-09-17 00:10:27.663334624 +0000 UTC m=+28.772110538"
Sep 17 00:10:27.730690 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.730662    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9gcbh"]
Sep 17 00:10:27.730811 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.730794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:27.730935 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:27.730910    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:27.734385 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.734363    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d5ff8"]
Sep 17 00:10:27.734487 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.734455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:27.734557 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:27.734532    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:27.735055 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.735027    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8wnd2"]
Sep 17 00:10:27.735181 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:27.735165    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:27.735300 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:27.735279    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:29.384590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:29.384418    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:29.385036 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:29.384484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:29.385036 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:29.384652    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:29.385036 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:29.384505    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:29.385036 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:29.384726    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:29.385036 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:29.384813    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:29.629709 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:29.629677    2565 generic.go:356] "Generic (PLEG): container finished" podID="79c3d307-c5ec-454d-ab28-c16840b8acef" containerID="da234d53f16b098e89188d5b99e4701bd62e72eae386ec7aa96ea39d33eb7cc9" exitCode=0
Sep 17 00:10:29.629870 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:29.629758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v566" event={"ID":"79c3d307-c5ec-454d-ab28-c16840b8acef","Type":"ContainerDied","Data":"da234d53f16b098e89188d5b99e4701bd62e72eae386ec7aa96ea39d33eb7cc9"}
Sep 17 00:10:31.382866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:31.382814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:31.382866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:31.382853    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:31.383391 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:31.382814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:31.383391 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:31.382950    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-d5ff8" podUID="f3f6541d-f62a-4f35-8337-6a79c593386a"
Sep 17 00:10:31.383391 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:31.383044    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:10:31.383391 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:31.383133    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9gcbh" podUID="f964a8dc-ec08-49f3-9c5e-a427f7fd695b"
Sep 17 00:10:32.114525 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:32.114492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:32.114683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:32.114539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:32.114683 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:32.114652    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:32.114683 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:32.114656    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:32.114794 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:32.114711    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret podName:f964a8dc-ec08-49f3-9c5e-a427f7fd695b nodeName:}" failed. No retries permitted until 2026-09-17 00:11:04.114697325 +0000 UTC m=+65.223473223 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret") pod "global-pull-secret-syncer-9gcbh" (UID: "f964a8dc-ec08-49f3-9c5e-a427f7fd695b") : object "kube-system"/"original-pull-secret" not registered
Sep 17 00:10:32.114794 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:32.114725    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs podName:ca6b8957-62ac-403c-a400-1b3c00462448 nodeName:}" failed. No retries permitted until 2026-09-17 00:11:04.114718339 +0000 UTC m=+65.223494232 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs") pod "network-metrics-daemon-8wnd2" (UID: "ca6b8957-62ac-403c-a400-1b3c00462448") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 17 00:10:32.215136 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:32.215105    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:32.215303 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:32.215253    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 17 00:10:32.215303 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:32.215273    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 17 00:10:32.215303 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:32.215282    2565 projected.go:196] Error preparing data for projected volume kube-api-access-n9mw4 for pod openshift-network-diagnostics/network-check-target-d5ff8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:32.215461 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:32.215339    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4 podName:f3f6541d-f62a-4f35-8337-6a79c593386a nodeName:}" failed. No retries permitted until 2026-09-17 00:11:04.215322098 +0000 UTC m=+65.324097993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-n9mw4" (UniqueName: "kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4") pod "network-check-target-d5ff8" (UID: "f3f6541d-f62a-4f35-8337-6a79c593386a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 17 00:10:33.110867 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.110836    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-192.ec2.internal" event="NodeReady"
Sep 17 00:10:33.111280 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.111011    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 17 00:10:33.156657 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.156623    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nw6jd"]
Sep 17 00:10:33.184579 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.184549    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qb7zm"]
Sep 17 00:10:33.184719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.184690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.187353 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.187308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 17 00:10:33.187483 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.187432    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d74lr\""
Sep 17 00:10:33.187579 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.187564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 17 00:10:33.200305 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.200286    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qb7zm"]
Sep 17 00:10:33.200410 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.200321    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nw6jd"]
Sep 17 00:10:33.200459 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.200428    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qb7zm"
Sep 17 00:10:33.203367 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.203336    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 17 00:10:33.203578 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.203553    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 17 00:10:33.203833 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.203813    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cbrk8\""
Sep 17 00:10:33.203963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.203878    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 17 00:10:33.323614 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.323583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8phdw\" (UniqueName: \"kubernetes.io/projected/2dba56c7-2ca8-416c-af7c-8057b63fb437-kube-api-access-8phdw\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.323791 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.323704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2dba56c7-2ca8-416c-af7c-8057b63fb437-config-volume\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.323791 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.323752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.323791 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.323780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dba56c7-2ca8-416c-af7c-8057b63fb437-tmp-dir\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.324036 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.323923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/497786de-13ef-4479-b0bf-7a6fcf911f8c-cert\") pod \"ingress-canary-qb7zm\" (UID: \"497786de-13ef-4479-b0bf-7a6fcf911f8c\") " pod="openshift-ingress-canary/ingress-canary-qb7zm"
Sep 17 00:10:33.324036 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.323957    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln7h8\" (UniqueName: \"kubernetes.io/projected/497786de-13ef-4479-b0bf-7a6fcf911f8c-kube-api-access-ln7h8\") pod \"ingress-canary-qb7zm\" (UID: \"497786de-13ef-4479-b0bf-7a6fcf911f8c\") " pod="openshift-ingress-canary/ingress-canary-qb7zm"
Sep 17 00:10:33.383114 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.383050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:10:33.383114 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.383097    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:10:33.383289 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.383050    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:10:33.386182 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.386160    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 00:10:33.386182 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.386179    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 00:10:33.386364 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.386162    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 00:10:33.386364 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.386196    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 00:10:33.386364 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.386184    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86j4t\""
Sep 17 00:10:33.386364 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.386295    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxlvp\""
Sep 17 00:10:33.425223 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.425202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/497786de-13ef-4479-b0bf-7a6fcf911f8c-cert\") pod \"ingress-canary-qb7zm\" (UID: \"497786de-13ef-4479-b0bf-7a6fcf911f8c\") " pod="openshift-ingress-canary/ingress-canary-qb7zm"
Sep 17 00:10:33.425339 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.425238    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ln7h8\" (UniqueName: \"kubernetes.io/projected/497786de-13ef-4479-b0bf-7a6fcf911f8c-kube-api-access-ln7h8\") pod \"ingress-canary-qb7zm\" (UID: \"497786de-13ef-4479-b0bf-7a6fcf911f8c\") " pod="openshift-ingress-canary/ingress-canary-qb7zm"
Sep 17 00:10:33.425339 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.425277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8phdw\" (UniqueName: \"kubernetes.io/projected/2dba56c7-2ca8-416c-af7c-8057b63fb437-kube-api-access-8phdw\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.425339 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.425330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2dba56c7-2ca8-416c-af7c-8057b63fb437-config-volume\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.425500 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.425350    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.425500 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.425376    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dba56c7-2ca8-416c-af7c-8057b63fb437-tmp-dir\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.425594 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:33.425505    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:33.425594 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:33.425564    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls podName:2dba56c7-2ca8-416c-af7c-8057b63fb437 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:33.925548748 +0000 UTC m=+35.034324641 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls") pod "dns-default-nw6jd" (UID: "2dba56c7-2ca8-416c-af7c-8057b63fb437") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:33.425814 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.425797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2dba56c7-2ca8-416c-af7c-8057b63fb437-tmp-dir\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.425876 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.425858    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2dba56c7-2ca8-416c-af7c-8057b63fb437-config-volume\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.430030 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.430012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/497786de-13ef-4479-b0bf-7a6fcf911f8c-cert\") pod \"ingress-canary-qb7zm\" (UID: \"497786de-13ef-4479-b0bf-7a6fcf911f8c\") " pod="openshift-ingress-canary/ingress-canary-qb7zm"
Sep 17 00:10:33.433876 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.433834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8phdw\" (UniqueName: \"kubernetes.io/projected/2dba56c7-2ca8-416c-af7c-8057b63fb437-kube-api-access-8phdw\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.434178 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.434155    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln7h8\" (UniqueName: \"kubernetes.io/projected/497786de-13ef-4479-b0bf-7a6fcf911f8c-kube-api-access-ln7h8\") pod \"ingress-canary-qb7zm\" (UID: \"497786de-13ef-4479-b0bf-7a6fcf911f8c\") " pod="openshift-ingress-canary/ingress-canary-qb7zm"
Sep 17 00:10:33.509993 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.509966    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qb7zm"
Sep 17 00:10:33.929433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:33.929396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:33.929616 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:33.929517    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:33.929616 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:33.929574    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls podName:2dba56c7-2ca8-416c-af7c-8057b63fb437 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:34.929558322 +0000 UTC m=+36.038334218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls") pod "dns-default-nw6jd" (UID: "2dba56c7-2ca8-416c-af7c-8057b63fb437") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:34.482768 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:34.482700    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qb7zm"]
Sep 17 00:10:34.486614 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:10:34.486589    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod497786de_13ef_4479_b0bf_7a6fcf911f8c.slice/crio-9f156f55545302fb9c91309d82040b52bbf1d5b2d0c5d4b6bba494e42cbf3588 WatchSource:0}: Error finding container 9f156f55545302fb9c91309d82040b52bbf1d5b2d0c5d4b6bba494e42cbf3588: Status 404 returned error can't find the container with id 9f156f55545302fb9c91309d82040b52bbf1d5b2d0c5d4b6bba494e42cbf3588
Sep 17 00:10:34.644502 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:34.644341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v566" event={"ID":"79c3d307-c5ec-454d-ab28-c16840b8acef","Type":"ContainerStarted","Data":"9f98f57d7e336f858c44fad4a709eda7158560de9ffdfa5b4196a07792d9e778"}
Sep 17 00:10:34.645726 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:34.645702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qb7zm" event={"ID":"497786de-13ef-4479-b0bf-7a6fcf911f8c","Type":"ContainerStarted","Data":"9f156f55545302fb9c91309d82040b52bbf1d5b2d0c5d4b6bba494e42cbf3588"}
Sep 17 00:10:34.935587 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:34.935558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:34.935718 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:34.935670    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:34.935763 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:34.935725    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls podName:2dba56c7-2ca8-416c-af7c-8057b63fb437 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:36.935705338 +0000 UTC m=+38.044481230 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls") pod "dns-default-nw6jd" (UID: "2dba56c7-2ca8-416c-af7c-8057b63fb437") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:35.652803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:35.652723    2565 generic.go:356] "Generic (PLEG): container finished" podID="79c3d307-c5ec-454d-ab28-c16840b8acef" containerID="9f98f57d7e336f858c44fad4a709eda7158560de9ffdfa5b4196a07792d9e778" exitCode=0
Sep 17 00:10:35.653258 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:35.652805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v566" event={"ID":"79c3d307-c5ec-454d-ab28-c16840b8acef","Type":"ContainerDied","Data":"9f98f57d7e336f858c44fad4a709eda7158560de9ffdfa5b4196a07792d9e778"}
Sep 17 00:10:36.659447 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:36.659279    2565 generic.go:356] "Generic (PLEG): container finished" podID="79c3d307-c5ec-454d-ab28-c16840b8acef" containerID="4bf6ee1ece59dcd7c7c34b59b333985dfc2fe35a377c46595528475ca98e97e7" exitCode=0
Sep 17 00:10:36.659447 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:36.659350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v566" event={"ID":"79c3d307-c5ec-454d-ab28-c16840b8acef","Type":"ContainerDied","Data":"4bf6ee1ece59dcd7c7c34b59b333985dfc2fe35a377c46595528475ca98e97e7"}
Sep 17 00:10:36.951457 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:36.951384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:36.951591 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:36.951555    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:36.951662 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:36.951631    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls podName:2dba56c7-2ca8-416c-af7c-8057b63fb437 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:40.951610967 +0000 UTC m=+42.060386862 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls") pod "dns-default-nw6jd" (UID: "2dba56c7-2ca8-416c-af7c-8057b63fb437") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:37.664771 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:37.664698    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8v566" event={"ID":"79c3d307-c5ec-454d-ab28-c16840b8acef","Type":"ContainerStarted","Data":"eaded39f7ac6b51081de86fee5885843b5b2c2889c50e67f670e5e68d221c37b"}
Sep 17 00:10:37.666184 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:37.666160    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qb7zm" event={"ID":"497786de-13ef-4479-b0bf-7a6fcf911f8c","Type":"ContainerStarted","Data":"3bee35903c98a7155b6912973a22205546a3af367e9677f4ebf8d7f9ee9e176c"}
Sep 17 00:10:37.685422 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:37.685384    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8v566" podStartSLOduration=8.148042745 podStartE2EDuration="38.685372113s" totalImagesPullingTime="30.537329368s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:37.683788455 +0000 UTC m=+38.792564389" watchObservedRunningTime="2026-09-17 00:10:37.685372113 +0000 UTC m=+38.794148028"
Sep 17 00:10:37.698430 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:37.698389    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qb7zm" podStartSLOduration=2.209039127 podStartE2EDuration="4.698375587s" totalImagesPullingTime="2.48933646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:10:37.697689002 +0000 UTC m=+38.806464918" watchObservedRunningTime="2026-09-17 00:10:37.698375587 +0000 UTC m=+38.807151492"
Sep 17 00:10:40.979507 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:40.979471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:40.979936 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:40.979625    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:40.979936 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:40.979688    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls podName:2dba56c7-2ca8-416c-af7c-8057b63fb437 nodeName:}" failed. No retries permitted until 2026-09-17 00:10:48.9796725 +0000 UTC m=+50.088448393 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls") pod "dns-default-nw6jd" (UID: "2dba56c7-2ca8-416c-af7c-8057b63fb437") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:49.033070 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:49.033033    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:10:49.033550 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:49.033194    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:10:49.033550 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:10:49.033268    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls podName:2dba56c7-2ca8-416c-af7c-8057b63fb437 nodeName:}" failed. No retries permitted until 2026-09-17 00:11:05.033251912 +0000 UTC m=+66.142027804 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls") pod "dns-default-nw6jd" (UID: "2dba56c7-2ca8-416c-af7c-8057b63fb437") : secret "dns-default-metrics-tls" not found
Sep 17 00:10:59.639216 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:10:59.639189    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kn9vs"
Sep 17 00:11:04.129206 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.129164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:11:04.129568 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.129216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:11:04.131802 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.131781    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 17 00:11:04.131802 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.131799    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 17 00:11:04.140036 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:11:04.140017    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 00:11:04.140097 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:11:04.140086    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs podName:ca6b8957-62ac-403c-a400-1b3c00462448 nodeName:}" failed. No retries permitted until 2026-09-17 00:12:08.140063211 +0000 UTC m=+129.248839114 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs") pod "network-metrics-daemon-8wnd2" (UID: "ca6b8957-62ac-403c-a400-1b3c00462448") : secret "metrics-daemon-secret" not found
Sep 17 00:11:04.142937 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.142908    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f964a8dc-ec08-49f3-9c5e-a427f7fd695b-original-pull-secret\") pod \"global-pull-secret-syncer-9gcbh\" (UID: \"f964a8dc-ec08-49f3-9c5e-a427f7fd695b\") " pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:11:04.229663 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.229636    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:11:04.232344 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.232326    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 17 00:11:04.243253 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.243235    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 17 00:11:04.253453 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.253428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9mw4\" (UniqueName: \"kubernetes.io/projected/f3f6541d-f62a-4f35-8337-6a79c593386a-kube-api-access-n9mw4\") pod \"network-check-target-d5ff8\" (UID: \"f3f6541d-f62a-4f35-8337-6a79c593386a\") " pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:11:04.296419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.296398    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86j4t\""
Sep 17 00:11:04.300509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.300494    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9gcbh"
Sep 17 00:11:04.304633 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.304615    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:11:04.595143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.595113    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9gcbh"]
Sep 17 00:11:04.597932 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:11:04.597891    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf964a8dc_ec08_49f3_9c5e_a427f7fd695b.slice/crio-6e00bb7fbdb546d047da3b3ec11afc651eec69f48f03d6d4c2d5e45c5f63e9d3 WatchSource:0}: Error finding container 6e00bb7fbdb546d047da3b3ec11afc651eec69f48f03d6d4c2d5e45c5f63e9d3: Status 404 returned error can't find the container with id 6e00bb7fbdb546d047da3b3ec11afc651eec69f48f03d6d4c2d5e45c5f63e9d3
Sep 17 00:11:04.616267 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.616246    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-d5ff8"]
Sep 17 00:11:04.618491 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:11:04.618470    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3f6541d_f62a_4f35_8337_6a79c593386a.slice/crio-59d1ca97123c6764e62b90d5e35f3cd07d7be361cf99a1114d4a69c023854423 WatchSource:0}: Error finding container 59d1ca97123c6764e62b90d5e35f3cd07d7be361cf99a1114d4a69c023854423: Status 404 returned error can't find the container with id 59d1ca97123c6764e62b90d5e35f3cd07d7be361cf99a1114d4a69c023854423
Sep 17 00:11:04.728236 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.728172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d5ff8" event={"ID":"f3f6541d-f62a-4f35-8337-6a79c593386a","Type":"ContainerStarted","Data":"59d1ca97123c6764e62b90d5e35f3cd07d7be361cf99a1114d4a69c023854423"}
Sep 17 00:11:04.729216 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:04.729195    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9gcbh" event={"ID":"f964a8dc-ec08-49f3-9c5e-a427f7fd695b","Type":"ContainerStarted","Data":"6e00bb7fbdb546d047da3b3ec11afc651eec69f48f03d6d4c2d5e45c5f63e9d3"}
Sep 17 00:11:05.035168 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:05.035091    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:11:05.035288 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:11:05.035224    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:11:05.035288 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:11:05.035287    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls podName:2dba56c7-2ca8-416c-af7c-8057b63fb437 nodeName:}" failed. No retries permitted until 2026-09-17 00:11:37.035270551 +0000 UTC m=+98.144046457 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls") pod "dns-default-nw6jd" (UID: "2dba56c7-2ca8-416c-af7c-8057b63fb437") : secret "dns-default-metrics-tls" not found
Sep 17 00:11:08.742273 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:08.742222    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-d5ff8" event={"ID":"f3f6541d-f62a-4f35-8337-6a79c593386a","Type":"ContainerStarted","Data":"99bf5e4f68cf432557102629bcfe3cf28d79b33ccd367997720394419c4ec352"}
Sep 17 00:11:08.742706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:08.742373    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:11:08.757703 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:08.757655    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-d5ff8" podStartSLOduration=66.648287531 podStartE2EDuration="1m9.757637277s" totalImagesPullingTime="3.109349746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:11:08.756661766 +0000 UTC m=+69.865437681" watchObservedRunningTime="2026-09-17 00:11:08.757637277 +0000 UTC m=+69.866413193"
Sep 17 00:11:09.746589 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:09.746546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9gcbh" event={"ID":"f964a8dc-ec08-49f3-9c5e-a427f7fd695b","Type":"ContainerStarted","Data":"852a97b9e1577f8321a1393ca776b2c1c3a581053b13e623296e507c70863808"}
Sep 17 00:11:09.761097 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:09.761053    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9gcbh" podStartSLOduration=66.224041156 podStartE2EDuration="1m10.761037783s" totalImagesPullingTime="4.536996627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:11:09.76063243 +0000 UTC m=+70.869408560" watchObservedRunningTime="2026-09-17 00:11:09.761037783 +0000 UTC m=+70.869813689"
Sep 17 00:11:37.040719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:37.040601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:11:37.041234 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:11:37.040730    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:11:37.041234 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:11:37.040797    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls podName:2dba56c7-2ca8-416c-af7c-8057b63fb437 nodeName:}" failed. No retries permitted until 2026-09-17 00:12:41.040780463 +0000 UTC m=+162.149556374 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls") pod "dns-default-nw6jd" (UID: "2dba56c7-2ca8-416c-af7c-8057b63fb437") : secret "dns-default-metrics-tls" not found
Sep 17 00:11:39.748672 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:11:39.748641    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-d5ff8"
Sep 17 00:12:08.239173 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:12:08.239133    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:12:08.239631 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:12:08.239231    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 17 00:12:08.239631 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:12:08.239294    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs podName:ca6b8957-62ac-403c-a400-1b3c00462448 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:10.239278272 +0000 UTC m=+251.348054165 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs") pod "network-metrics-daemon-8wnd2" (UID: "ca6b8957-62ac-403c-a400-1b3c00462448") : secret "metrics-daemon-secret" not found
Sep 17 00:12:36.194377 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:12:36.194328    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nw6jd" podUID="2dba56c7-2ca8-416c-af7c-8057b63fb437"
Sep 17 00:12:36.406592 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:12:36.406541    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8wnd2" podUID="ca6b8957-62ac-403c-a400-1b3c00462448"
Sep 17 00:12:36.957357 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:12:36.957324    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:12:41.046410 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:12:41.046372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:12:41.046859 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:12:41.046516    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 17 00:12:41.046859 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:12:41.046571    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls podName:2dba56c7-2ca8-416c-af7c-8057b63fb437 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:43.046556603 +0000 UTC m=+284.155332500 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls") pod "dns-default-nw6jd" (UID: "2dba56c7-2ca8-416c-af7c-8057b63fb437") : secret "dns-default-metrics-tls" not found
Sep 17 00:12:47.383255 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:12:47.383219    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:13:51.999341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:51.999309    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z"]
Sep 17 00:13:52.001240 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.001218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z"
Sep 17 00:13:52.004085 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.003436    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq"]
Sep 17 00:13:52.005761 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.004768    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-prndp\""
Sep 17 00:13:52.007987 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.007968    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq"
Sep 17 00:13:52.010496 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.010476    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 17 00:13:52.010592 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.010476    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:13:52.010656 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.010607    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-x54w8\""
Sep 17 00:13:52.015140 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.015120    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z"]
Sep 17 00:13:52.016037 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.016006    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq"]
Sep 17 00:13:52.097910 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.097848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qd8j\" (UniqueName: \"kubernetes.io/projected/3537920a-d5bb-4a0e-bab7-bac7b4b818c9-kube-api-access-6qd8j\") pod \"volume-data-source-validator-86695b7cc7-55kcq\" (UID: \"3537920a-d5bb-4a0e-bab7-bac7b4b818c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq"
Sep 17 00:13:52.098039 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.097973    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xndpm\" (UniqueName: \"kubernetes.io/projected/e321ee29-1169-459d-bfa7-0b402bef5776-kube-api-access-xndpm\") pod \"network-check-source-6f8b768455-b6g2z\" (UID: \"e321ee29-1169-459d-bfa7-0b402bef5776\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z"
Sep 17 00:13:52.098317 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.098301    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"]
Sep 17 00:13:52.099944 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.099930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.102106 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.102082    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"]
Sep 17 00:13:52.102996 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.102972    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 17 00:13:52.103140 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.103116    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 17 00:13:52.104153 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.104133    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 17 00:13:52.104262 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.104160    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 17 00:13:52.104262 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.104194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4d5t6\""
Sep 17 00:13:52.104763 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.104746    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-6zdqm"]
Sep 17 00:13:52.104874 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.104855    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:52.106249 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.106232    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5545b8dc84-zb7vb"]
Sep 17 00:13:52.106407 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.106394    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.107698 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.107666    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q6fjt\""
Sep 17 00:13:52.107771 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.107696    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:13:52.107771 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.107741    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 17 00:13:52.108345 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.108327    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 17 00:13:52.108649 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.108632    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-vpr92\""
Sep 17 00:13:52.108837 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.108820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.108954 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.108938    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 17 00:13:52.109264 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.109249    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 17 00:13:52.109341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.109265    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 17 00:13:52.109480 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.109465    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 17 00:13:52.111785 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.111770    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 17 00:13:52.111923 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.111891    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 17 00:13:52.111970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.111942    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 17 00:13:52.113579 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.113423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j25ch\""
Sep 17 00:13:52.114133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.114115    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"]
Sep 17 00:13:52.118480 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.118456    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 17 00:13:52.119941 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.119917    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 17 00:13:52.120040 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.119940    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-6zdqm"]
Sep 17 00:13:52.120854 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.120833    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"]
Sep 17 00:13:52.122147 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.122091    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5545b8dc84-zb7vb"]
Sep 17 00:13:52.198793 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.198761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-image-registry-private-configuration\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.198793 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.198795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.199013 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.198820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qd8j\" (UniqueName: \"kubernetes.io/projected/3537920a-d5bb-4a0e-bab7-bac7b4b818c9-kube-api-access-6qd8j\") pod \"volume-data-source-validator-86695b7cc7-55kcq\" (UID: \"3537920a-d5bb-4a0e-bab7-bac7b4b818c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq"
Sep 17 00:13:52.199013 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.198974    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26347aba-c871-478d-af3d-bb09d4eb9260-serving-cert\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.199132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199018    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xckfm\" (UniqueName: \"kubernetes.io/projected/e18b5f5a-0364-42bd-97be-a83fae10ac10-kube-api-access-xckfm\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.199132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199055    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-bound-sa-token\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.199132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199079    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qfdh\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-kube-api-access-9qfdh\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.199132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199123    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/26347aba-c871-478d-af3d-bb09d4eb9260-snapshots\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.199290 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.199290 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199205    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-installation-pull-secrets\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.199290 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199237    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crtk9\" (UniqueName: \"kubernetes.io/projected/a2724e26-d562-4bc3-a2ce-1a60e0a92417-kube-api-access-crtk9\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:52.199290 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26347aba-c871-478d-af3d-bb09d4eb9260-service-ca-bundle\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.199484 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-trusted-ca\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.199484 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c7kt\" (UniqueName: \"kubernetes.io/projected/26347aba-c871-478d-af3d-bb09d4eb9260-kube-api-access-7c7kt\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.199484 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26347aba-c871-478d-af3d-bb09d4eb9260-tmp\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.199484 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:52.199484 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e18b5f5a-0364-42bd-97be-a83fae10ac10-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.199484 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-ca-trust-extracted\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.199747 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xndpm\" (UniqueName: \"kubernetes.io/projected/e321ee29-1169-459d-bfa7-0b402bef5776-kube-api-access-xndpm\") pod \"network-check-source-6f8b768455-b6g2z\" (UID: \"e321ee29-1169-459d-bfa7-0b402bef5776\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z"
Sep 17 00:13:52.199747 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199538    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26347aba-c871-478d-af3d-bb09d4eb9260-trusted-ca-bundle\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.199747 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.199571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-certificates\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.207149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.207124    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xndpm\" (UniqueName: \"kubernetes.io/projected/e321ee29-1169-459d-bfa7-0b402bef5776-kube-api-access-xndpm\") pod \"network-check-source-6f8b768455-b6g2z\" (UID: \"e321ee29-1169-459d-bfa7-0b402bef5776\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z"
Sep 17 00:13:52.207332 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.207311    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qd8j\" (UniqueName: \"kubernetes.io/projected/3537920a-d5bb-4a0e-bab7-bac7b4b818c9-kube-api-access-6qd8j\") pod \"volume-data-source-validator-86695b7cc7-55kcq\" (UID: \"3537920a-d5bb-4a0e-bab7-bac7b4b818c9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq"
Sep 17 00:13:52.300495 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-ca-trust-extracted\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.300495 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26347aba-c871-478d-af3d-bb09d4eb9260-trusted-ca-bundle\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.300495 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-certificates\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.300743 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-image-registry-private-configuration\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.300743 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.300850 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26347aba-c871-478d-af3d-bb09d4eb9260-serving-cert\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.300850 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300801    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xckfm\" (UniqueName: \"kubernetes.io/projected/e18b5f5a-0364-42bd-97be-a83fae10ac10-kube-api-access-xckfm\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.300850 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-bound-sa-token\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.300850 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300838    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-ca-trust-extracted\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.301085 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.300851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qfdh\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-kube-api-access-9qfdh\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.301085 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.300855    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:52.301085 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.300964    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls podName:e18b5f5a-0364-42bd-97be-a83fae10ac10 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:52.800942828 +0000 UTC m=+233.909718727 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rhfdq" (UID: "e18b5f5a-0364-42bd-97be-a83fae10ac10") : secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:52.301085 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/26347aba-c871-478d-af3d-bb09d4eb9260-snapshots\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.301285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301088    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.301285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-installation-pull-secrets\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.301285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301142    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-certificates\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.301285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crtk9\" (UniqueName: \"kubernetes.io/projected/a2724e26-d562-4bc3-a2ce-1a60e0a92417-kube-api-access-crtk9\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:52.301285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26347aba-c871-478d-af3d-bb09d4eb9260-service-ca-bundle\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.301285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-trusted-ca\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.301285 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.301244    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 00:13:52.301285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c7kt\" (UniqueName: \"kubernetes.io/projected/26347aba-c871-478d-af3d-bb09d4eb9260-kube-api-access-7c7kt\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.301285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26347aba-c871-478d-af3d-bb09d4eb9260-tmp\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.301705 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301306    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:52.301705 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e18b5f5a-0364-42bd-97be-a83fae10ac10-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.301705 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26347aba-c871-478d-af3d-bb09d4eb9260-trusted-ca-bundle\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.301869 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.301749    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/26347aba-c871-478d-af3d-bb09d4eb9260-snapshots\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.301939 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.301257    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5545b8dc84-zb7vb: secret "image-registry-tls" not found
Sep 17 00:13:52.302015 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.302000    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls podName:ae4f647a-8ac5-4d8e-a061-ed7ad945b382 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:52.801979475 +0000 UTC m=+233.910755381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls") pod "image-registry-5545b8dc84-zb7vb" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382") : secret "image-registry-tls" not found
Sep 17 00:13:52.302079 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.301918    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 00:13:52.302079 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.302057    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls podName:a2724e26-d562-4bc3-a2ce-1a60e0a92417 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:52.802044865 +0000 UTC m=+233.910820771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4spqh" (UID: "a2724e26-d562-4bc3-a2ce-1a60e0a92417") : secret "samples-operator-tls" not found
Sep 17 00:13:52.302188 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.302127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/26347aba-c871-478d-af3d-bb09d4eb9260-service-ca-bundle\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.302242 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.302218    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e18b5f5a-0364-42bd-97be-a83fae10ac10-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.302358 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.302335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26347aba-c871-478d-af3d-bb09d4eb9260-tmp\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.302443 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.302424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-trusted-ca\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.303237 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.303220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/26347aba-c871-478d-af3d-bb09d4eb9260-serving-cert\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.303336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.303314    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-image-registry-private-configuration\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.303561 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.303538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-installation-pull-secrets\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.309575 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.309554    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xckfm\" (UniqueName: \"kubernetes.io/projected/e18b5f5a-0364-42bd-97be-a83fae10ac10-kube-api-access-xckfm\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.309848 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.309824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c7kt\" (UniqueName: \"kubernetes.io/projected/26347aba-c871-478d-af3d-bb09d4eb9260-kube-api-access-7c7kt\") pod \"insights-operator-5844b856db-6zdqm\" (UID: \"26347aba-c871-478d-af3d-bb09d4eb9260\") " pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.309984 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.309836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qfdh\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-kube-api-access-9qfdh\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.310023 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.310003    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crtk9\" (UniqueName: \"kubernetes.io/projected/a2724e26-d562-4bc3-a2ce-1a60e0a92417-kube-api-access-crtk9\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:52.310686 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.310669    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-bound-sa-token\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.311535 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.311519    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z"
Sep 17 00:13:52.318383 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.318365    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq"
Sep 17 00:13:52.426783 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.426758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-6zdqm"
Sep 17 00:13:52.577930 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.577875    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z"]
Sep 17 00:13:52.579958 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:13:52.579932    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode321ee29_1169_459d_bfa7_0b402bef5776.slice/crio-e8b1f0f535f83e77a820e0937b63cd77c1d189df03eac83498ced9eff8267552 WatchSource:0}: Error finding container e8b1f0f535f83e77a820e0937b63cd77c1d189df03eac83498ced9eff8267552: Status 404 returned error can't find the container with id e8b1f0f535f83e77a820e0937b63cd77c1d189df03eac83498ced9eff8267552
Sep 17 00:13:52.583676 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.583558    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq"]
Sep 17 00:13:52.586124 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:13:52.586106    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3537920a_d5bb_4a0e_bab7_bac7b4b818c9.slice/crio-4caa3fd8053807bc2c2b1d83d93c0689ef3688fc79e87cbf1e2fed3abce85a33 WatchSource:0}: Error finding container 4caa3fd8053807bc2c2b1d83d93c0689ef3688fc79e87cbf1e2fed3abce85a33: Status 404 returned error can't find the container with id 4caa3fd8053807bc2c2b1d83d93c0689ef3688fc79e87cbf1e2fed3abce85a33
Sep 17 00:13:52.690256 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.690104    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-6zdqm"]
Sep 17 00:13:52.692266 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:13:52.692241    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26347aba_c871_478d_af3d_bb09d4eb9260.slice/crio-b75a794ce00ab825e38f40bfdc0be3d31487ef22f9d853f2dabf789cb1499425 WatchSource:0}: Error finding container b75a794ce00ab825e38f40bfdc0be3d31487ef22f9d853f2dabf789cb1499425: Status 404 returned error can't find the container with id b75a794ce00ab825e38f40bfdc0be3d31487ef22f9d853f2dabf789cb1499425
Sep 17 00:13:52.805735 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.805694    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:52.805871 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.805778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:52.805871 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:52.805819    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:52.805871 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.805837    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:52.806104 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.805913    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls podName:e18b5f5a-0364-42bd-97be-a83fae10ac10 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:53.805878071 +0000 UTC m=+234.914653964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rhfdq" (UID: "e18b5f5a-0364-42bd-97be-a83fae10ac10") : secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:52.806104 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.805950    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 00:13:52.806104 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.805974    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5545b8dc84-zb7vb: secret "image-registry-tls" not found
Sep 17 00:13:52.806104 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.806025    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls podName:ae4f647a-8ac5-4d8e-a061-ed7ad945b382 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:53.806009745 +0000 UTC m=+234.914785643 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls") pod "image-registry-5545b8dc84-zb7vb" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382") : secret "image-registry-tls" not found
Sep 17 00:13:52.806104 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.805951    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 00:13:52.806104 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:52.806072    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls podName:a2724e26-d562-4bc3-a2ce-1a60e0a92417 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:53.806062512 +0000 UTC m=+234.914838406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4spqh" (UID: "a2724e26-d562-4bc3-a2ce-1a60e0a92417") : secret "samples-operator-tls" not found
Sep 17 00:13:53.136301 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:53.136264    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6zdqm" event={"ID":"26347aba-c871-478d-af3d-bb09d4eb9260","Type":"ContainerStarted","Data":"b75a794ce00ab825e38f40bfdc0be3d31487ef22f9d853f2dabf789cb1499425"}
Sep 17 00:13:53.137487 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:53.137464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq" event={"ID":"3537920a-d5bb-4a0e-bab7-bac7b4b818c9","Type":"ContainerStarted","Data":"4caa3fd8053807bc2c2b1d83d93c0689ef3688fc79e87cbf1e2fed3abce85a33"}
Sep 17 00:13:53.138882 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:53.138861    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z" event={"ID":"e321ee29-1169-459d-bfa7-0b402bef5776","Type":"ContainerStarted","Data":"00b716ac9cad66066712a83f8b17d4aa7d70b3db0052c99b149e1725db6623fb"}
Sep 17 00:13:53.138980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:53.138912    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z" event={"ID":"e321ee29-1169-459d-bfa7-0b402bef5776","Type":"ContainerStarted","Data":"e8b1f0f535f83e77a820e0937b63cd77c1d189df03eac83498ced9eff8267552"}
Sep 17 00:13:53.155617 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:53.155569    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-b6g2z" podStartSLOduration=2.155545224 podStartE2EDuration="2.155545224s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:13:53.154482291 +0000 UTC m=+234.263258207" watchObservedRunningTime="2026-09-17 00:13:53.155545224 +0000 UTC m=+234.264321140"
Sep 17 00:13:53.812684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:53.812645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:53.812866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:53.812808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:53.812866 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:53.812819    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:53.812866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:53.812854    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:53.813061 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:53.812913    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls podName:e18b5f5a-0364-42bd-97be-a83fae10ac10 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:55.812876729 +0000 UTC m=+236.921652626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rhfdq" (UID: "e18b5f5a-0364-42bd-97be-a83fae10ac10") : secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:53.813061 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:53.812965    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 00:13:53.813061 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:53.812975    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 00:13:53.813061 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:53.812997    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5545b8dc84-zb7vb: secret "image-registry-tls" not found
Sep 17 00:13:53.813061 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:53.813010    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls podName:a2724e26-d562-4bc3-a2ce-1a60e0a92417 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:55.81299449 +0000 UTC m=+236.921770383 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4spqh" (UID: "a2724e26-d562-4bc3-a2ce-1a60e0a92417") : secret "samples-operator-tls" not found
Sep 17 00:13:53.813061 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:53.813046    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls podName:ae4f647a-8ac5-4d8e-a061-ed7ad945b382 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:55.813029066 +0000 UTC m=+236.921804980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls") pod "image-registry-5545b8dc84-zb7vb" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382") : secret "image-registry-tls" not found
Sep 17 00:13:55.147182 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:55.147147    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6zdqm" event={"ID":"26347aba-c871-478d-af3d-bb09d4eb9260","Type":"ContainerStarted","Data":"05f919a326b719716db53246476a06056631656e2d6f4b0a4f646734462762f1"}
Sep 17 00:13:55.148720 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:55.148696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq" event={"ID":"3537920a-d5bb-4a0e-bab7-bac7b4b818c9","Type":"ContainerStarted","Data":"35aeb0ff2cd43d38c003b5a297c23af656a8075e53cc2d120f14bf5cd50d1a27"}
Sep 17 00:13:55.167179 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:55.164866    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-6zdqm" podStartSLOduration=1.090301251 podStartE2EDuration="3.164847613s" totalImagesPullingTime="2.074546362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:13:55.162963432 +0000 UTC m=+236.271739350" watchObservedRunningTime="2026-09-17 00:13:55.164847613 +0000 UTC m=+236.273623529"
Sep 17 00:13:55.180673 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:55.180633    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-55kcq" podStartSLOduration=2.002449945 podStartE2EDuration="4.180621846s" totalImagesPullingTime="2.178171901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:13:55.179624641 +0000 UTC m=+236.288400555" watchObservedRunningTime="2026-09-17 00:13:55.180621846 +0000 UTC m=+236.289397760"
Sep 17 00:13:55.829721 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:55.829678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:55.829958 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:55.829742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:55.829958 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:55.829770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:55.829958 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:55.829826    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:55.829958 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:55.829851    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 00:13:55.829958 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:55.829925    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls podName:a2724e26-d562-4bc3-a2ce-1a60e0a92417 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:59.829882537 +0000 UTC m=+240.938658444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4spqh" (UID: "a2724e26-d562-4bc3-a2ce-1a60e0a92417") : secret "samples-operator-tls" not found
Sep 17 00:13:55.829958 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:55.829923    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 00:13:55.829958 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:55.829942    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls podName:e18b5f5a-0364-42bd-97be-a83fae10ac10 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:59.829934262 +0000 UTC m=+240.938710155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rhfdq" (UID: "e18b5f5a-0364-42bd-97be-a83fae10ac10") : secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:55.829958 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:55.829947    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5545b8dc84-zb7vb: secret "image-registry-tls" not found
Sep 17 00:13:55.830266 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:55.830009    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls podName:ae4f647a-8ac5-4d8e-a061-ed7ad945b382 nodeName:}" failed. No retries permitted until 2026-09-17 00:13:59.829990931 +0000 UTC m=+240.938766827 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls") pod "image-registry-5545b8dc84-zb7vb" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382") : secret "image-registry-tls" not found
Sep 17 00:13:56.110002 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.109931    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2dzbh"]
Sep 17 00:13:56.112207 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.112177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.114762 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.114744    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2jxk2\""
Sep 17 00:13:56.115045 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.115031    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 17 00:13:56.115856 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.115833    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 17 00:13:56.120999 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.120974    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2dzbh"]
Sep 17 00:13:56.233040 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.233013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7965b738-5588-4303-bf99-ac22c00d17ab-data-volume\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.233480 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.233113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.233480 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.233141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwwgc\" (UniqueName: \"kubernetes.io/projected/7965b738-5588-4303-bf99-ac22c00d17ab-kube-api-access-fwwgc\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.233480 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.233175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7965b738-5588-4303-bf99-ac22c00d17ab-crio-socket\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.233480 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.233306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.334465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.334430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.334605 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.334504    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7965b738-5588-4303-bf99-ac22c00d17ab-data-volume\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.334605 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.334546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.334605 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:56.334551    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:13:56.334605 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.334576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwwgc\" (UniqueName: \"kubernetes.io/projected/7965b738-5588-4303-bf99-ac22c00d17ab-kube-api-access-fwwgc\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.334605 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.334604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7965b738-5588-4303-bf99-ac22c00d17ab-crio-socket\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.334785 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:56.334622    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm podName:7965b738-5588-4303-bf99-ac22c00d17ab nodeName:}" failed. No retries permitted until 2026-09-17 00:13:56.834604123 +0000 UTC m=+237.943380041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2dzbh" (UID: "7965b738-5588-4303-bf99-ac22c00d17ab") : configmap "kube-rbac-proxy" not found
Sep 17 00:13:56.334785 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.334666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7965b738-5588-4303-bf99-ac22c00d17ab-crio-socket\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.334785 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:56.334680    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:56.334785 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:56.334754    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls podName:7965b738-5588-4303-bf99-ac22c00d17ab nodeName:}" failed. No retries permitted until 2026-09-17 00:13:56.834735847 +0000 UTC m=+237.943511755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dzbh" (UID: "7965b738-5588-4303-bf99-ac22c00d17ab") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:56.335002 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.334855    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7965b738-5588-4303-bf99-ac22c00d17ab-data-volume\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.342480 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.342462    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwwgc\" (UniqueName: \"kubernetes.io/projected/7965b738-5588-4303-bf99-ac22c00d17ab-kube-api-access-fwwgc\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.838423 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.838387    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.838583 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:56.838458    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:56.838583 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:56.838500    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:13:56.838583 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:56.838554    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:56.838583 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:56.838566    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm podName:7965b738-5588-4303-bf99-ac22c00d17ab nodeName:}" failed. No retries permitted until 2026-09-17 00:13:57.838551352 +0000 UTC m=+238.947327245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2dzbh" (UID: "7965b738-5588-4303-bf99-ac22c00d17ab") : configmap "kube-rbac-proxy" not found
Sep 17 00:13:56.838720 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:56.838604    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls podName:7965b738-5588-4303-bf99-ac22c00d17ab nodeName:}" failed. No retries permitted until 2026-09-17 00:13:57.838593287 +0000 UTC m=+238.947369180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dzbh" (UID: "7965b738-5588-4303-bf99-ac22c00d17ab") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:57.158807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.158726    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs"]
Sep 17 00:13:57.160675 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.160660    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs"
Sep 17 00:13:57.163305 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.163285    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 17 00:13:57.163397 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.163354    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-n2tsq\""
Sep 17 00:13:57.164713 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.164697    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 17 00:13:57.170750 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.170729    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs"]
Sep 17 00:13:57.241827 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.241802    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4z2p\" (UniqueName: \"kubernetes.io/projected/ce1083b8-813d-4fc8-b5c4-25a48b661174-kube-api-access-p4z2p\") pod \"migrator-8b4d697c5-hvccs\" (UID: \"ce1083b8-813d-4fc8-b5c4-25a48b661174\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs"
Sep 17 00:13:57.343046 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.343020    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4z2p\" (UniqueName: \"kubernetes.io/projected/ce1083b8-813d-4fc8-b5c4-25a48b661174-kube-api-access-p4z2p\") pod \"migrator-8b4d697c5-hvccs\" (UID: \"ce1083b8-813d-4fc8-b5c4-25a48b661174\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs"
Sep 17 00:13:57.350830 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.350808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4z2p\" (UniqueName: \"kubernetes.io/projected/ce1083b8-813d-4fc8-b5c4-25a48b661174-kube-api-access-p4z2p\") pod \"migrator-8b4d697c5-hvccs\" (UID: \"ce1083b8-813d-4fc8-b5c4-25a48b661174\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs"
Sep 17 00:13:57.469398 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.469339    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs"
Sep 17 00:13:57.732762 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.732734    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs"]
Sep 17 00:13:57.734859 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:13:57.734836    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1083b8_813d_4fc8_b5c4_25a48b661174.slice/crio-65dc29afd4fed6cbf6300bf5b2b7ee88a958d7fc173021e5bfed53f276b40886 WatchSource:0}: Error finding container 65dc29afd4fed6cbf6300bf5b2b7ee88a958d7fc173021e5bfed53f276b40886: Status 404 returned error can't find the container with id 65dc29afd4fed6cbf6300bf5b2b7ee88a958d7fc173021e5bfed53f276b40886
Sep 17 00:13:57.847560 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.847529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:57.847667 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.847626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:57.847667 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:57.847647    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 17 00:13:57.847737 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:57.847707    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm podName:7965b738-5588-4303-bf99-ac22c00d17ab nodeName:}" failed. No retries permitted until 2026-09-17 00:13:59.847690998 +0000 UTC m=+240.956466892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2dzbh" (UID: "7965b738-5588-4303-bf99-ac22c00d17ab") : configmap "kube-rbac-proxy" not found
Sep 17 00:13:57.847790 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:57.847771    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:57.847842 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:57.847833    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls podName:7965b738-5588-4303-bf99-ac22c00d17ab nodeName:}" failed. No retries permitted until 2026-09-17 00:13:59.847813529 +0000 UTC m=+240.956589427 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dzbh" (UID: "7965b738-5588-4303-bf99-ac22c00d17ab") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:57.883237 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:57.883217    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6kvtx_05a14f42-47c1-4c0e-b6a9-82a6ee4eb899/dns-node-resolver/0.log"
Sep 17 00:13:58.162734 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:58.162699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs" event={"ID":"ce1083b8-813d-4fc8-b5c4-25a48b661174","Type":"ContainerStarted","Data":"65dc29afd4fed6cbf6300bf5b2b7ee88a958d7fc173021e5bfed53f276b40886"}
Sep 17 00:13:58.883481 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:58.883450    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lpbnb_f1e60d13-d6b3-43f8-af0e-2865438288f9/node-ca/0.log"
Sep 17 00:13:59.167162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:59.167136    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs" event={"ID":"ce1083b8-813d-4fc8-b5c4-25a48b661174","Type":"ContainerStarted","Data":"e03fe7ff813775103e6e1462eb99f388e9c081c273ff729524b6a019b6176651"}
Sep 17 00:13:59.686112 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:59.686087    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qb7zm_497786de-13ef-4479-b0bf-7a6fcf911f8c/serve-healthcheck-canary/0.log"
Sep 17 00:13:59.862308 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:59.862268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:59.862477 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:59.862323    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:13:59.862477 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:59.862373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:13:59.862477 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:59.862398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:13:59.862477 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:59.862410    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:59.862477 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:59.862447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:13:59.862477 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:59.862472    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls podName:7965b738-5588-4303-bf99-ac22c00d17ab nodeName:}" failed. No retries permitted until 2026-09-17 00:14:03.862459019 +0000 UTC m=+244.971234912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dzbh" (UID: "7965b738-5588-4303-bf99-ac22c00d17ab") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:13:59.862721 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:59.862488    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 17 00:13:59.862721 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:59.862505    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:59.862721 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:59.862536    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls podName:a2724e26-d562-4bc3-a2ce-1a60e0a92417 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:07.862521213 +0000 UTC m=+248.971297110 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-4spqh" (UID: "a2724e26-d562-4bc3-a2ce-1a60e0a92417") : secret "samples-operator-tls" not found
Sep 17 00:13:59.862721 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:59.862556    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls podName:e18b5f5a-0364-42bd-97be-a83fae10ac10 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:07.862544653 +0000 UTC m=+248.971320546 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rhfdq" (UID: "e18b5f5a-0364-42bd-97be-a83fae10ac10") : secret "cluster-monitoring-operator-tls" not found
Sep 17 00:13:59.862721 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:59.862563    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 17 00:13:59.862721 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:59.862577    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5545b8dc84-zb7vb: secret "image-registry-tls" not found
Sep 17 00:13:59.862721 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:13:59.862627    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls podName:ae4f647a-8ac5-4d8e-a061-ed7ad945b382 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:07.862613578 +0000 UTC m=+248.971389481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls") pod "image-registry-5545b8dc84-zb7vb" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382") : secret "image-registry-tls" not found
Sep 17 00:13:59.862960 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:13:59.862884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7965b738-5588-4303-bf99-ac22c00d17ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:14:00.172536 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:00.172503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs" event={"ID":"ce1083b8-813d-4fc8-b5c4-25a48b661174","Type":"ContainerStarted","Data":"0d42e0859378c7efccba932e9e4c620e69b71b1842456c71176c3e0331805114"}
Sep 17 00:14:00.189059 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:00.189022    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-hvccs" podStartSLOduration=1.843811614 podStartE2EDuration="3.189009948s" totalImagesPullingTime="1.345198334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:00.187660278 +0000 UTC m=+241.296436193" watchObservedRunningTime="2026-09-17 00:14:00.189009948 +0000 UTC m=+241.297785862"
Sep 17 00:14:03.896249 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:03.896212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:14:03.896618 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:03.896321    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 17 00:14:03.896618 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:03.896372    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls podName:7965b738-5588-4303-bf99-ac22c00d17ab nodeName:}" failed. No retries permitted until 2026-09-17 00:14:11.896359513 +0000 UTC m=+253.005135405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2dzbh" (UID: "7965b738-5588-4303-bf99-ac22c00d17ab") : secret "insights-runtime-extractor-tls" not found
Sep 17 00:14:07.927739 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:07.927705    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:14:07.928100 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:07.927758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:14:07.928100 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:07.927778    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:14:07.928100 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:07.927909    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 17 00:14:07.928100 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:07.927980    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls podName:e18b5f5a-0364-42bd-97be-a83fae10ac10 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:23.927963805 +0000 UTC m=+265.036739698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-rhfdq" (UID: "e18b5f5a-0364-42bd-97be-a83fae10ac10") : secret "cluster-monitoring-operator-tls" not found
Sep 17 00:14:07.930034 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:07.930013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") pod \"image-registry-5545b8dc84-zb7vb\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") " pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:14:07.930138 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:07.930034    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2724e26-d562-4bc3-a2ce-1a60e0a92417-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-4spqh\" (UID: \"a2724e26-d562-4bc3-a2ce-1a60e0a92417\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:14:08.022083 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:08.022056    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q6fjt\""
Sep 17 00:14:08.030145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:08.030125    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"
Sep 17 00:14:08.034147 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:08.034125    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-j25ch\""
Sep 17 00:14:08.043163 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:08.043139    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:14:08.295651 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:08.295572    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh"]
Sep 17 00:14:08.319051 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:08.319021    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5545b8dc84-zb7vb"]
Sep 17 00:14:08.321177 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:08.321147    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4f647a_8ac5_4d8e_a061_ed7ad945b382.slice/crio-b03c67bc76b84ca72e99ba2905b0125a224e2bd8c5323c200e1122683330343b WatchSource:0}: Error finding container b03c67bc76b84ca72e99ba2905b0125a224e2bd8c5323c200e1122683330343b: Status 404 returned error can't find the container with id b03c67bc76b84ca72e99ba2905b0125a224e2bd8c5323c200e1122683330343b
Sep 17 00:14:09.200124 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:09.200083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh" event={"ID":"a2724e26-d562-4bc3-a2ce-1a60e0a92417","Type":"ContainerStarted","Data":"e3ff6a6ec1bee725331b387560ac640bff593555bd567b7b10ffca4cbc37abf2"}
Sep 17 00:14:09.201745 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:09.201720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb" event={"ID":"ae4f647a-8ac5-4d8e-a061-ed7ad945b382","Type":"ContainerStarted","Data":"29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9"}
Sep 17 00:14:09.201877 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:09.201762    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb" event={"ID":"ae4f647a-8ac5-4d8e-a061-ed7ad945b382","Type":"ContainerStarted","Data":"b03c67bc76b84ca72e99ba2905b0125a224e2bd8c5323c200e1122683330343b"}
Sep 17 00:14:09.201944 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:09.201917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:14:09.221473 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:09.221433    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb" podStartSLOduration=17.221419052 podStartE2EDuration="17.221419052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:09.220326365 +0000 UTC m=+250.329102280" watchObservedRunningTime="2026-09-17 00:14:09.221419052 +0000 UTC m=+250.330194967"
Sep 17 00:14:10.244814 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:10.244776    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:14:10.247570 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:10.247548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ca6b8957-62ac-403c-a400-1b3c00462448-metrics-certs\") pod \"network-metrics-daemon-8wnd2\" (UID: \"ca6b8957-62ac-403c-a400-1b3c00462448\") " pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:14:10.486727 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:10.486698    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zxlvp\""
Sep 17 00:14:10.494743 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:10.494725    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wnd2"
Sep 17 00:14:10.775253 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:10.775174    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8wnd2"]
Sep 17 00:14:10.778165 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:10.778132    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca6b8957_62ac_403c_a400_1b3c00462448.slice/crio-412d3f21730a1018c65046466444e08bf6e56236605b8a91c62d6a02560c5897 WatchSource:0}: Error finding container 412d3f21730a1018c65046466444e08bf6e56236605b8a91c62d6a02560c5897: Status 404 returned error can't find the container with id 412d3f21730a1018c65046466444e08bf6e56236605b8a91c62d6a02560c5897
Sep 17 00:14:11.209890 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:11.209853    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wnd2" event={"ID":"ca6b8957-62ac-403c-a400-1b3c00462448","Type":"ContainerStarted","Data":"412d3f21730a1018c65046466444e08bf6e56236605b8a91c62d6a02560c5897"}
Sep 17 00:14:11.211525 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:11.211503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh" event={"ID":"a2724e26-d562-4bc3-a2ce-1a60e0a92417","Type":"ContainerStarted","Data":"1ea9e7b6eeb1bf5b906fc52f774cba6b253c5f6fe0c73554d573d78aef729bdb"}
Sep 17 00:14:11.211648 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:11.211541    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh" event={"ID":"a2724e26-d562-4bc3-a2ce-1a60e0a92417","Type":"ContainerStarted","Data":"0b89249310d9a3491ededdeef78108cf24ba5445f8ad5925bf536c671983939f"}
Sep 17 00:14:11.228616 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:11.228578    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-4spqh" podStartSLOduration=17.281742556 podStartE2EDuration="19.228564235s" totalImagesPullingTime="1.946821679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:11.227990188 +0000 UTC m=+252.336766102" watchObservedRunningTime="2026-09-17 00:14:11.228564235 +0000 UTC m=+252.337340205"
Sep 17 00:14:11.957259 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:11.957234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:14:11.959449 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:11.959413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7965b738-5588-4303-bf99-ac22c00d17ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2dzbh\" (UID: \"7965b738-5588-4303-bf99-ac22c00d17ab\") " pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:14:12.026522 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:12.026493    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2jxk2\""
Sep 17 00:14:12.033654 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:12.033635    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2dzbh"
Sep 17 00:14:12.216731 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:12.216693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wnd2" event={"ID":"ca6b8957-62ac-403c-a400-1b3c00462448","Type":"ContainerStarted","Data":"3436e101ef06db72ace254b379fd9d0912ba88317b812ef1535e7d99058e7c50"}
Sep 17 00:14:12.216879 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:12.216760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wnd2" event={"ID":"ca6b8957-62ac-403c-a400-1b3c00462448","Type":"ContainerStarted","Data":"88f83f1d50edcf21ffa6953260ad1a74d2f4dfce8a8a084b2d6af3b388bf345c"}
Sep 17 00:14:12.231655 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:12.231605    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8wnd2" podStartSLOduration=252.220238436 podStartE2EDuration="4m13.231570316s" totalImagesPullingTime="1.01133188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:09:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:12.231000046 +0000 UTC m=+253.339775961" watchObservedRunningTime="2026-09-17 00:14:12.231570316 +0000 UTC m=+253.340346232"
Sep 17 00:14:12.300485 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:12.300402    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2dzbh"]
Sep 17 00:14:12.303094 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:12.303066    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7965b738_5588_4303_bf99_ac22c00d17ab.slice/crio-73717ab56f0586cc839658dacb843f6260ba0bac46a75024decd78ab1177a447 WatchSource:0}: Error finding container 73717ab56f0586cc839658dacb843f6260ba0bac46a75024decd78ab1177a447: Status 404 returned error can't find the container with id 73717ab56f0586cc839658dacb843f6260ba0bac46a75024decd78ab1177a447
Sep 17 00:14:13.221915 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:13.221872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dzbh" event={"ID":"7965b738-5588-4303-bf99-ac22c00d17ab","Type":"ContainerStarted","Data":"b655c19540f963aa234c43c4e88cce61d62458b85f95696143e6a5f5f54df7f7"}
Sep 17 00:14:13.222209 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:13.221935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dzbh" event={"ID":"7965b738-5588-4303-bf99-ac22c00d17ab","Type":"ContainerStarted","Data":"a33fe45a3da4cbdb09bbfdd619008a81235aea3d6b2d033e60494241c2c12722"}
Sep 17 00:14:13.222209 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:13.221955    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dzbh" event={"ID":"7965b738-5588-4303-bf99-ac22c00d17ab","Type":"ContainerStarted","Data":"73717ab56f0586cc839658dacb843f6260ba0bac46a75024decd78ab1177a447"}
Sep 17 00:14:15.230363 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:15.230327    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2dzbh" event={"ID":"7965b738-5588-4303-bf99-ac22c00d17ab","Type":"ContainerStarted","Data":"857639d0751ff287b1677882066725d1673033bd3078be2081a61f6ac134e217"}
Sep 17 00:14:15.250096 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:15.250052    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2dzbh" podStartSLOduration=17.018507418 podStartE2EDuration="19.250038248s" totalImagesPullingTime="2.23153083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:13:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:15.248703368 +0000 UTC m=+256.357479283" watchObservedRunningTime="2026-09-17 00:14:15.250038248 +0000 UTC m=+256.358814163"
Sep 17 00:14:18.981110 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:18.981081    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5545b8dc84-zb7vb"]
Sep 17 00:14:23.938620 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:23.938529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:14:23.940909 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:23.940882    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e18b5f5a-0364-42bd-97be-a83fae10ac10-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-rhfdq\" (UID: \"e18b5f5a-0364-42bd-97be-a83fae10ac10\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:14:24.213463 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:24.213390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4d5t6\""
Sep 17 00:14:24.221393 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:24.221376    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"
Sep 17 00:14:24.485798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:24.485775    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq"]
Sep 17 00:14:24.487952 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:24.487920    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode18b5f5a_0364_42bd_97be_a83fae10ac10.slice/crio-08e66a39d450cd13d6af51a843da1504287227515347868d757827b5cdfe04a2 WatchSource:0}: Error finding container 08e66a39d450cd13d6af51a843da1504287227515347868d757827b5cdfe04a2: Status 404 returned error can't find the container with id 08e66a39d450cd13d6af51a843da1504287227515347868d757827b5cdfe04a2
Sep 17 00:14:25.261891 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:25.261858    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq" event={"ID":"e18b5f5a-0364-42bd-97be-a83fae10ac10","Type":"ContainerStarted","Data":"08e66a39d450cd13d6af51a843da1504287227515347868d757827b5cdfe04a2"}
Sep 17 00:14:27.270598 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:27.270559    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq" event={"ID":"e18b5f5a-0364-42bd-97be-a83fae10ac10","Type":"ContainerStarted","Data":"98bdc50e7b4d80c1188066f6d7f95e8761dea701c607ff4705b1dd8e773b5311"}
Sep 17 00:14:27.287328 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:27.287266    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-rhfdq" podStartSLOduration=33.355456331 podStartE2EDuration="35.287246181s" totalImagesPullingTime="1.93178985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:27.2851047 +0000 UTC m=+268.393880615" watchObservedRunningTime="2026-09-17 00:14:27.287246181 +0000 UTC m=+268.396022097"
Sep 17 00:14:28.987266 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:28.987229    2565 patch_prober.go:28] interesting pod/image-registry-5545b8dc84-zb7vb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 00:14:28.987632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:28.987285    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb" podUID="ae4f647a-8ac5-4d8e-a061-ed7ad945b382" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:14:35.276403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.276370    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"]
Sep 17 00:14:35.279781 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.279763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.282588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.282569    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 17 00:14:35.282849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.282836    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 17 00:14:35.284145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.284123    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-d8qth\""
Sep 17 00:14:35.284193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.284131    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 17 00:14:35.287205 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.287187    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"]
Sep 17 00:14:35.290061 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.290046    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.292690 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.292664    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 17 00:14:35.292788 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.292726    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 17 00:14:35.292847 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.292819    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 17 00:14:35.293056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.293040    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ghwnq\""
Sep 17 00:14:35.294136 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.294116    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"]
Sep 17 00:14:35.300479 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.300458    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"]
Sep 17 00:14:35.303693 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.303673    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2f5rj"]
Sep 17 00:14:35.306520 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.306504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.308982 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.308965    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 17 00:14:35.309056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.308971    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 17 00:14:35.309099 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.309087    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-klwx5\""
Sep 17 00:14:35.309306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.309293    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 17 00:14:35.419836 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.419809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3870839-3f33-490e-9026-db8927474e69-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.419836 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.419838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.420056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.419857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-sys\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.420056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.419876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.420056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.419920    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-wtmp\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.420056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.419947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-accelerators-collector-config\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.420056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.419963    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-root\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.420056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.419978    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-textfile\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.420056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.419993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-tls\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.420056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-metrics-client-ca\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.420401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420089    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8kmk\" (UniqueName: \"kubernetes.io/projected/c3870839-3f33-490e-9026-db8927474e69-kube-api-access-r8kmk\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.420401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420120    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.420401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420155    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.420401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.420401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420216    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3870839-3f33-490e-9026-db8927474e69-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.420401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420254    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3870839-3f33-490e-9026-db8927474e69-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.420401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420289    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.420401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg6g9\" (UniqueName: \"kubernetes.io/projected/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-api-access-wg6g9\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.420401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.420324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbpk7\" (UniqueName: \"kubernetes.io/projected/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-kube-api-access-gbpk7\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521218 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521186    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-wtmp\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521218 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-accelerators-collector-config\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521417 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-root\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521417 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521253    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-textfile\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521417 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521332    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-root\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521417 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-wtmp\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-tls\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-metrics-client-ca\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521516    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8kmk\" (UniqueName: \"kubernetes.io/projected/c3870839-3f33-490e-9026-db8927474e69-kube-api-access-r8kmk\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.521613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521549    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.521613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521556    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-textfile\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.521613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521607    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.521981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3870839-3f33-490e-9026-db8927474e69-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.521981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3870839-3f33-490e-9026-db8927474e69-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.521981 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:35.521673    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 17 00:14:35.521981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521715    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.521981 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:35.521737    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-tls podName:245f22b3-7a1b-43e0-b6cc-23b6ff33891a nodeName:}" failed. No retries permitted until 2026-09-17 00:14:36.021716991 +0000 UTC m=+277.130492895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-tls") pod "node-exporter-2f5rj" (UID: "245f22b3-7a1b-43e0-b6cc-23b6ff33891a") : secret "node-exporter-tls" not found
Sep 17 00:14:35.521981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg6g9\" (UniqueName: \"kubernetes.io/projected/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-api-access-wg6g9\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.521981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521809    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbpk7\" (UniqueName: \"kubernetes.io/projected/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-kube-api-access-gbpk7\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521889    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-accelerators-collector-config\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.521981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3870839-3f33-490e-9026-db8927474e69-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.521991    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.522016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-sys\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.522043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.522053    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-metrics-client-ca\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:35.521913    2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:35.522163    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3870839-3f33-490e-9026-db8927474e69-openshift-state-metrics-tls podName:c3870839-3f33-490e-9026-db8927474e69 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:36.022141454 +0000 UTC m=+277.130917359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c3870839-3f33-490e-9026-db8927474e69-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-jkkzm" (UID: "c3870839-3f33-490e-9026-db8927474e69") : secret "openshift-state-metrics-tls" not found
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.522275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.522335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:35.522361    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 17 00:14:35.522419 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:35.522427    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-tls podName:82ff24d7-2518-4de6-af9c-b59e10f3fcf0 nodeName:}" failed. No retries permitted until 2026-09-17 00:14:36.02241095 +0000 UTC m=+277.131186854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-tls") pod "kube-state-metrics-59fbdd77d-95pfk" (UID: "82ff24d7-2518-4de6-af9c-b59e10f3fcf0") : secret "kube-state-metrics-tls" not found
Sep 17 00:14:35.522961 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.522465    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-sys\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.523066 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.523009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3870839-3f33-490e-9026-db8927474e69-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.523158 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.523139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.524392 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.524373    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.524507 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.524448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3870839-3f33-490e-9026-db8927474e69-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.525069 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.525042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:35.531999 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.531922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8kmk\" (UniqueName: \"kubernetes.io/projected/c3870839-3f33-490e-9026-db8927474e69-kube-api-access-r8kmk\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:35.532760 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.532741    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg6g9\" (UniqueName: \"kubernetes.io/projected/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-api-access-wg6g9\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:35.532851 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:35.532758    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbpk7\" (UniqueName: \"kubernetes.io/projected/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-kube-api-access-gbpk7\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:36.026399 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.026365    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-tls\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:36.026540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.026419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3870839-3f33-490e-9026-db8927474e69-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:36.026540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.026503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:36.028890 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.028860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c3870839-3f33-490e-9026-db8927474e69-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-jkkzm\" (UID: \"c3870839-3f33-490e-9026-db8927474e69\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:36.028890 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.028883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/245f22b3-7a1b-43e0-b6cc-23b6ff33891a-node-exporter-tls\") pod \"node-exporter-2f5rj\" (UID: \"245f22b3-7a1b-43e0-b6cc-23b6ff33891a\") " pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:36.029088 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.028959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/82ff24d7-2518-4de6-af9c-b59e10f3fcf0-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-95pfk\" (UID: \"82ff24d7-2518-4de6-af9c-b59e10f3fcf0\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:36.188490 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.188447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"
Sep 17 00:14:36.199848 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.199822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"
Sep 17 00:14:36.215196 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.215169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2f5rj"
Sep 17 00:14:36.230864 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:36.230818    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245f22b3_7a1b_43e0_b6cc_23b6ff33891a.slice/crio-ff0ef35f9ebeb36f6d041618ba43de263c34ef3142c85db23998f6c927668876 WatchSource:0}: Error finding container ff0ef35f9ebeb36f6d041618ba43de263c34ef3142c85db23998f6c927668876: Status 404 returned error can't find the container with id ff0ef35f9ebeb36f6d041618ba43de263c34ef3142c85db23998f6c927668876
Sep 17 00:14:36.301047 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.300990    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2f5rj" event={"ID":"245f22b3-7a1b-43e0-b6cc-23b6ff33891a","Type":"ContainerStarted","Data":"ff0ef35f9ebeb36f6d041618ba43de263c34ef3142c85db23998f6c927668876"}
Sep 17 00:14:36.470311 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.470283    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm"]
Sep 17 00:14:36.471880 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:36.471845    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3870839_3f33_490e_9026_db8927474e69.slice/crio-0bd5c84460f302e35ca2aec899fa9b6c1d52fd0f5e37615f259e209010610a4c WatchSource:0}: Error finding container 0bd5c84460f302e35ca2aec899fa9b6c1d52fd0f5e37615f259e209010610a4c: Status 404 returned error can't find the container with id 0bd5c84460f302e35ca2aec899fa9b6c1d52fd0f5e37615f259e209010610a4c
Sep 17 00:14:36.489241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:36.489218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk"]
Sep 17 00:14:36.492576 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:36.492554    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ff24d7_2518_4de6_af9c_b59e10f3fcf0.slice/crio-b1259b797d98f3138d4e4aea1414611a14ba781556e01a8bb9676054f5536b70 WatchSource:0}: Error finding container b1259b797d98f3138d4e4aea1414611a14ba781556e01a8bb9676054f5536b70: Status 404 returned error can't find the container with id b1259b797d98f3138d4e4aea1414611a14ba781556e01a8bb9676054f5536b70
Sep 17 00:14:37.257758 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.257731    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"]
Sep 17 00:14:37.264816 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.264792    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.267401 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.267377    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 17 00:14:37.267504 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.267465    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 17 00:14:37.267504 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.267478    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 17 00:14:37.267607 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.267528    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 17 00:14:37.267607 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.267583    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-5ntra7fit4ouj\""
Sep 17 00:14:37.267755 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.267643    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qp74m\""
Sep 17 00:14:37.267755 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.267676    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 17 00:14:37.271719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.271695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"]
Sep 17 00:14:37.307197 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.307163    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2f5rj" event={"ID":"245f22b3-7a1b-43e0-b6cc-23b6ff33891a","Type":"ContainerStarted","Data":"d6961c79dd6d422f04ccf0d9b520f38a775a58e294213d443d06e9751d705939"}
Sep 17 00:14:37.308617 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.308595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk" event={"ID":"82ff24d7-2518-4de6-af9c-b59e10f3fcf0","Type":"ContainerStarted","Data":"b1259b797d98f3138d4e4aea1414611a14ba781556e01a8bb9676054f5536b70"}
Sep 17 00:14:37.310580 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.310557    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm" event={"ID":"c3870839-3f33-490e-9026-db8927474e69","Type":"ContainerStarted","Data":"761f5002a5f09196b8295ef61236e291761baaef6224ae2af8c5685cb7f82313"}
Sep 17 00:14:37.310662 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.310606    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm" event={"ID":"c3870839-3f33-490e-9026-db8927474e69","Type":"ContainerStarted","Data":"bd25d2b310e321674a4ed16b11534475e94bab894949939a12fbbd0e2c5b3a10"}
Sep 17 00:14:37.310662 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.310633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm" event={"ID":"c3870839-3f33-490e-9026-db8927474e69","Type":"ContainerStarted","Data":"0bd5c84460f302e35ca2aec899fa9b6c1d52fd0f5e37615f259e209010610a4c"}
Sep 17 00:14:37.439271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.439231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.439450 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.439298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-tls\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.439450 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.439332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.439450 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.439380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-grpc-tls\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.439450 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.439411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.439450 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.439437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.439732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.439481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k27fl\" (UniqueName: \"kubernetes.io/projected/56da6621-b00a-4cf7-af58-6949200a0550-kube-api-access-k27fl\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.439732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.439529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56da6621-b00a-4cf7-af58-6949200a0550-metrics-client-ca\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.540746 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.540668    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-tls\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.540746 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.540719    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.540980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.540768    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-grpc-tls\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.540980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.540798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.540980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.540830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.540980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.540865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k27fl\" (UniqueName: \"kubernetes.io/projected/56da6621-b00a-4cf7-af58-6949200a0550-kube-api-access-k27fl\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.540980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.540926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56da6621-b00a-4cf7-af58-6949200a0550-metrics-client-ca\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.541239 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.541008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.541767 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.541715    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/56da6621-b00a-4cf7-af58-6949200a0550-metrics-client-ca\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.543732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.543702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.543826 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.543761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-tls\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.544006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.543982    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.544092 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.544020    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-grpc-tls\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.544092 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.544040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.544435 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.544415    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/56da6621-b00a-4cf7-af58-6949200a0550-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.549079 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.549033    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k27fl\" (UniqueName: \"kubernetes.io/projected/56da6621-b00a-4cf7-af58-6949200a0550-kube-api-access-k27fl\") pod \"thanos-querier-79b7fd8499-6b6wc\" (UID: \"56da6621-b00a-4cf7-af58-6949200a0550\") " pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.574987 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.574960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:37.852676 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:37.852648    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"]
Sep 17 00:14:37.870398 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:37.870375    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56da6621_b00a_4cf7_af58_6949200a0550.slice/crio-3b53698dc3643a0d0c7ffc639c311ae5cb1d0f55aa6fd21e9a95bc358a3fe3c6 WatchSource:0}: Error finding container 3b53698dc3643a0d0c7ffc639c311ae5cb1d0f55aa6fd21e9a95bc358a3fe3c6: Status 404 returned error can't find the container with id 3b53698dc3643a0d0c7ffc639c311ae5cb1d0f55aa6fd21e9a95bc358a3fe3c6
Sep 17 00:14:38.315363 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:38.315337    2565 generic.go:356] "Generic (PLEG): container finished" podID="245f22b3-7a1b-43e0-b6cc-23b6ff33891a" containerID="d6961c79dd6d422f04ccf0d9b520f38a775a58e294213d443d06e9751d705939" exitCode=0
Sep 17 00:14:38.315699 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:38.315422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2f5rj" event={"ID":"245f22b3-7a1b-43e0-b6cc-23b6ff33891a","Type":"ContainerDied","Data":"d6961c79dd6d422f04ccf0d9b520f38a775a58e294213d443d06e9751d705939"}
Sep 17 00:14:38.317891 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:38.317862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm" event={"ID":"c3870839-3f33-490e-9026-db8927474e69","Type":"ContainerStarted","Data":"529a9dc5d67f950bd01cbf098f98bf74e07295850e1a888405dfe9b57e4d4eed"}
Sep 17 00:14:38.319198 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:38.319117    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc" event={"ID":"56da6621-b00a-4cf7-af58-6949200a0550","Type":"ContainerStarted","Data":"3b53698dc3643a0d0c7ffc639c311ae5cb1d0f55aa6fd21e9a95bc358a3fe3c6"}
Sep 17 00:14:38.349751 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:38.349710    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-jkkzm" podStartSLOduration=2.015539881 podStartE2EDuration="3.349676284s" totalImagesPullingTime="1.334136403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:38.348056849 +0000 UTC m=+279.456832766" watchObservedRunningTime="2026-09-17 00:14:38.349676284 +0000 UTC m=+279.458452199"
Sep 17 00:14:38.987376 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:38.987334    2565 patch_prober.go:28] interesting pod/image-registry-5545b8dc84-zb7vb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 17 00:14:38.987560 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:38.987401    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb" podUID="ae4f647a-8ac5-4d8e-a061-ed7ad945b382" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:14:39.324670 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:39.324635    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2f5rj" event={"ID":"245f22b3-7a1b-43e0-b6cc-23b6ff33891a","Type":"ContainerStarted","Data":"53b2b036e40e0df44199bf2e7f3f08f6686d4b8b182bacd61e8820f62c154f04"}
Sep 17 00:14:39.325069 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:39.324701    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2f5rj" event={"ID":"245f22b3-7a1b-43e0-b6cc-23b6ff33891a","Type":"ContainerStarted","Data":"1938336dc97869e3fb98cc7ad357e42fccecca8266561b5444b393645380e690"}
Sep 17 00:14:39.326744 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:39.326721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk" event={"ID":"82ff24d7-2518-4de6-af9c-b59e10f3fcf0","Type":"ContainerStarted","Data":"1f6929a39a59370d1246f124ba380a3256cf62585f8ac3627cfef3791c79cf11"}
Sep 17 00:14:39.326862 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:39.326767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk" event={"ID":"82ff24d7-2518-4de6-af9c-b59e10f3fcf0","Type":"ContainerStarted","Data":"630d3a01eef3e8b52d8de4fd249e1cbdc5fca03463d666cf7c83add79006fe47"}
Sep 17 00:14:39.326862 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:39.326791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk" event={"ID":"82ff24d7-2518-4de6-af9c-b59e10f3fcf0","Type":"ContainerStarted","Data":"6cb366f51404dc16f6de1428c0877aacd73449b67e3fd9b9f2328047992391ea"}
Sep 17 00:14:39.343505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:39.343468    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2f5rj" podStartSLOduration=3.313710119 podStartE2EDuration="4.343456614s" totalImagesPullingTime="967.25395ms" totalInitContainerRuntime="62.492545ms" isStatefulPod=true podCreationTimestamp="2026-09-17 00:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:39.341963894 +0000 UTC m=+280.450739811" watchObservedRunningTime="2026-09-17 00:14:39.343456614 +0000 UTC m=+280.452232529"
Sep 17 00:14:39.361426 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:39.359520    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-95pfk" podStartSLOduration=2.541224589 podStartE2EDuration="4.359502773s" totalImagesPullingTime="1.818278184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:39.357537914 +0000 UTC m=+280.466313822" watchObservedRunningTime="2026-09-17 00:14:39.359502773 +0000 UTC m=+280.468278689"
Sep 17 00:14:39.958601 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:39.958557    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-nw6jd" podUID="2dba56c7-2ca8-416c-af7c-8057b63fb437"
Sep 17 00:14:40.332718 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.332692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc" event={"ID":"56da6621-b00a-4cf7-af58-6949200a0550","Type":"ContainerStarted","Data":"3f8bafd58c69f4b7ab1df5c35c368b16e6e6d7b9f16a21b2008741066f07050f"}
Sep 17 00:14:40.333054 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.332772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc" event={"ID":"56da6621-b00a-4cf7-af58-6949200a0550","Type":"ContainerStarted","Data":"303f78a9cb5bd8045ed4a621d3688f9ba06ae6a10f3e196cd0cf18c395e72830"}
Sep 17 00:14:40.333054 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.332796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:14:40.468071 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.467995    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-975697f56-ctshc"]
Sep 17 00:14:40.471356 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.471338    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.473640 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.473619    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 17 00:14:40.473745 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.473687    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 17 00:14:40.473745 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.473690    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 17 00:14:40.473856 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.473807    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 17 00:14:40.474216 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.474196    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 17 00:14:40.474279 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.474238    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-c9b8b\""
Sep 17 00:14:40.478892 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.478869    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 17 00:14:40.481318 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.481298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-975697f56-ctshc"]
Sep 17 00:14:40.567141 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.567113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-federate-client-tls\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.567269 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.567160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f4c011-6515-45d4-9686-a7dca2a527f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.567269 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.567215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f4c011-6515-45d4-9686-a7dca2a527f7-serving-certs-ca-bundle\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.567269 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.567250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8lzp\" (UniqueName: \"kubernetes.io/projected/79f4c011-6515-45d4-9686-a7dca2a527f7-kube-api-access-c8lzp\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.567382 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.567307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f4c011-6515-45d4-9686-a7dca2a527f7-metrics-client-ca\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.567382 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.567371    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-telemeter-client-tls\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.567493 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.567398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.567493 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.567436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-secret-telemeter-client\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.668463 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.668433    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-federate-client-tls\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.668463 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.668463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f4c011-6515-45d4-9686-a7dca2a527f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.668609 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.668486    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f4c011-6515-45d4-9686-a7dca2a527f7-serving-certs-ca-bundle\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.668609 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.668508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8lzp\" (UniqueName: \"kubernetes.io/projected/79f4c011-6515-45d4-9686-a7dca2a527f7-kube-api-access-c8lzp\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.668673 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.668642    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f4c011-6515-45d4-9686-a7dca2a527f7-metrics-client-ca\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.668718 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.668701    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-telemeter-client-tls\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.668761 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.668732    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.668808 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.668766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-secret-telemeter-client\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.669326 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.669300    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f4c011-6515-45d4-9686-a7dca2a527f7-serving-certs-ca-bundle\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.669433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.669418    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79f4c011-6515-45d4-9686-a7dca2a527f7-metrics-client-ca\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.669575 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.669555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79f4c011-6515-45d4-9686-a7dca2a527f7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.670915 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.670883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-federate-client-tls\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.671326 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.671309    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-secret-telemeter-client\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.671536 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.671518    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.671656 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.671635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/79f4c011-6515-45d4-9686-a7dca2a527f7-telemeter-client-tls\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.676209 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.676187    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8lzp\" (UniqueName: \"kubernetes.io/projected/79f4c011-6515-45d4-9686-a7dca2a527f7-kube-api-access-c8lzp\") pod \"telemeter-client-975697f56-ctshc\" (UID: \"79f4c011-6515-45d4-9686-a7dca2a527f7\") " pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:40.781041 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:40.780989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-975697f56-ctshc"
Sep 17 00:14:41.052333 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.052193    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-975697f56-ctshc"]
Sep 17 00:14:41.055311 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:41.055282    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79f4c011_6515_45d4_9686_a7dca2a527f7.slice/crio-a66beba1d8731ca4096d9330abe8ae56703867322a7de8c17fe319c12c83f896 WatchSource:0}: Error finding container a66beba1d8731ca4096d9330abe8ae56703867322a7de8c17fe319c12c83f896: Status 404 returned error can't find the container with id a66beba1d8731ca4096d9330abe8ae56703867322a7de8c17fe319c12c83f896
Sep 17 00:14:41.340442 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.340410    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc" event={"ID":"56da6621-b00a-4cf7-af58-6949200a0550","Type":"ContainerStarted","Data":"aa849566bd6e09917790729a5516619576f7d868d9e82623f991f1b27ce2bd30"}
Sep 17 00:14:41.341704 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.341665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-975697f56-ctshc" event={"ID":"79f4c011-6515-45d4-9686-a7dca2a527f7","Type":"ContainerStarted","Data":"a66beba1d8731ca4096d9330abe8ae56703867322a7de8c17fe319c12c83f896"}
Sep 17 00:14:41.465620 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.465578    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 00:14:41.469757 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.469735    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.472438 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.472407    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 00:14:41.472575 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.472474    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 00:14:41.472575 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.472536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 00:14:41.472689 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.472536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 00:14:41.472689 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.472670    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 00:14:41.472793 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.472698    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xg88x\""
Sep 17 00:14:41.472793 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.472776    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 00:14:41.472940 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.472925    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 00:14:41.473006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.472992    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 00:14:41.473448 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.473428    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 00:14:41.473566 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.473521    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 00:14:41.474029 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.473986    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 00:14:41.474029 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.474006    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 00:14:41.474212 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.474006    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 00:14:41.474212 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.474096    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1npb8gs6ve2i6\""
Sep 17 00:14:41.474385 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.474228    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 00:14:41.476137 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.476116    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 00:14:41.484481 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.484454    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 00:14:41.576602 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.576560    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.576784 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.576605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config-out\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.576784 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.576635    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.576784 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.576734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.576997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.576811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-web-config\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.576997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.576846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.576997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.576925    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.576997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.576967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577183 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577002    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577183 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577183 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577057    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577183 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577085    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckln7\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-kube-api-access-ckln7\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577183 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577115    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577413 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577413 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577413 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577291    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577413 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577610 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577610 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.577610 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.577478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678362 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678362 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678362 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678343    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678383    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678414    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config-out\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678442    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-web-config\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678643    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678710    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678740    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckln7\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-kube-api-access-ckln7\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678807    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678866    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.678980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.678976    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.679588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.679560    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.680372 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.679754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.680372 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.679863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.680372 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.680036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.682309 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.682286    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.682528 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.682504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.683310 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.683215    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.683310 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.683220    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.684006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.683599    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.684006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.683734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.684163 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.684066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.684523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.684503    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-web-config\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.684788 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.684760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.684912 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.684880    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.684974 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.684945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.684974 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.684959    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.685159 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.685138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config-out\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.685414 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.685397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.686129 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.686108    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.686989 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.686971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckln7\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-kube-api-access-ckln7\") pod \"prometheus-k8s-0\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:41.781213 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:41.781003    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:42.062702 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:42.062629    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 00:14:42.065792 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:42.065771    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5c5747_a5a7_4845_81f9_48bb3fa37aee.slice/crio-23ae6b2abf65f3dfb1b7bc56f4065e8bea96a43448cbb05c81fd090c663d204b WatchSource:0}: Error finding container 23ae6b2abf65f3dfb1b7bc56f4065e8bea96a43448cbb05c81fd090c663d204b: Status 404 returned error can't find the container with id 23ae6b2abf65f3dfb1b7bc56f4065e8bea96a43448cbb05c81fd090c663d204b
Sep 17 00:14:42.349498 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:42.349389    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc" event={"ID":"56da6621-b00a-4cf7-af58-6949200a0550","Type":"ContainerStarted","Data":"1cf576252a661b82a9696bc8fde8562c7d5476ca68d4826cde83c21ceaf996fc"}
Sep 17 00:14:42.349498 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:42.349466    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc" event={"ID":"56da6621-b00a-4cf7-af58-6949200a0550","Type":"ContainerStarted","Data":"e501873317b01dcdd967675b9443452ecda1a8ee9e8d43628be90a694f562421"}
Sep 17 00:14:42.349963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:42.349509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc" event={"ID":"56da6621-b00a-4cf7-af58-6949200a0550","Type":"ContainerStarted","Data":"e093cdeac910fcfe924e2ec6f81aad7a1056c4c5c04bf4e25e132063a292566f"}
Sep 17 00:14:42.349963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:42.349550    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:42.350876 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:42.350842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerStarted","Data":"23ae6b2abf65f3dfb1b7bc56f4065e8bea96a43448cbb05c81fd090c663d204b"}
Sep 17 00:14:42.369696 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:42.369635    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc" podStartSLOduration=1.6908550679999999 podStartE2EDuration="5.369620854s" totalImagesPullingTime="3.678765786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:42.368107639 +0000 UTC m=+283.476883567" watchObservedRunningTime="2026-09-17 00:14:42.369620854 +0000 UTC m=+283.478396773"
Sep 17 00:14:43.092692 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:43.092658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:14:43.097600 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:43.095891    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2dba56c7-2ca8-416c-af7c-8057b63fb437-metrics-tls\") pod \"dns-default-nw6jd\" (UID: \"2dba56c7-2ca8-416c-af7c-8057b63fb437\") " pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:14:43.337210 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:43.337182    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-d74lr\""
Sep 17 00:14:43.344568 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:43.344499    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:14:43.357777 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:43.357676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-975697f56-ctshc" event={"ID":"79f4c011-6515-45d4-9686-a7dca2a527f7","Type":"ContainerStarted","Data":"e033f4fd479fb4e671a6d4792a4b486c550991147c2379606da373a9091441c8"}
Sep 17 00:14:43.623963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:43.623867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nw6jd"]
Sep 17 00:14:43.679355 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:14:43.679323    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dba56c7_2ca8_416c_af7c_8057b63fb437.slice/crio-1849d903d3344483b1829cc62e672fba6e7ec119233962a57e659bf9f04af029 WatchSource:0}: Error finding container 1849d903d3344483b1829cc62e672fba6e7ec119233962a57e659bf9f04af029: Status 404 returned error can't find the container with id 1849d903d3344483b1829cc62e672fba6e7ec119233962a57e659bf9f04af029
Sep 17 00:14:43.999257 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:43.999208    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb" podUID="ae4f647a-8ac5-4d8e-a061-ed7ad945b382" containerName="registry" containerID="cri-o://29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9" gracePeriod=30
Sep 17 00:14:44.225475 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.225451    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:14:44.365298 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.365263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-975697f56-ctshc" event={"ID":"79f4c011-6515-45d4-9686-a7dca2a527f7","Type":"ContainerStarted","Data":"09582a34d7e4f6850f3fe2c225c0e534857875c3117d1fa9b698eb3fe1dd642e"}
Sep 17 00:14:44.365692 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.365333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-975697f56-ctshc" event={"ID":"79f4c011-6515-45d4-9686-a7dca2a527f7","Type":"ContainerStarted","Data":"79acffa107c2ad0c66eea0a43fae985b54164b8924a121fa622385785eadf2e6"}
Sep 17 00:14:44.367257 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.367234    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerID="6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85" exitCode=0
Sep 17 00:14:44.367386 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.367339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerDied","Data":"6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85"}
Sep 17 00:14:44.369016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.368850    2565 generic.go:356] "Generic (PLEG): container finished" podID="ae4f647a-8ac5-4d8e-a061-ed7ad945b382" containerID="29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9" exitCode=0
Sep 17 00:14:44.369016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.368922    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb"
Sep 17 00:14:44.369016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.368953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb" event={"ID":"ae4f647a-8ac5-4d8e-a061-ed7ad945b382","Type":"ContainerDied","Data":"29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9"}
Sep 17 00:14:44.369016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.368994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5545b8dc84-zb7vb" event={"ID":"ae4f647a-8ac5-4d8e-a061-ed7ad945b382","Type":"ContainerDied","Data":"b03c67bc76b84ca72e99ba2905b0125a224e2bd8c5323c200e1122683330343b"}
Sep 17 00:14:44.369274 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.369023    2565 scope.go:117] "RemoveContainer" containerID="29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9"
Sep 17 00:14:44.370630 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.370594    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nw6jd" event={"ID":"2dba56c7-2ca8-416c-af7c-8057b63fb437","Type":"ContainerStarted","Data":"1849d903d3344483b1829cc62e672fba6e7ec119233962a57e659bf9f04af029"}
Sep 17 00:14:44.379336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.379318    2565 scope.go:117] "RemoveContainer" containerID="29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9"
Sep 17 00:14:44.379645 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:14:44.379612    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9\": container with ID starting with 29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9 not found: ID does not exist" containerID="29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9"
Sep 17 00:14:44.379759 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.379650    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9"} err="failed to get container status \"29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9\": rpc error: code = NotFound desc = could not find container \"29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9\": container with ID starting with 29e2ea261d8047bb385cd782653c3c2b7dad9c34d752b298ef28ab5c18ba64d9 not found: ID does not exist"
Sep 17 00:14:44.386655 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.386611    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-975697f56-ctshc" podStartSLOduration=1.76459633 podStartE2EDuration="4.386594953s" totalImagesPullingTime="2.621998623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:44.383965844 +0000 UTC m=+285.492741762" watchObservedRunningTime="2026-09-17 00:14:44.386594953 +0000 UTC m=+285.495370867"
Sep 17 00:14:44.404689 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.404669    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-bound-sa-token\") pod \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") "
Sep 17 00:14:44.404803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.404715    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qfdh\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-kube-api-access-9qfdh\") pod \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") "
Sep 17 00:14:44.404803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.404747    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-installation-pull-secrets\") pod \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") "
Sep 17 00:14:44.404803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.404800    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-trusted-ca\") pod \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") "
Sep 17 00:14:44.404984 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.404828    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-ca-trust-extracted\") pod \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") "
Sep 17 00:14:44.404984 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.404856    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-certificates\") pod \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") "
Sep 17 00:14:44.404984 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.404883    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-image-registry-private-configuration\") pod \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") "
Sep 17 00:14:44.404984 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.404931    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") pod \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\" (UID: \"ae4f647a-8ac5-4d8e-a061-ed7ad945b382\") "
Sep 17 00:14:44.405479 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.405323    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ae4f647a-8ac5-4d8e-a061-ed7ad945b382" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:14:44.406280 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.406255    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ae4f647a-8ac5-4d8e-a061-ed7ad945b382" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:14:44.407467 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.407438    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ae4f647a-8ac5-4d8e-a061-ed7ad945b382" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:14:44.407551 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.407518    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ae4f647a-8ac5-4d8e-a061-ed7ad945b382" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:14:44.407660 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.407636    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-kube-api-access-9qfdh" (OuterVolumeSpecName: "kube-api-access-9qfdh") pod "ae4f647a-8ac5-4d8e-a061-ed7ad945b382" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382"). InnerVolumeSpecName "kube-api-access-9qfdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:14:44.407980 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.407934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ae4f647a-8ac5-4d8e-a061-ed7ad945b382" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:14:44.408641 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.408611    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ae4f647a-8ac5-4d8e-a061-ed7ad945b382" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:14:44.416695 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.416671    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ae4f647a-8ac5-4d8e-a061-ed7ad945b382" (UID: "ae4f647a-8ac5-4d8e-a061-ed7ad945b382"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:14:44.507598 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.507383    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-bound-sa-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:14:44.507598 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.507564    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qfdh\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-kube-api-access-9qfdh\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:14:44.508132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.508102    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-installation-pull-secrets\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:14:44.508241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.508179    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-trusted-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:14:44.508241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.508204    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-ca-trust-extracted\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:14:44.508241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.508218    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-certificates\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:14:44.508241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.508228    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-image-registry-private-configuration\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:14:44.508241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.508240    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ae4f647a-8ac5-4d8e-a061-ed7ad945b382-registry-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:14:44.693865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.693839    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5545b8dc84-zb7vb"]
Sep 17 00:14:44.697741 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:44.697707    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5545b8dc84-zb7vb"]
Sep 17 00:14:45.397146 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:45.397102    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4f647a-8ac5-4d8e-a061-ed7ad945b382" path="/var/lib/kubelet/pods/ae4f647a-8ac5-4d8e-a061-ed7ad945b382/volumes"
Sep 17 00:14:46.384699 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:46.384661    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nw6jd" event={"ID":"2dba56c7-2ca8-416c-af7c-8057b63fb437","Type":"ContainerStarted","Data":"5b6edab6522c8a28f498a674b99f200988ff9dffeeb2467862d91723e410a7bf"}
Sep 17 00:14:46.384864 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:46.384727    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nw6jd" event={"ID":"2dba56c7-2ca8-416c-af7c-8057b63fb437","Type":"ContainerStarted","Data":"52a1b2b843d3b5583824a634f9a9bcf4d1ba37dc3d603787fcd48b7f2780cc8f"}
Sep 17 00:14:46.384864 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:46.384758    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:14:46.402586 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:46.402529    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nw6jd" podStartSLOduration=251.599692719 podStartE2EDuration="4m13.402510832s" totalImagesPullingTime="1.802818113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:10:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:46.399981839 +0000 UTC m=+287.508757757" watchObservedRunningTime="2026-09-17 00:14:46.402510832 +0000 UTC m=+287.511286752"
Sep 17 00:14:48.365786 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:48.365766    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-79b7fd8499-6b6wc"
Sep 17 00:14:49.402197 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:49.402163    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerStarted","Data":"61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58"}
Sep 17 00:14:49.402540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:49.402224    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerStarted","Data":"53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b"}
Sep 17 00:14:49.402540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:49.402250    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerStarted","Data":"0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9"}
Sep 17 00:14:49.402540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:49.402274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerStarted","Data":"939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297"}
Sep 17 00:14:49.402540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:49.402297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerStarted","Data":"69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61"}
Sep 17 00:14:49.402540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:49.402318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerStarted","Data":"bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f"}
Sep 17 00:14:49.430795 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:49.430737    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.766383234 podStartE2EDuration="8.43071878s" totalImagesPullingTime="5.64291593s" totalInitContainerRuntime="21.419616ms" isStatefulPod=false podCreationTimestamp="2026-09-17 00:14:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:14:49.427777033 +0000 UTC m=+290.536552947" watchObservedRunningTime="2026-09-17 00:14:49.43071878 +0000 UTC m=+290.539494697"
Sep 17 00:14:51.781962 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:51.781929    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:14:56.392274 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:56.392243    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nw6jd"
Sep 17 00:14:59.294925 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:59.294884    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:14:59.295310 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:59.294956    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:14:59.297716 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:14:59.297699    2565 kubelet.go:1648] "Image garbage collection succeeded"
Sep 17 00:15:25.541227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:25.541194    2565 generic.go:356] "Generic (PLEG): container finished" podID="26347aba-c871-478d-af3d-bb09d4eb9260" containerID="05f919a326b719716db53246476a06056631656e2d6f4b0a4f646734462762f1" exitCode=0
Sep 17 00:15:25.541587 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:25.541236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6zdqm" event={"ID":"26347aba-c871-478d-af3d-bb09d4eb9260","Type":"ContainerDied","Data":"05f919a326b719716db53246476a06056631656e2d6f4b0a4f646734462762f1"}
Sep 17 00:15:25.541587 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:25.541522    2565 scope.go:117] "RemoveContainer" containerID="05f919a326b719716db53246476a06056631656e2d6f4b0a4f646734462762f1"
Sep 17 00:15:26.547277 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:26.547241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-6zdqm" event={"ID":"26347aba-c871-478d-af3d-bb09d4eb9260","Type":"ContainerStarted","Data":"4d78d945d7cc0024e38792ca23870071441074faa2eccbba32ba7a63e57f5cf8"}
Sep 17 00:15:41.781726 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:41.781694    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:15:41.801424 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:41.801397    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:15:42.659048 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:42.659023    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:15:59.764117 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:59.764041    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 00:15:59.764680 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:59.764308    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="prometheus" containerID="cri-o://bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f" gracePeriod=600
Sep 17 00:15:59.764680 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:59.764332    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy" containerID="cri-o://53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b" gracePeriod=600
Sep 17 00:15:59.764680 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:59.764375    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy-thanos" containerID="cri-o://61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58" gracePeriod=600
Sep 17 00:15:59.764680 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:59.764352    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="config-reloader" containerID="cri-o://69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61" gracePeriod=600
Sep 17 00:15:59.764680 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:59.764415    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy-web" containerID="cri-o://0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9" gracePeriod=600
Sep 17 00:15:59.764680 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:15:59.764342    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="thanos-sidecar" containerID="cri-o://939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297" gracePeriod=600
Sep 17 00:16:00.723533 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723498    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerID="61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58" exitCode=0
Sep 17 00:16:00.723533 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723524    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerID="53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b" exitCode=0
Sep 17 00:16:00.723533 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723530    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerID="939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297" exitCode=0
Sep 17 00:16:00.723533 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723538    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerID="69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61" exitCode=0
Sep 17 00:16:00.723533 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723543    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerID="bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f" exitCode=0
Sep 17 00:16:00.723836 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerDied","Data":"61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58"}
Sep 17 00:16:00.723836 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723623    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerDied","Data":"53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b"}
Sep 17 00:16:00.723836 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerDied","Data":"939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297"}
Sep 17 00:16:00.723836 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerDied","Data":"69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61"}
Sep 17 00:16:00.723836 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:00.723697    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerDied","Data":"bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f"}
Sep 17 00:16:01.008437 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.008413    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.131654 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.131622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.131654 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.131653    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckln7\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-kube-api-access-ckln7\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.131840 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.131672    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-1\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.131840 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.131700    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-thanos-prometheus-http-client-file\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.131840 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.131826    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-web-config\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132024 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.131880    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-metrics-client-ca\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132024 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.131947    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-tls\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132024 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.131999    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-serving-certs-ca-bundle\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132171 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132027    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-kubelet-serving-ca-bundle\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132171 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132052    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-2\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132171 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132086    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-kube-rbac-proxy\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132171 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config-out\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132171 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132077    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:16:01.132171 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132154    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-0\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132204    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-trusted-ca-bundle\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132234    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-metrics-client-certs\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132245    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:16:01.132465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132303    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-db\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132327    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132357    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-grpc-tls\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132383    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-tls-assets\") pod \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\" (UID: \"fd5c5747-a5a7-4845-81f9-48bb3fa37aee\") "
Sep 17 00:16:01.132835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132480    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:16:01.132835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132633    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:16:01.132835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132671    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-metrics-client-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.132835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132692    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.132835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.132709    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.133113 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.133064    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:16:01.134148 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.134121    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:16:01.134584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.134559    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-kube-api-access-ckln7" (OuterVolumeSpecName: "kube-api-access-ckln7") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "kube-api-access-ckln7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:16:01.134760 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.134733    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:16:01.135142 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.135097    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:16:01.135391 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.135342    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:16:01.135489 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.135399    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:16:01.136273 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.136236    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:16:01.136569 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.136537    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:16:01.136569 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.136555    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config-out" (OuterVolumeSpecName: "config-out") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:16:01.136695 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.136640    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:16:01.136695 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.136666    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:16:01.137177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.137150    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:16:01.137280 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.137261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config" (OuterVolumeSpecName: "config") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:16:01.137954 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.137937    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:16:01.146862 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.146840    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-web-config" (OuterVolumeSpecName: "web-config") pod "fd5c5747-a5a7-4845-81f9-48bb3fa37aee" (UID: "fd5c5747-a5a7-4845-81f9-48bb3fa37aee"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:16:01.233048 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233027    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233048 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233046    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233057    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233066    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-kube-rbac-proxy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233074    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config-out\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233085    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233094    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233102    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-metrics-client-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233111    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233121    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-prometheus-k8s-db\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233129    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233136    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-grpc-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233143    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-tls-assets\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233151    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233160    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckln7\" (UniqueName: \"kubernetes.io/projected/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-kube-api-access-ckln7\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233524 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233169    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.233524 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.233178    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd5c5747-a5a7-4845-81f9-48bb3fa37aee-web-config\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:16:01.730748 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.730661    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerID="0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9" exitCode=0
Sep 17 00:16:01.730748 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.730732    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.730992 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.730751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerDied","Data":"0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9"}
Sep 17 00:16:01.730992 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.730845    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd5c5747-a5a7-4845-81f9-48bb3fa37aee","Type":"ContainerDied","Data":"23ae6b2abf65f3dfb1b7bc56f4065e8bea96a43448cbb05c81fd090c663d204b"}
Sep 17 00:16:01.730992 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.730915    2565 scope.go:117] "RemoveContainer" containerID="61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58"
Sep 17 00:16:01.738617 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.738597    2565 scope.go:117] "RemoveContainer" containerID="53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b"
Sep 17 00:16:01.745795 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.745778    2565 scope.go:117] "RemoveContainer" containerID="0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9"
Sep 17 00:16:01.753223 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.753194    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 00:16:01.753527 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.753511    2565 scope.go:117] "RemoveContainer" containerID="939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297"
Sep 17 00:16:01.759479 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.759451    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 00:16:01.765733 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.765713    2565 scope.go:117] "RemoveContainer" containerID="69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61"
Sep 17 00:16:01.772382 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.772351    2565 scope.go:117] "RemoveContainer" containerID="bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f"
Sep 17 00:16:01.779921 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.779885    2565 scope.go:117] "RemoveContainer" containerID="6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85"
Sep 17 00:16:01.781755 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.781739    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 00:16:01.782096 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782081    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="thanos-sidecar"
Sep 17 00:16:01.782149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782098    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="thanos-sidecar"
Sep 17 00:16:01.782149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782106    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy"
Sep 17 00:16:01.782149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782112    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy"
Sep 17 00:16:01.782149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782129    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="config-reloader"
Sep 17 00:16:01.782149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782134    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="config-reloader"
Sep 17 00:16:01.782149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782142    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="prometheus"
Sep 17 00:16:01.782149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782147    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="prometheus"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782154    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy-thanos"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782160    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy-thanos"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782166    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="init-config-reloader"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782172    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="init-config-reloader"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782177    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4f647a-8ac5-4d8e-a061-ed7ad945b382" containerName="registry"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782182    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4f647a-8ac5-4d8e-a061-ed7ad945b382" containerName="registry"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782188    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy-web"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782195    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy-web"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782237    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4f647a-8ac5-4d8e-a061-ed7ad945b382" containerName="registry"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782246    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy-thanos"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782252    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782257    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="thanos-sidecar"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782262    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="prometheus"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782269    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="kube-rbac-proxy-web"
Sep 17 00:16:01.782346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.782280    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" containerName="config-reloader"
Sep 17 00:16:01.787236 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.787220    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.787398 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.787365    2565 scope.go:117] "RemoveContainer" containerID="61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58"
Sep 17 00:16:01.787654 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:16:01.787624    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58\": container with ID starting with 61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58 not found: ID does not exist" containerID="61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58"
Sep 17 00:16:01.787739 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.787661    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58"} err="failed to get container status \"61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58\": rpc error: code = NotFound desc = could not find container \"61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58\": container with ID starting with 61d57cb4e338bd413919d0cdbf14f7dec93c9b3a5300a51fc288d13560c9fd58 not found: ID does not exist"
Sep 17 00:16:01.787739 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.787679    2565 scope.go:117] "RemoveContainer" containerID="53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b"
Sep 17 00:16:01.788022 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:16:01.787991    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b\": container with ID starting with 53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b not found: ID does not exist" containerID="53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b"
Sep 17 00:16:01.788103 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.788029    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b"} err="failed to get container status \"53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b\": rpc error: code = NotFound desc = could not find container \"53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b\": container with ID starting with 53535ff895240c849d1d893f3b2fd737322c77921ec698c11b316ed6c7354e4b not found: ID does not exist"
Sep 17 00:16:01.788103 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.788052    2565 scope.go:117] "RemoveContainer" containerID="0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9"
Sep 17 00:16:01.788318 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:16:01.788299    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9\": container with ID starting with 0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9 not found: ID does not exist" containerID="0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9"
Sep 17 00:16:01.788381 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.788327    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9"} err="failed to get container status \"0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9\": rpc error: code = NotFound desc = could not find container \"0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9\": container with ID starting with 0ede19750f81e28e1415ce8611a367040f332b1e6f6280c6e0ea5faef2eab9b9 not found: ID does not exist"
Sep 17 00:16:01.788381 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.788349    2565 scope.go:117] "RemoveContainer" containerID="939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297"
Sep 17 00:16:01.788616 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:16:01.788596    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297\": container with ID starting with 939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297 not found: ID does not exist" containerID="939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297"
Sep 17 00:16:01.788683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.788617    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297"} err="failed to get container status \"939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297\": rpc error: code = NotFound desc = could not find container \"939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297\": container with ID starting with 939f797e8b20e01d86a24fa7b6d761bff85d882a34e77442ea385fc972e46297 not found: ID does not exist"
Sep 17 00:16:01.788683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.788632    2565 scope.go:117] "RemoveContainer" containerID="69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61"
Sep 17 00:16:01.788876 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:16:01.788859    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61\": container with ID starting with 69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61 not found: ID does not exist" containerID="69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61"
Sep 17 00:16:01.789037 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.788880    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61"} err="failed to get container status \"69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61\": rpc error: code = NotFound desc = could not find container \"69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61\": container with ID starting with 69c0915d397d89dfd4bea7d987a3b958802f04bdc2ef345c04e73333d330aa61 not found: ID does not exist"
Sep 17 00:16:01.789037 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.788920    2565 scope.go:117] "RemoveContainer" containerID="bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f"
Sep 17 00:16:01.789175 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:16:01.789154    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f\": container with ID starting with bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f not found: ID does not exist" containerID="bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f"
Sep 17 00:16:01.789229 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.789182    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f"} err="failed to get container status \"bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f\": rpc error: code = NotFound desc = could not find container \"bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f\": container with ID starting with bc0363f9e5ea192d7befa14a1390f73a7e869ee2138e27c389038bee7185e19f not found: ID does not exist"
Sep 17 00:16:01.789229 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.789201    2565 scope.go:117] "RemoveContainer" containerID="6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85"
Sep 17 00:16:01.789484 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:16:01.789466    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85\": container with ID starting with 6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85 not found: ID does not exist" containerID="6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85"
Sep 17 00:16:01.789528 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.789493    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85"} err="failed to get container status \"6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85\": rpc error: code = NotFound desc = could not find container \"6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85\": container with ID starting with 6549e70d569793f87e521f4a29c39bda9ec6215af3c3c8cc7efb16ab2c7b6c85 not found: ID does not exist"
Sep 17 00:16:01.790004 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.789982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 17 00:16:01.790097 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790038    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 17 00:16:01.790247 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790235    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 17 00:16:01.790291 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790267    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 17 00:16:01.790559 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790545    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 17 00:16:01.790710 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790695    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 17 00:16:01.790756 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790746    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 17 00:16:01.790825 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790810    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 17 00:16:01.790825 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790818    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xg88x\""
Sep 17 00:16:01.790945 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790863    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1npb8gs6ve2i6\""
Sep 17 00:16:01.790945 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.790872    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 17 00:16:01.791330 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.791300    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 17 00:16:01.791330 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.791317    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 17 00:16:01.791478 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.791380    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 17 00:16:01.791565 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.791551    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 17 00:16:01.793459 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.793439    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 17 00:16:01.795584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.795563    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 17 00:16:01.800365 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.800345    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 00:16:01.837460 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837554 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee266d5e-c12b-4cda-bb15-30076d127020-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837554 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837554 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837567    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee266d5e-c12b-4cda-bb15-30076d127020-config-out\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837688    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-web-config\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837957 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837717    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837957 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837957 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837957 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837775    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgj5k\" (UniqueName: \"kubernetes.io/projected/ee266d5e-c12b-4cda-bb15-30076d127020-kube-api-access-kgj5k\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837957 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-config\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837957 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837885    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.837957 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.838217 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.838217 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.837991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939163 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939137    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939253 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939253 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939253 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939253 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939416 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939273    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee266d5e-c12b-4cda-bb15-30076d127020-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939416 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939300    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939416 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939416 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939416 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939416 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939398    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee266d5e-c12b-4cda-bb15-30076d127020-config-out\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939490    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-web-config\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgj5k\" (UniqueName: \"kubernetes.io/projected/ee266d5e-c12b-4cda-bb15-30076d127020-kube-api-access-kgj5k\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.939691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939654    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-config\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.940157 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.939976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.940157 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.940012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.940157 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.940012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.941047 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.941017    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.942371 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.942347    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ee266d5e-c12b-4cda-bb15-30076d127020-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.942571 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.942547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-config\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.942688 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.942670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ee266d5e-c12b-4cda-bb15-30076d127020-config-out\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.942759 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.942689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.942759 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.942694    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.943431 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.943409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.943550 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.943471    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.943663 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.943636    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.943736 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.943581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.944120 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.944095    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ee266d5e-c12b-4cda-bb15-30076d127020-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.944284 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.944262    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.945213 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.945190    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-web-config\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.945318 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.945248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.945318 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.945248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.945877 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.945861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ee266d5e-c12b-4cda-bb15-30076d127020-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:01.950199 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:01.950183    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgj5k\" (UniqueName: \"kubernetes.io/projected/ee266d5e-c12b-4cda-bb15-30076d127020-kube-api-access-kgj5k\") pod \"prometheus-k8s-0\" (UID: \"ee266d5e-c12b-4cda-bb15-30076d127020\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:02.097508 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:02.097484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:16:02.374505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:02.374474    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 17 00:16:02.376111 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:16:02.376088    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee266d5e_c12b_4cda_bb15_30076d127020.slice/crio-1eb4b1fd6f0dff7e5706ad107656caa68f011184cc7deb2e47ccf468cabd5f42 WatchSource:0}: Error finding container 1eb4b1fd6f0dff7e5706ad107656caa68f011184cc7deb2e47ccf468cabd5f42: Status 404 returned error can't find the container with id 1eb4b1fd6f0dff7e5706ad107656caa68f011184cc7deb2e47ccf468cabd5f42
Sep 17 00:16:02.737058 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:02.736978    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee266d5e-c12b-4cda-bb15-30076d127020" containerID="0ced40b99be600bcda5464f6dbb6cebf00ff8dc6ea70c653505b8b5d68de254c" exitCode=0
Sep 17 00:16:02.737058 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:02.737028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee266d5e-c12b-4cda-bb15-30076d127020","Type":"ContainerDied","Data":"0ced40b99be600bcda5464f6dbb6cebf00ff8dc6ea70c653505b8b5d68de254c"}
Sep 17 00:16:02.737213 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:02.737075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee266d5e-c12b-4cda-bb15-30076d127020","Type":"ContainerStarted","Data":"1eb4b1fd6f0dff7e5706ad107656caa68f011184cc7deb2e47ccf468cabd5f42"}
Sep 17 00:16:03.389272 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:03.389240    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd5c5747-a5a7-4845-81f9-48bb3fa37aee" path="/var/lib/kubelet/pods/fd5c5747-a5a7-4845-81f9-48bb3fa37aee/volumes"
Sep 17 00:16:03.749840 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:03.749754    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee266d5e-c12b-4cda-bb15-30076d127020","Type":"ContainerStarted","Data":"8b9f8a1c4dee490600c78a17319aa0180cd57625fd2f42541926011e6cb2e742"}
Sep 17 00:16:03.749985 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:03.749868    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee266d5e-c12b-4cda-bb15-30076d127020","Type":"ContainerStarted","Data":"4c392414bf80eb9447165b6f99205f4b637d5928e794052bd77c9ce07a0e922f"}
Sep 17 00:16:03.749985 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:03.749931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee266d5e-c12b-4cda-bb15-30076d127020","Type":"ContainerStarted","Data":"5e63d0c6729c347d6c9183722ee0591761f395dca4e9e32128987da612e45f8f"}
Sep 17 00:16:03.749985 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:03.749971    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee266d5e-c12b-4cda-bb15-30076d127020","Type":"ContainerStarted","Data":"1c745bdd8a57d513611f80f633893dfe74da8e874f8a2ee00e1350ae8151cea9"}
Sep 17 00:16:03.750153 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:03.750009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee266d5e-c12b-4cda-bb15-30076d127020","Type":"ContainerStarted","Data":"dfffa9d2b03c1c3487b82578d440976a4aec9caacfdf8ae928ac70756aac93c8"}
Sep 17 00:16:03.750153 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:03.750047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ee266d5e-c12b-4cda-bb15-30076d127020","Type":"ContainerStarted","Data":"b426df311919fdd247e9fa4980deea936aa77d712a4d7fa7fc35f257f4ef1032"}
Sep 17 00:16:03.780145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:03.780093    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.761025051 podStartE2EDuration="2.7800745s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.049449ms" isStatefulPod=false podCreationTimestamp="2026-09-17 00:16:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:16:03.777177944 +0000 UTC m=+364.885953882" watchObservedRunningTime="2026-09-17 00:16:03.7800745 +0000 UTC m=+364.888850416"
Sep 17 00:16:07.098211 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:16:07.098182    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:17:02.098519 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:02.098486    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:17:02.113929 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:02.113883    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:17:03.013227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:03.013196    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 17 00:17:16.447230 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.447190    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"]
Sep 17 00:17:16.455339 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.455317    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"
Sep 17 00:17:16.458753 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.458729    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-s62s7\""
Sep 17 00:17:16.458874 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.458771    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 17 00:17:16.458874 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.458810    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 17 00:17:16.459001 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.458961    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"]
Sep 17 00:17:16.495785 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.495751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cff2909a-36a6-467f-8559-160b4d1245cc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fphl5\" (UID: \"cff2909a-36a6-467f-8559-160b4d1245cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"
Sep 17 00:17:16.495892 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.495870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn6g5\" (UniqueName: \"kubernetes.io/projected/cff2909a-36a6-467f-8559-160b4d1245cc-kube-api-access-bn6g5\") pod \"cert-manager-cainjector-559cdd8c87-fphl5\" (UID: \"cff2909a-36a6-467f-8559-160b4d1245cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"
Sep 17 00:17:16.597090 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.597063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn6g5\" (UniqueName: \"kubernetes.io/projected/cff2909a-36a6-467f-8559-160b4d1245cc-kube-api-access-bn6g5\") pod \"cert-manager-cainjector-559cdd8c87-fphl5\" (UID: \"cff2909a-36a6-467f-8559-160b4d1245cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"
Sep 17 00:17:16.597188 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.597102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cff2909a-36a6-467f-8559-160b4d1245cc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fphl5\" (UID: \"cff2909a-36a6-467f-8559-160b4d1245cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"
Sep 17 00:17:16.604607 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.604583    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cff2909a-36a6-467f-8559-160b4d1245cc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fphl5\" (UID: \"cff2909a-36a6-467f-8559-160b4d1245cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"
Sep 17 00:17:16.604860 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.604844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn6g5\" (UniqueName: \"kubernetes.io/projected/cff2909a-36a6-467f-8559-160b4d1245cc-kube-api-access-bn6g5\") pod \"cert-manager-cainjector-559cdd8c87-fphl5\" (UID: \"cff2909a-36a6-467f-8559-160b4d1245cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"
Sep 17 00:17:16.779723 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:16.779665    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"
Sep 17 00:17:17.048244 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:17.048121    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fphl5"]
Sep 17 00:17:17.050679 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:17:17.050647    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcff2909a_36a6_467f_8559_160b4d1245cc.slice/crio-5574b59c93e94a563cd68d39b86929560504bd680014d2cc75c8d54a4bf6ac3c WatchSource:0}: Error finding container 5574b59c93e94a563cd68d39b86929560504bd680014d2cc75c8d54a4bf6ac3c: Status 404 returned error can't find the container with id 5574b59c93e94a563cd68d39b86929560504bd680014d2cc75c8d54a4bf6ac3c
Sep 17 00:17:17.053051 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:17.053032    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:17:18.057308 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:18.057256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5" event={"ID":"cff2909a-36a6-467f-8559-160b4d1245cc","Type":"ContainerStarted","Data":"5574b59c93e94a563cd68d39b86929560504bd680014d2cc75c8d54a4bf6ac3c"}
Sep 17 00:17:22.075619 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:22.075543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5" event={"ID":"cff2909a-36a6-467f-8559-160b4d1245cc","Type":"ContainerStarted","Data":"560973646c8c5d3ee8dc645f559c76fc818aab4b40c20fc1a1d04c1939075ed7"}
Sep 17 00:17:22.089738 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:22.089694    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fphl5" podStartSLOduration=2.096932229 podStartE2EDuration="6.08967996s" totalImagesPullingTime="3.992747731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:17:22.089051159 +0000 UTC m=+443.197827076" watchObservedRunningTime="2026-09-17 00:17:22.08967996 +0000 UTC m=+443.198455875"
Sep 17 00:17:47.641930 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.641880    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"]
Sep 17 00:17:47.653074 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.653041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.656334 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.656305    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 17 00:17:47.656562 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.656347    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 17 00:17:47.656698 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.656352    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mk2l7\""
Sep 17 00:17:47.656698 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.656375    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 17 00:17:47.656698 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.656393    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 17 00:17:47.666193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.666166    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"]
Sep 17 00:17:47.746565 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.746536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlbkr\" (UniqueName: \"kubernetes.io/projected/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-kube-api-access-tlbkr\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.746687 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.746570    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-manifests\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.746687 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.746587    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-tmp\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.746687 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.746616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.746795 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.746696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.847879 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.847847    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlbkr\" (UniqueName: \"kubernetes.io/projected/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-kube-api-access-tlbkr\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.848047 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.848008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-manifests\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.848047 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.848038    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-tmp\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.848168 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.848081    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.848168 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.848156    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.848428 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.848407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-manifests\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.850359 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.850329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-tmp\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.850565 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.850548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.850643 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.850605    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.858863 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.858831    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlbkr\" (UniqueName: \"kubernetes.io/projected/cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6-kube-api-access-tlbkr\") pod \"opendatahub-operator-controller-manager-5cc689bf9d-k5fzq\" (UID: \"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6\") " pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:47.967258 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:47.967192    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:48.239321 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:48.239227    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"]
Sep 17 00:17:48.241695 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:17:48.241672    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc99e8b1_b00b_4f8b_8c66_843cc3cc4db6.slice/crio-df6a86293e8715417d05f6d07c9afbc23f5b0ac33083bdc331e2eabf46b71600 WatchSource:0}: Error finding container df6a86293e8715417d05f6d07c9afbc23f5b0ac33083bdc331e2eabf46b71600: Status 404 returned error can't find the container with id df6a86293e8715417d05f6d07c9afbc23f5b0ac33083bdc331e2eabf46b71600
Sep 17 00:17:49.186403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:49.186283    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq" event={"ID":"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6","Type":"ContainerStarted","Data":"df6a86293e8715417d05f6d07c9afbc23f5b0ac33083bdc331e2eabf46b71600"}
Sep 17 00:17:52.208220 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:52.208186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq" event={"ID":"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6","Type":"ContainerStarted","Data":"a0dbb6d75e9497aa6b0c16e9441b568690026d72f2244b9014233f734e8ede74"}
Sep 17 00:17:53.214219 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:53.214183    2565 generic.go:356] "Generic (PLEG): container finished" podID="cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6" containerID="a0dbb6d75e9497aa6b0c16e9441b568690026d72f2244b9014233f734e8ede74" exitCode=0
Sep 17 00:17:53.214581 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:53.214236    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq" event={"ID":"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6","Type":"ContainerDied","Data":"a0dbb6d75e9497aa6b0c16e9441b568690026d72f2244b9014233f734e8ede74"}
Sep 17 00:17:54.220289 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:54.220253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq" event={"ID":"cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6","Type":"ContainerStarted","Data":"7fa45219b119c8676a2c85932ffde25a7f6691155ebf938fdd9c9685c9bca574"}
Sep 17 00:17:54.220660 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:54.220377    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:17:54.242125 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:17:54.242067    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq" podStartSLOduration=2.639969668 podStartE2EDuration="7.242041814s" totalImagesPullingTime="3.582465814s" totalInitContainerRuntime="1.019606332s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:17:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:17:54.240576787 +0000 UTC m=+475.349352702" watchObservedRunningTime="2026-09-17 00:17:54.242041814 +0000 UTC m=+475.350817729"
Sep 17 00:18:05.227039 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:05.227004    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cc689bf9d-k5fzq"
Sep 17 00:18:07.027079 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.027046    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"]
Sep 17 00:18:07.037967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.037944    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.042305 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.042280    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 17 00:18:07.044004 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.043757    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 17 00:18:07.044004 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.043812    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 17 00:18:07.044004 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.043828    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 17 00:18:07.044004 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.043757    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 17 00:18:07.044281 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.044117    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-frbfh\""
Sep 17 00:18:07.046164 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.046074    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"]
Sep 17 00:18:07.088412 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.088386    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15562294-3ac8-4078-867b-89ab1d1da897-cert\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.088522 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.088434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15562294-3ac8-4078-867b-89ab1d1da897-manager-config\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.088522 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.088491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15562294-3ac8-4078-867b-89ab1d1da897-metrics-cert\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.088522 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.088517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz8r6\" (UniqueName: \"kubernetes.io/projected/15562294-3ac8-4078-867b-89ab1d1da897-kube-api-access-cz8r6\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.171701 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.171675    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"]
Sep 17 00:18:07.174226 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.174206    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.177745 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.177723    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 17 00:18:07.177865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.177736    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 17 00:18:07.177865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.177817    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 17 00:18:07.178018 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.177880    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9dtg8\""
Sep 17 00:18:07.178018 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.177891    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 17 00:18:07.189673 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.189651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15562294-3ac8-4078-867b-89ab1d1da897-cert\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.189781 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.189690    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-tls-certs\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.189781 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.189749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15562294-3ac8-4078-867b-89ab1d1da897-manager-config\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.189781 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.189769    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-tmp\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.189966 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.189791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15562294-3ac8-4078-867b-89ab1d1da897-metrics-cert\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.189966 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.189821    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz8r6\" (UniqueName: \"kubernetes.io/projected/15562294-3ac8-4078-867b-89ab1d1da897-kube-api-access-cz8r6\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.189966 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.189846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbhmh\" (UniqueName: \"kubernetes.io/projected/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-kube-api-access-dbhmh\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.190740 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.190618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15562294-3ac8-4078-867b-89ab1d1da897-manager-config\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.192369 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.192349    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"]
Sep 17 00:18:07.192502 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.192483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15562294-3ac8-4078-867b-89ab1d1da897-metrics-cert\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.192634 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.192619    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15562294-3ac8-4078-867b-89ab1d1da897-cert\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.207597 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.207571    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz8r6\" (UniqueName: \"kubernetes.io/projected/15562294-3ac8-4078-867b-89ab1d1da897-kube-api-access-cz8r6\") pod \"lws-controller-manager-6685c7f5f5-z2nks\" (UID: \"15562294-3ac8-4078-867b-89ab1d1da897\") " pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.290224 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.290163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-tmp\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.290224 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.290216    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbhmh\" (UniqueName: \"kubernetes.io/projected/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-kube-api-access-dbhmh\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.290352 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.290271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-tls-certs\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.290396 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:18:07.290382    2565 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 17 00:18:07.290485 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:18:07.290473    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-tls-certs podName:d4e95bcf-4adf-4797-b46c-8cfe61ae12b5 nodeName:}" failed. No retries permitted until 2026-09-17 00:18:07.790453226 +0000 UTC m=+488.899229122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-tls-certs") pod "kube-auth-proxy-5f57c6d865-s8j24" (UID: "d4e95bcf-4adf-4797-b46c-8cfe61ae12b5") : secret "kube-auth-proxy-tls" not found
Sep 17 00:18:07.292255 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.292230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-tmp\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.298576 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.298553    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbhmh\" (UniqueName: \"kubernetes.io/projected/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-kube-api-access-dbhmh\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.348865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.348844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:07.615220 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.615160    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"]
Sep 17 00:18:07.617836 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:18:07.617805    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15562294_3ac8_4078_867b_89ab1d1da897.slice/crio-a02b4a9b367ae52e5aa589bfe78566502360a231a3d6eabd9c9ffe01da3777fd WatchSource:0}: Error finding container a02b4a9b367ae52e5aa589bfe78566502360a231a3d6eabd9c9ffe01da3777fd: Status 404 returned error can't find the container with id a02b4a9b367ae52e5aa589bfe78566502360a231a3d6eabd9c9ffe01da3777fd
Sep 17 00:18:07.794559 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.794518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-tls-certs\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:07.796962 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:07.796931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d4e95bcf-4adf-4797-b46c-8cfe61ae12b5-tls-certs\") pod \"kube-auth-proxy-5f57c6d865-s8j24\" (UID: \"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5\") " pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:08.084466 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:08.084433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"
Sep 17 00:18:08.282189 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:08.282152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks" event={"ID":"15562294-3ac8-4078-867b-89ab1d1da897","Type":"ContainerStarted","Data":"a02b4a9b367ae52e5aa589bfe78566502360a231a3d6eabd9c9ffe01da3777fd"}
Sep 17 00:18:08.365172 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:08.365133    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24"]
Sep 17 00:18:08.372286 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:18:08.372253    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e95bcf_4adf_4797_b46c_8cfe61ae12b5.slice/crio-7e594c806c13ced7de02c8a2b7307c3a228daaa50d54585430ed7bc41de862bc WatchSource:0}: Error finding container 7e594c806c13ced7de02c8a2b7307c3a228daaa50d54585430ed7bc41de862bc: Status 404 returned error can't find the container with id 7e594c806c13ced7de02c8a2b7307c3a228daaa50d54585430ed7bc41de862bc
Sep 17 00:18:09.289946 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:09.289859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24" event={"ID":"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5","Type":"ContainerStarted","Data":"7e594c806c13ced7de02c8a2b7307c3a228daaa50d54585430ed7bc41de862bc"}
Sep 17 00:18:12.304887 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:12.304847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24" event={"ID":"d4e95bcf-4adf-4797-b46c-8cfe61ae12b5","Type":"ContainerStarted","Data":"f8eaee85180c0fc34ac15599d2dd789e6f8c4340f8828889f5ad71cc6a991b44"}
Sep 17 00:18:12.306434 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:12.306412    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks" event={"ID":"15562294-3ac8-4078-867b-89ab1d1da897","Type":"ContainerStarted","Data":"9ceba9751bf1c71dfe55c51b8c00a953bf95b042d55d43a43c87f89ec258509a"}
Sep 17 00:18:12.306547 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:12.306463    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:18:12.322007 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:12.321968    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5f57c6d865-s8j24" podStartSLOduration=2.158141667 podStartE2EDuration="5.321955677s" totalImagesPullingTime="3.16381401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:18:12.319869076 +0000 UTC m=+493.428645021" watchObservedRunningTime="2026-09-17 00:18:12.321955677 +0000 UTC m=+493.430731592"
Sep 17 00:18:12.335045 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:12.334993    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks" podStartSLOduration=1.475126865 podStartE2EDuration="5.334977376s" totalImagesPullingTime="3.859850511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:18:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:18:12.333861831 +0000 UTC m=+493.442637748" watchObservedRunningTime="2026-09-17 00:18:12.334977376 +0000 UTC m=+493.443753291"
Sep 17 00:18:23.313046 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:18:23.313010    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6685c7f5f5-z2nks"
Sep 17 00:19:05.020386 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:19:05.020337    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-192.ec2.internal" podUID="d7c6efec3d953df3c8f862ee842d933e" containerName="haproxy" probeResult="failure" output="Get \"https://172.20.0.1:6443/version\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 17 00:19:59.323932 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:19:59.323885    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:19:59.325749 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:19:59.325728    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:20:03.784131 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:03.784095    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"]
Sep 17 00:20:03.787107 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:03.787090    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"
Sep 17 00:20:03.789951 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:03.789927    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 17 00:20:03.790090 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:03.789927    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 17 00:20:03.790090 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:03.790035    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 17 00:20:03.790283 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:03.790267    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-s5sjb\""
Sep 17 00:20:03.799923 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:03.799885    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"]
Sep 17 00:20:03.909359 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:03.909332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c4b2\" (UniqueName: \"kubernetes.io/projected/902ba8a2-30d3-4978-99a1-cdeaa7ab670c-kube-api-access-9c4b2\") pod \"dns-operator-controller-manager-7b84cd7c9c-2tkv2\" (UID: \"902ba8a2-30d3-4978-99a1-cdeaa7ab670c\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"
Sep 17 00:20:04.010109 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:04.010079    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c4b2\" (UniqueName: \"kubernetes.io/projected/902ba8a2-30d3-4978-99a1-cdeaa7ab670c-kube-api-access-9c4b2\") pod \"dns-operator-controller-manager-7b84cd7c9c-2tkv2\" (UID: \"902ba8a2-30d3-4978-99a1-cdeaa7ab670c\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"
Sep 17 00:20:04.018168 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:04.018148    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c4b2\" (UniqueName: \"kubernetes.io/projected/902ba8a2-30d3-4978-99a1-cdeaa7ab670c-kube-api-access-9c4b2\") pod \"dns-operator-controller-manager-7b84cd7c9c-2tkv2\" (UID: \"902ba8a2-30d3-4978-99a1-cdeaa7ab670c\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"
Sep 17 00:20:04.097541 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:04.097516    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"
Sep 17 00:20:04.367006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:04.366976    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"]
Sep 17 00:20:04.369357 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:20:04.369335    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902ba8a2_30d3_4978_99a1_cdeaa7ab670c.slice/crio-31769cc12ff8a20128b573f742ccc75b646dcf6a2766747e527e1878d241c379 WatchSource:0}: Error finding container 31769cc12ff8a20128b573f742ccc75b646dcf6a2766747e527e1878d241c379: Status 404 returned error can't find the container with id 31769cc12ff8a20128b573f742ccc75b646dcf6a2766747e527e1878d241c379
Sep 17 00:20:04.797110 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:04.797026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2" event={"ID":"902ba8a2-30d3-4978-99a1-cdeaa7ab670c","Type":"ContainerStarted","Data":"31769cc12ff8a20128b573f742ccc75b646dcf6a2766747e527e1878d241c379"}
Sep 17 00:20:07.811911 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:07.811862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2" event={"ID":"902ba8a2-30d3-4978-99a1-cdeaa7ab670c","Type":"ContainerStarted","Data":"750ebf6bc11fcd18996ad9cea100dd90e28967007db5f870c1f66b4ded2336d8"}
Sep 17 00:20:07.812293 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:07.812039    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"
Sep 17 00:20:07.828434 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:07.828362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2" podStartSLOduration=2.105898771 podStartE2EDuration="4.828347012s" totalImagesPullingTime="2.722448241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:20:07.82742818 +0000 UTC m=+608.936204095" watchObservedRunningTime="2026-09-17 00:20:07.828347012 +0000 UTC m=+608.937122926"
Sep 17 00:20:18.819025 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:18.818988    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-2tkv2"
Sep 17 00:20:50.910146 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:50.910070    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"]
Sep 17 00:20:50.918739 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:50.918714    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"]
Sep 17 00:20:50.918923 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:50.918817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:50.921496 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:50.921475    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xztff\""
Sep 17 00:20:50.921592 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:50.921536    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 17 00:20:51.079291 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.079257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.079531 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.079294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.079531 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.079332    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.079531 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.079398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.079531 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.079433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.079531 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.079467    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.079531 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.079493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwmkj\" (UniqueName: \"kubernetes.io/projected/16626e4d-960e-4f28-a622-96a0e93ebefa-kube-api-access-cwmkj\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.079860 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.079548    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.079860 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.079628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16626e4d-960e-4f28-a622-96a0e93ebefa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.180632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.180564    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.180632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.180595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.180632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.180622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.180880 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.180758    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwmkj\" (UniqueName: \"kubernetes.io/projected/16626e4d-960e-4f28-a622-96a0e93ebefa-kube-api-access-cwmkj\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.180880 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.180843    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.181033 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.180885    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16626e4d-960e-4f28-a622-96a0e93ebefa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.181033 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.180969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.181033 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.180994    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.181033 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.181018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.181227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.181036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.181227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.181048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.181337 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.181275    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.181419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.181400    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.181561 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.181542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16626e4d-960e-4f28-a622-96a0e93ebefa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.183009 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.182989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.183217 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.183198    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.189596 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.189577    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16626e4d-960e-4f28-a622-96a0e93ebefa-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.189807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.189786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwmkj\" (UniqueName: \"kubernetes.io/projected/16626e4d-960e-4f28-a622-96a0e93ebefa-kube-api-access-cwmkj\") pod \"maas-default-gateway-openshift-default-78bb78ff78-pr7x5\" (UID: \"16626e4d-960e-4f28-a622-96a0e93ebefa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.229538 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.229516    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:51.500146 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:51.500123    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"]
Sep 17 00:20:51.502745 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:20:51.502716    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16626e4d_960e_4f28_a622_96a0e93ebefa.slice/crio-6741e831ab18398140de3ef68be863f5878004a5ae78bd98248c07bd5e0beec5 WatchSource:0}: Error finding container 6741e831ab18398140de3ef68be863f5878004a5ae78bd98248c07bd5e0beec5: Status 404 returned error can't find the container with id 6741e831ab18398140de3ef68be863f5878004a5ae78bd98248c07bd5e0beec5
Sep 17 00:20:52.020081 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:52.020045    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" event={"ID":"16626e4d-960e-4f28-a622-96a0e93ebefa","Type":"ContainerStarted","Data":"6741e831ab18398140de3ef68be863f5878004a5ae78bd98248c07bd5e0beec5"}
Sep 17 00:20:56.012706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:56.012668    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:20:56.012955 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:56.012743    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:20:56.012955 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:56.012771    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:20:57.045438 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:57.045403    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" event={"ID":"16626e4d-960e-4f28-a622-96a0e93ebefa","Type":"ContainerStarted","Data":"c095b012d03e069b28320257c2e0a951f89237765f96a7bdf5a9f5fecc268cd2"}
Sep 17 00:20:57.069452 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:57.069393    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" podStartSLOduration=2.561985499 podStartE2EDuration="7.069378384s" totalImagesPullingTime="4.507392885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:20:57.067438735 +0000 UTC m=+658.176214652" watchObservedRunningTime="2026-09-17 00:20:57.069378384 +0000 UTC m=+658.178154299"
Sep 17 00:20:57.230659 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:57.230629    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:57.234737 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:57.234715    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:58.051185 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:58.051152    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:20:58.052119 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:20:58.052101    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:21:05.901204 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:05.901169    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pg2sb"]
Sep 17 00:21:05.904669 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:05.904653    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:05.907196 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:05.907168    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 17 00:21:05.907327 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:05.907181    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kqb42\""
Sep 17 00:21:05.913518 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:05.913492    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pg2sb"]
Sep 17 00:21:05.998804 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:05.998774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pg2sb"]
Sep 17 00:21:06.006712 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.006681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73904511-1663-4e14-9097-56bf6b0a97c3-config-file\") pod \"limitador-limitador-8588749977-pg2sb\" (UID: \"73904511-1663-4e14-9097-56bf6b0a97c3\") " pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:06.006832 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.006716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6qdf\" (UniqueName: \"kubernetes.io/projected/73904511-1663-4e14-9097-56bf6b0a97c3-kube-api-access-m6qdf\") pod \"limitador-limitador-8588749977-pg2sb\" (UID: \"73904511-1663-4e14-9097-56bf6b0a97c3\") " pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:06.107863 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.107832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6qdf\" (UniqueName: \"kubernetes.io/projected/73904511-1663-4e14-9097-56bf6b0a97c3-kube-api-access-m6qdf\") pod \"limitador-limitador-8588749977-pg2sb\" (UID: \"73904511-1663-4e14-9097-56bf6b0a97c3\") " pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:06.108050 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.107926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73904511-1663-4e14-9097-56bf6b0a97c3-config-file\") pod \"limitador-limitador-8588749977-pg2sb\" (UID: \"73904511-1663-4e14-9097-56bf6b0a97c3\") " pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:06.108483 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.108464    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73904511-1663-4e14-9097-56bf6b0a97c3-config-file\") pod \"limitador-limitador-8588749977-pg2sb\" (UID: \"73904511-1663-4e14-9097-56bf6b0a97c3\") " pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:06.115979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.115958    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6qdf\" (UniqueName: \"kubernetes.io/projected/73904511-1663-4e14-9097-56bf6b0a97c3-kube-api-access-m6qdf\") pod \"limitador-limitador-8588749977-pg2sb\" (UID: \"73904511-1663-4e14-9097-56bf6b0a97c3\") " pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:06.215855 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.215786    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:06.483397 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.483370    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pg2sb"]
Sep 17 00:21:06.485777 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:21:06.485748    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73904511_1663_4e14_9097_56bf6b0a97c3.slice/crio-302ffdc0c6248bf4412f90f70f976f78c0be02870e2a224dcd11d0927c87115a WatchSource:0}: Error finding container 302ffdc0c6248bf4412f90f70f976f78c0be02870e2a224dcd11d0927c87115a: Status 404 returned error can't find the container with id 302ffdc0c6248bf4412f90f70f976f78c0be02870e2a224dcd11d0927c87115a
Sep 17 00:21:06.685678 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.685639    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-h8898"]
Sep 17 00:21:06.690052 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.690032    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898"
Sep 17 00:21:06.692754 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.692720    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-sqxq8\""
Sep 17 00:21:06.694490 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.694462    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-h8898"]
Sep 17 00:21:06.810738 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.810677    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-8vxrm"]
Sep 17 00:21:06.813536 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.813511    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfwdf\" (UniqueName: \"kubernetes.io/projected/47fe645b-ca90-4cd5-9ba3-c01a4431e9b8-kube-api-access-sfwdf\") pod \"authorino-7bcfd8f9cd-h8898\" (UID: \"47fe645b-ca90-4cd5-9ba3-c01a4431e9b8\") " pod="kuadrant-system/authorino-7bcfd8f9cd-h8898"
Sep 17 00:21:06.814057 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.814042    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-8vxrm"
Sep 17 00:21:06.818057 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.818034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8vxrm"]
Sep 17 00:21:06.914162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.914137    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfwdf\" (UniqueName: \"kubernetes.io/projected/47fe645b-ca90-4cd5-9ba3-c01a4431e9b8-kube-api-access-sfwdf\") pod \"authorino-7bcfd8f9cd-h8898\" (UID: \"47fe645b-ca90-4cd5-9ba3-c01a4431e9b8\") " pod="kuadrant-system/authorino-7bcfd8f9cd-h8898"
Sep 17 00:21:06.914556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.914190    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd9ts\" (UniqueName: \"kubernetes.io/projected/12c8289a-41e4-439f-b405-fab8c5e1b237-kube-api-access-nd9ts\") pod \"authorino-59c974bd48-8vxrm\" (UID: \"12c8289a-41e4-439f-b405-fab8c5e1b237\") " pod="kuadrant-system/authorino-59c974bd48-8vxrm"
Sep 17 00:21:06.921935 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:06.921913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfwdf\" (UniqueName: \"kubernetes.io/projected/47fe645b-ca90-4cd5-9ba3-c01a4431e9b8-kube-api-access-sfwdf\") pod \"authorino-7bcfd8f9cd-h8898\" (UID: \"47fe645b-ca90-4cd5-9ba3-c01a4431e9b8\") " pod="kuadrant-system/authorino-7bcfd8f9cd-h8898"
Sep 17 00:21:07.000137 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:07.000108    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898"
Sep 17 00:21:07.015350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:07.015324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd9ts\" (UniqueName: \"kubernetes.io/projected/12c8289a-41e4-439f-b405-fab8c5e1b237-kube-api-access-nd9ts\") pod \"authorino-59c974bd48-8vxrm\" (UID: \"12c8289a-41e4-439f-b405-fab8c5e1b237\") " pod="kuadrant-system/authorino-59c974bd48-8vxrm"
Sep 17 00:21:07.022962 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:07.022931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd9ts\" (UniqueName: \"kubernetes.io/projected/12c8289a-41e4-439f-b405-fab8c5e1b237-kube-api-access-nd9ts\") pod \"authorino-59c974bd48-8vxrm\" (UID: \"12c8289a-41e4-439f-b405-fab8c5e1b237\") " pod="kuadrant-system/authorino-59c974bd48-8vxrm"
Sep 17 00:21:07.095234 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:07.095199    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb" event={"ID":"73904511-1663-4e14-9097-56bf6b0a97c3","Type":"ContainerStarted","Data":"302ffdc0c6248bf4412f90f70f976f78c0be02870e2a224dcd11d0927c87115a"}
Sep 17 00:21:07.123557 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:07.123524    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-8vxrm"
Sep 17 00:21:07.264610 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:07.264584    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-h8898"]
Sep 17 00:21:07.266472 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:21:07.266445    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod47fe645b_ca90_4cd5_9ba3_c01a4431e9b8.slice/crio-00c87ad2d2addccddb7068a25b24b4dd92b6f93db4b242f60d231a354876f40b WatchSource:0}: Error finding container 00c87ad2d2addccddb7068a25b24b4dd92b6f93db4b242f60d231a354876f40b: Status 404 returned error can't find the container with id 00c87ad2d2addccddb7068a25b24b4dd92b6f93db4b242f60d231a354876f40b
Sep 17 00:21:07.390033 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:07.390009    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8vxrm"]
Sep 17 00:21:07.390475 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:21:07.390451    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12c8289a_41e4_439f_b405_fab8c5e1b237.slice/crio-1e6103847c3e612009451c381e7fdfe1bf7eeefe644283738572987728dd09d1 WatchSource:0}: Error finding container 1e6103847c3e612009451c381e7fdfe1bf7eeefe644283738572987728dd09d1: Status 404 returned error can't find the container with id 1e6103847c3e612009451c381e7fdfe1bf7eeefe644283738572987728dd09d1
Sep 17 00:21:08.102754 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:08.102720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898" event={"ID":"47fe645b-ca90-4cd5-9ba3-c01a4431e9b8","Type":"ContainerStarted","Data":"00c87ad2d2addccddb7068a25b24b4dd92b6f93db4b242f60d231a354876f40b"}
Sep 17 00:21:08.104482 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:08.104447    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-8vxrm" event={"ID":"12c8289a-41e4-439f-b405-fab8c5e1b237","Type":"ContainerStarted","Data":"1e6103847c3e612009451c381e7fdfe1bf7eeefe644283738572987728dd09d1"}
Sep 17 00:21:09.114725 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:09.114678    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb" event={"ID":"73904511-1663-4e14-9097-56bf6b0a97c3","Type":"ContainerStarted","Data":"7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031"}
Sep 17 00:21:09.115222 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:09.114775    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:09.133878 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:09.133806    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb" podStartSLOduration=2.10322526 podStartE2EDuration="4.133786126s" totalImagesPullingTime="2.030560866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:21:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:21:09.131449393 +0000 UTC m=+670.240225308" watchObservedRunningTime="2026-09-17 00:21:09.133786126 +0000 UTC m=+670.242562044"
Sep 17 00:21:10.120737 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:10.120699    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898" event={"ID":"47fe645b-ca90-4cd5-9ba3-c01a4431e9b8","Type":"ContainerStarted","Data":"259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a"}
Sep 17 00:21:10.122163 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:10.122135    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-8vxrm" event={"ID":"12c8289a-41e4-439f-b405-fab8c5e1b237","Type":"ContainerStarted","Data":"7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df"}
Sep 17 00:21:10.135823 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:10.135774    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898" podStartSLOduration=1.7169910929999999 podStartE2EDuration="4.135760203s" totalImagesPullingTime="2.41876911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:21:10.134642489 +0000 UTC m=+671.243418404" watchObservedRunningTime="2026-09-17 00:21:10.135760203 +0000 UTC m=+671.244536096"
Sep 17 00:21:10.147318 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:10.147266    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-8vxrm" podStartSLOduration=2.222469265 podStartE2EDuration="4.147248826s" totalImagesPullingTime="1.924779561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:21:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:21:10.146993229 +0000 UTC m=+671.255769145" watchObservedRunningTime="2026-09-17 00:21:10.147248826 +0000 UTC m=+671.256024743"
Sep 17 00:21:10.168467 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:10.168444    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-h8898"]
Sep 17 00:21:12.131215 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:12.131180    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898" podUID="47fe645b-ca90-4cd5-9ba3-c01a4431e9b8" containerName="authorino" containerID="cri-o://259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a" gracePeriod=30
Sep 17 00:21:12.375505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:12.375481    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898"
Sep 17 00:21:12.465078 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:12.464998    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfwdf\" (UniqueName: \"kubernetes.io/projected/47fe645b-ca90-4cd5-9ba3-c01a4431e9b8-kube-api-access-sfwdf\") pod \"47fe645b-ca90-4cd5-9ba3-c01a4431e9b8\" (UID: \"47fe645b-ca90-4cd5-9ba3-c01a4431e9b8\") "
Sep 17 00:21:12.467098 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:12.467074    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47fe645b-ca90-4cd5-9ba3-c01a4431e9b8-kube-api-access-sfwdf" (OuterVolumeSpecName: "kube-api-access-sfwdf") pod "47fe645b-ca90-4cd5-9ba3-c01a4431e9b8" (UID: "47fe645b-ca90-4cd5-9ba3-c01a4431e9b8"). InnerVolumeSpecName "kube-api-access-sfwdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:21:12.566404 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:12.566374    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfwdf\" (UniqueName: \"kubernetes.io/projected/47fe645b-ca90-4cd5-9ba3-c01a4431e9b8-kube-api-access-sfwdf\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:21:13.137211 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.137179    2565 generic.go:356] "Generic (PLEG): container finished" podID="47fe645b-ca90-4cd5-9ba3-c01a4431e9b8" containerID="259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a" exitCode=0
Sep 17 00:21:13.137629 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.137223    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898"
Sep 17 00:21:13.137629 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.137265    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898" event={"ID":"47fe645b-ca90-4cd5-9ba3-c01a4431e9b8","Type":"ContainerDied","Data":"259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a"}
Sep 17 00:21:13.137629 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.137302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-h8898" event={"ID":"47fe645b-ca90-4cd5-9ba3-c01a4431e9b8","Type":"ContainerDied","Data":"00c87ad2d2addccddb7068a25b24b4dd92b6f93db4b242f60d231a354876f40b"}
Sep 17 00:21:13.137629 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.137320    2565 scope.go:117] "RemoveContainer" containerID="259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a"
Sep 17 00:21:13.145755 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.145739    2565 scope.go:117] "RemoveContainer" containerID="259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a"
Sep 17 00:21:13.146058 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:21:13.146037    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a\": container with ID starting with 259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a not found: ID does not exist" containerID="259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a"
Sep 17 00:21:13.146137 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.146065    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a"} err="failed to get container status \"259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a\": rpc error: code = NotFound desc = could not find container \"259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a\": container with ID starting with 259c6958b5d76dde9f547434785f2a48181e73ea1903d695e705c996a9cbf82a not found: ID does not exist"
Sep 17 00:21:13.157548 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.157527    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-h8898"]
Sep 17 00:21:13.161347 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.161328    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-h8898"]
Sep 17 00:21:13.389524 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:13.389452    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47fe645b-ca90-4cd5-9ba3-c01a4431e9b8" path="/var/lib/kubelet/pods/47fe645b-ca90-4cd5-9ba3-c01a4431e9b8/volumes"
Sep 17 00:21:20.123487 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:20.123458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:21.498875 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:21.498840    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pg2sb"]
Sep 17 00:21:21.499315 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:21.499041    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb" podUID="73904511-1663-4e14-9097-56bf6b0a97c3" containerName="limitador" containerID="cri-o://7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031" gracePeriod=30
Sep 17 00:21:22.048231 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.048207    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:22.143615 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.143590    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73904511-1663-4e14-9097-56bf6b0a97c3-config-file\") pod \"73904511-1663-4e14-9097-56bf6b0a97c3\" (UID: \"73904511-1663-4e14-9097-56bf6b0a97c3\") "
Sep 17 00:21:22.143778 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.143701    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6qdf\" (UniqueName: \"kubernetes.io/projected/73904511-1663-4e14-9097-56bf6b0a97c3-kube-api-access-m6qdf\") pod \"73904511-1663-4e14-9097-56bf6b0a97c3\" (UID: \"73904511-1663-4e14-9097-56bf6b0a97c3\") "
Sep 17 00:21:22.143963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.143941    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73904511-1663-4e14-9097-56bf6b0a97c3-config-file" (OuterVolumeSpecName: "config-file") pod "73904511-1663-4e14-9097-56bf6b0a97c3" (UID: "73904511-1663-4e14-9097-56bf6b0a97c3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:21:22.145660 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.145640    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73904511-1663-4e14-9097-56bf6b0a97c3-kube-api-access-m6qdf" (OuterVolumeSpecName: "kube-api-access-m6qdf") pod "73904511-1663-4e14-9097-56bf6b0a97c3" (UID: "73904511-1663-4e14-9097-56bf6b0a97c3"). InnerVolumeSpecName "kube-api-access-m6qdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:21:22.183571 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.183541    2565 generic.go:356] "Generic (PLEG): container finished" podID="73904511-1663-4e14-9097-56bf6b0a97c3" containerID="7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031" exitCode=0
Sep 17 00:21:22.183690 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.183583    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb"
Sep 17 00:21:22.183690 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.183581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb" event={"ID":"73904511-1663-4e14-9097-56bf6b0a97c3","Type":"ContainerDied","Data":"7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031"}
Sep 17 00:21:22.183774 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.183692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-pg2sb" event={"ID":"73904511-1663-4e14-9097-56bf6b0a97c3","Type":"ContainerDied","Data":"302ffdc0c6248bf4412f90f70f976f78c0be02870e2a224dcd11d0927c87115a"}
Sep 17 00:21:22.183774 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.183720    2565 scope.go:117] "RemoveContainer" containerID="7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031"
Sep 17 00:21:22.192244 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.192226    2565 scope.go:117] "RemoveContainer" containerID="7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031"
Sep 17 00:21:22.192507 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:21:22.192489    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031\": container with ID starting with 7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031 not found: ID does not exist" containerID="7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031"
Sep 17 00:21:22.192558 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.192516    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031"} err="failed to get container status \"7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031\": rpc error: code = NotFound desc = could not find container \"7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031\": container with ID starting with 7d03f06b9ff6c6c52e0c3ca9f976258dda455b014b842366ec710e4e9b7ed031 not found: ID does not exist"
Sep 17 00:21:22.204503 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.204480    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pg2sb"]
Sep 17 00:21:22.207535 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.207502    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-pg2sb"]
Sep 17 00:21:22.245044 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.245024    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6qdf\" (UniqueName: \"kubernetes.io/projected/73904511-1663-4e14-9097-56bf6b0a97c3-kube-api-access-m6qdf\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:21:22.245120 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:22.245046    2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/73904511-1663-4e14-9097-56bf6b0a97c3-config-file\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:21:23.390965 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:23.390929    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73904511-1663-4e14-9097-56bf6b0a97c3" path="/var/lib/kubelet/pods/73904511-1663-4e14-9097-56bf6b0a97c3/volumes"
Sep 17 00:21:24.877855 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.877826    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"]
Sep 17 00:21:24.878362 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.878343    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73904511-1663-4e14-9097-56bf6b0a97c3" containerName="limitador"
Sep 17 00:21:24.878443 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.878365    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="73904511-1663-4e14-9097-56bf6b0a97c3" containerName="limitador"
Sep 17 00:21:24.878443 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.878380    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47fe645b-ca90-4cd5-9ba3-c01a4431e9b8" containerName="authorino"
Sep 17 00:21:24.878443 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.878387    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="47fe645b-ca90-4cd5-9ba3-c01a4431e9b8" containerName="authorino"
Sep 17 00:21:24.878591 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.878503    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="73904511-1663-4e14-9097-56bf6b0a97c3" containerName="limitador"
Sep 17 00:21:24.878591 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.878513    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="47fe645b-ca90-4cd5-9ba3-c01a4431e9b8" containerName="authorino"
Sep 17 00:21:24.881402 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.881384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:24.884109 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.884086    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 17 00:21:24.884224 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.884096    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 17 00:21:24.884224 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.884126    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 17 00:21:24.885294 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.885275    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-ch6ds\""
Sep 17 00:21:24.888054 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.888030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"]
Sep 17 00:21:24.967682 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.967657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/99a52ec6-8c0a-4313-8fa3-ad1959e045c8-data\") pod \"postgres-69fb4594cf-xvf4r\" (UID: \"99a52ec6-8c0a-4313-8fa3-ad1959e045c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:24.967841 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:24.967721    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstvr\" (UniqueName: \"kubernetes.io/projected/99a52ec6-8c0a-4313-8fa3-ad1959e045c8-kube-api-access-fstvr\") pod \"postgres-69fb4594cf-xvf4r\" (UID: \"99a52ec6-8c0a-4313-8fa3-ad1959e045c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:25.069108 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:25.069072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstvr\" (UniqueName: \"kubernetes.io/projected/99a52ec6-8c0a-4313-8fa3-ad1959e045c8-kube-api-access-fstvr\") pod \"postgres-69fb4594cf-xvf4r\" (UID: \"99a52ec6-8c0a-4313-8fa3-ad1959e045c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:25.069273 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:25.069122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/99a52ec6-8c0a-4313-8fa3-ad1959e045c8-data\") pod \"postgres-69fb4594cf-xvf4r\" (UID: \"99a52ec6-8c0a-4313-8fa3-ad1959e045c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:25.069443 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:25.069424    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/99a52ec6-8c0a-4313-8fa3-ad1959e045c8-data\") pod \"postgres-69fb4594cf-xvf4r\" (UID: \"99a52ec6-8c0a-4313-8fa3-ad1959e045c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:25.077076 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:25.077049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstvr\" (UniqueName: \"kubernetes.io/projected/99a52ec6-8c0a-4313-8fa3-ad1959e045c8-kube-api-access-fstvr\") pod \"postgres-69fb4594cf-xvf4r\" (UID: \"99a52ec6-8c0a-4313-8fa3-ad1959e045c8\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:25.193726 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:25.193663    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:25.467655 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:25.467582    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"]
Sep 17 00:21:25.470509 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:21:25.470475    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a52ec6_8c0a_4313_8fa3_ad1959e045c8.slice/crio-cea371757528c5e74f2fb61830e3e2b106f6421eccd15dea94756dbd5fdfaece WatchSource:0}: Error finding container cea371757528c5e74f2fb61830e3e2b106f6421eccd15dea94756dbd5fdfaece: Status 404 returned error can't find the container with id cea371757528c5e74f2fb61830e3e2b106f6421eccd15dea94756dbd5fdfaece
Sep 17 00:21:26.203614 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:26.203577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r" event={"ID":"99a52ec6-8c0a-4313-8fa3-ad1959e045c8","Type":"ContainerStarted","Data":"cea371757528c5e74f2fb61830e3e2b106f6421eccd15dea94756dbd5fdfaece"}
Sep 17 00:21:31.231801 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:31.231775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r" event={"ID":"99a52ec6-8c0a-4313-8fa3-ad1959e045c8","Type":"ContainerStarted","Data":"d583f081bf4d2b3d7929347da5daadd9585288def57f625ce44c8db76a805cc5"}
Sep 17 00:21:31.232126 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:31.231864    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:31.247508 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:31.247464    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r" podStartSLOduration=1.590909409 podStartE2EDuration="7.247450443s" totalImagesPullingTime="5.656541034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:21:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:21:31.24571476 +0000 UTC m=+692.354490687" watchObservedRunningTime="2026-09-17 00:21:31.247450443 +0000 UTC m=+692.356226358"
Sep 17 00:21:37.264597 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.264568    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xvf4r"
Sep 17 00:21:37.790241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.790210    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-bqk92"]
Sep 17 00:21:37.792496 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.792477    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bqk92"
Sep 17 00:21:37.799816 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.799791    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-bqk92"]
Sep 17 00:21:37.890951 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.890916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpcxj\" (UniqueName: \"kubernetes.io/projected/53259732-110b-48c5-93db-506405324f45-kube-api-access-gpcxj\") pod \"authorino-557f876f69-bqk92\" (UID: \"53259732-110b-48c5-93db-506405324f45\") " pod="kuadrant-system/authorino-557f876f69-bqk92"
Sep 17 00:21:37.916175 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.916146    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-bqk92"]
Sep 17 00:21:37.916382 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:21:37.916362    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-gpcxj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-bqk92" podUID="53259732-110b-48c5-93db-506405324f45"
Sep 17 00:21:37.945382 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.945356    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-rrzlr"]
Sep 17 00:21:37.947603 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.947589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:37.949942 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.949925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 17 00:21:37.955145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.955127    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-rrzlr"]
Sep 17 00:21:37.992275 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.992250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpcxj\" (UniqueName: \"kubernetes.io/projected/53259732-110b-48c5-93db-506405324f45-kube-api-access-gpcxj\") pod \"authorino-557f876f69-bqk92\" (UID: \"53259732-110b-48c5-93db-506405324f45\") " pod="kuadrant-system/authorino-557f876f69-bqk92"
Sep 17 00:21:38.000002 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:37.999972    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpcxj\" (UniqueName: \"kubernetes.io/projected/53259732-110b-48c5-93db-506405324f45-kube-api-access-gpcxj\") pod \"authorino-557f876f69-bqk92\" (UID: \"53259732-110b-48c5-93db-506405324f45\") " pod="kuadrant-system/authorino-557f876f69-bqk92"
Sep 17 00:21:38.023196 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.020394    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-rrzlr"]
Sep 17 00:21:38.023196 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:21:38.021022    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-vw5w6 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-vw5w6 tls-cert]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-rrzlr" podUID="b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08"
Sep 17 00:21:38.046707 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.046647    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7865f494bd-9d8m8"]
Sep 17 00:21:38.048985 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.048970    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:21:38.056242 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.056218    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7865f494bd-9d8m8"]
Sep 17 00:21:38.093261 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.093235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-tls-cert\") pod \"authorino-6d4dfc649f-rrzlr\" (UID: \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\") " pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:38.093344 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.093271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw5w6\" (UniqueName: \"kubernetes.io/projected/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-kube-api-access-vw5w6\") pod \"authorino-6d4dfc649f-rrzlr\" (UID: \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\") " pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:38.194189 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.194162    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-tls-cert\") pod \"authorino-6d4dfc649f-rrzlr\" (UID: \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\") " pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:38.194292 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.194192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw5w6\" (UniqueName: \"kubernetes.io/projected/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-kube-api-access-vw5w6\") pod \"authorino-6d4dfc649f-rrzlr\" (UID: \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\") " pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:38.194292 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.194245    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44e33f36-4ff8-45a0-83b7-704075bff4a8-tls-cert\") pod \"authorino-7865f494bd-9d8m8\" (UID: \"44e33f36-4ff8-45a0-83b7-704075bff4a8\") " pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:21:38.194292 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.194268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzfhf\" (UniqueName: \"kubernetes.io/projected/44e33f36-4ff8-45a0-83b7-704075bff4a8-kube-api-access-mzfhf\") pod \"authorino-7865f494bd-9d8m8\" (UID: \"44e33f36-4ff8-45a0-83b7-704075bff4a8\") " pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:21:38.196504 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.196478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-tls-cert\") pod \"authorino-6d4dfc649f-rrzlr\" (UID: \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\") " pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:38.201516 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.201491    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw5w6\" (UniqueName: \"kubernetes.io/projected/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-kube-api-access-vw5w6\") pod \"authorino-6d4dfc649f-rrzlr\" (UID: \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\") " pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:38.267826 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.267806    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:38.268109 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.267825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bqk92"
Sep 17 00:21:38.274643 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.274626    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:38.276864 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.276848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bqk92"
Sep 17 00:21:38.294769 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.294743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44e33f36-4ff8-45a0-83b7-704075bff4a8-tls-cert\") pod \"authorino-7865f494bd-9d8m8\" (UID: \"44e33f36-4ff8-45a0-83b7-704075bff4a8\") " pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:21:38.294868 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.294790    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzfhf\" (UniqueName: \"kubernetes.io/projected/44e33f36-4ff8-45a0-83b7-704075bff4a8-kube-api-access-mzfhf\") pod \"authorino-7865f494bd-9d8m8\" (UID: \"44e33f36-4ff8-45a0-83b7-704075bff4a8\") " pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:21:38.297010 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.296966    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44e33f36-4ff8-45a0-83b7-704075bff4a8-tls-cert\") pod \"authorino-7865f494bd-9d8m8\" (UID: \"44e33f36-4ff8-45a0-83b7-704075bff4a8\") " pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:21:38.301715 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.301699    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzfhf\" (UniqueName: \"kubernetes.io/projected/44e33f36-4ff8-45a0-83b7-704075bff4a8-kube-api-access-mzfhf\") pod \"authorino-7865f494bd-9d8m8\" (UID: \"44e33f36-4ff8-45a0-83b7-704075bff4a8\") " pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:21:38.358911 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.358873    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:21:38.395919 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.395866    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-tls-cert\") pod \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\" (UID: \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\") "
Sep 17 00:21:38.396071 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.395933    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpcxj\" (UniqueName: \"kubernetes.io/projected/53259732-110b-48c5-93db-506405324f45-kube-api-access-gpcxj\") pod \"53259732-110b-48c5-93db-506405324f45\" (UID: \"53259732-110b-48c5-93db-506405324f45\") "
Sep 17 00:21:38.396071 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.395990    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw5w6\" (UniqueName: \"kubernetes.io/projected/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-kube-api-access-vw5w6\") pod \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\" (UID: \"b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08\") "
Sep 17 00:21:38.398339 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.398305    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08" (UID: "b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:21:38.398445 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.398383    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53259732-110b-48c5-93db-506405324f45-kube-api-access-gpcxj" (OuterVolumeSpecName: "kube-api-access-gpcxj") pod "53259732-110b-48c5-93db-506405324f45" (UID: "53259732-110b-48c5-93db-506405324f45"). InnerVolumeSpecName "kube-api-access-gpcxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:21:38.398445 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.398434    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-kube-api-access-vw5w6" (OuterVolumeSpecName: "kube-api-access-vw5w6") pod "b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08" (UID: "b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08"). InnerVolumeSpecName "kube-api-access-vw5w6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:21:38.496683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.496651    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw5w6\" (UniqueName: \"kubernetes.io/projected/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-kube-api-access-vw5w6\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:21:38.496683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.496678    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08-tls-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:21:38.496683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.496688    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpcxj\" (UniqueName: \"kubernetes.io/projected/53259732-110b-48c5-93db-506405324f45-kube-api-access-gpcxj\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:21:38.628193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:38.628157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7865f494bd-9d8m8"]
Sep 17 00:21:38.630412 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:21:38.630389    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44e33f36_4ff8_45a0_83b7_704075bff4a8.slice/crio-4c202ed3c3f17773c6dc12cff82bdbb795a3b2b14e1473dd32781de2d9a9d24c WatchSource:0}: Error finding container 4c202ed3c3f17773c6dc12cff82bdbb795a3b2b14e1473dd32781de2d9a9d24c: Status 404 returned error can't find the container with id 4c202ed3c3f17773c6dc12cff82bdbb795a3b2b14e1473dd32781de2d9a9d24c
Sep 17 00:21:39.274293 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.274201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7865f494bd-9d8m8" event={"ID":"44e33f36-4ff8-45a0-83b7-704075bff4a8","Type":"ContainerStarted","Data":"2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27"}
Sep 17 00:21:39.274293 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.274229    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-rrzlr"
Sep 17 00:21:39.274293 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.274247    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7865f494bd-9d8m8" event={"ID":"44e33f36-4ff8-45a0-83b7-704075bff4a8","Type":"ContainerStarted","Data":"4c202ed3c3f17773c6dc12cff82bdbb795a3b2b14e1473dd32781de2d9a9d24c"}
Sep 17 00:21:39.274704 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.274389    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-bqk92"
Sep 17 00:21:39.291275 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.291237    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7865f494bd-9d8m8" podStartSLOduration=0.912676157 podStartE2EDuration="1.291223163s" totalImagesPullingTime="378.547006ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:21:39.289361695 +0000 UTC m=+700.398137609" watchObservedRunningTime="2026-09-17 00:21:39.291223163 +0000 UTC m=+700.399999078"
Sep 17 00:21:39.310022 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.309996    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-bqk92"]
Sep 17 00:21:39.317059 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.317038    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-bqk92"]
Sep 17 00:21:39.319457 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.319435    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8vxrm"]
Sep 17 00:21:39.319632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.319609    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-8vxrm" podUID="12c8289a-41e4-439f-b405-fab8c5e1b237" containerName="authorino" containerID="cri-o://7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df" gracePeriod=30
Sep 17 00:21:39.339796 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.339772    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-rrzlr"]
Sep 17 00:21:39.344882 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.344853    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-rrzlr"]
Sep 17 00:21:39.388728 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.388696    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53259732-110b-48c5-93db-506405324f45" path="/var/lib/kubelet/pods/53259732-110b-48c5-93db-506405324f45/volumes"
Sep 17 00:21:39.389021 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.389007    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08" path="/var/lib/kubelet/pods/b2ef41dc-bb9f-49c5-89b6-5e6ab1c52a08/volumes"
Sep 17 00:21:39.559209 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.559179    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-8vxrm"
Sep 17 00:21:39.706698 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.706669    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nd9ts\" (UniqueName: \"kubernetes.io/projected/12c8289a-41e4-439f-b405-fab8c5e1b237-kube-api-access-nd9ts\") pod \"12c8289a-41e4-439f-b405-fab8c5e1b237\" (UID: \"12c8289a-41e4-439f-b405-fab8c5e1b237\") "
Sep 17 00:21:39.708596 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.708566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12c8289a-41e4-439f-b405-fab8c5e1b237-kube-api-access-nd9ts" (OuterVolumeSpecName: "kube-api-access-nd9ts") pod "12c8289a-41e4-439f-b405-fab8c5e1b237" (UID: "12c8289a-41e4-439f-b405-fab8c5e1b237"). InnerVolumeSpecName "kube-api-access-nd9ts". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:21:39.807406 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:39.807330    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nd9ts\" (UniqueName: \"kubernetes.io/projected/12c8289a-41e4-439f-b405-fab8c5e1b237-kube-api-access-nd9ts\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:21:40.280485 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:40.280450    2565 generic.go:356] "Generic (PLEG): container finished" podID="12c8289a-41e4-439f-b405-fab8c5e1b237" containerID="7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df" exitCode=0
Sep 17 00:21:40.280485 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:40.280486    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-8vxrm"
Sep 17 00:21:40.280994 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:40.280527    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-8vxrm" event={"ID":"12c8289a-41e4-439f-b405-fab8c5e1b237","Type":"ContainerDied","Data":"7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df"}
Sep 17 00:21:40.280994 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:40.280565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-8vxrm" event={"ID":"12c8289a-41e4-439f-b405-fab8c5e1b237","Type":"ContainerDied","Data":"1e6103847c3e612009451c381e7fdfe1bf7eeefe644283738572987728dd09d1"}
Sep 17 00:21:40.280994 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:40.280583    2565 scope.go:117] "RemoveContainer" containerID="7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df"
Sep 17 00:21:40.289265 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:40.289246    2565 scope.go:117] "RemoveContainer" containerID="7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df"
Sep 17 00:21:40.289549 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:21:40.289530    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df\": container with ID starting with 7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df not found: ID does not exist" containerID="7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df"
Sep 17 00:21:40.289613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:40.289561    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df"} err="failed to get container status \"7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df\": rpc error: code = NotFound desc = could not find container \"7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df\": container with ID starting with 7fe1b02ae5c560f62bcbe10ca92dbe0e941659a83785f9a3141b1032e82f85df not found: ID does not exist"
Sep 17 00:21:40.300590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:40.300552    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8vxrm"]
Sep 17 00:21:40.302412 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:40.302394    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-8vxrm"]
Sep 17 00:21:41.388560 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:41.388516    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12c8289a-41e4-439f-b405-fab8c5e1b237" path="/var/lib/kubelet/pods/12c8289a-41e4-439f-b405-fab8c5e1b237/volumes"
Sep 17 00:21:44.085828 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.085793    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-669bd445f5-h8hg8"]
Sep 17 00:21:44.086206 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.086174    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12c8289a-41e4-439f-b405-fab8c5e1b237" containerName="authorino"
Sep 17 00:21:44.086206 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.086186    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12c8289a-41e4-439f-b405-fab8c5e1b237" containerName="authorino"
Sep 17 00:21:44.086279 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.086254    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="12c8289a-41e4-439f-b405-fab8c5e1b237" containerName="authorino"
Sep 17 00:21:44.089092 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.089069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.091805 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.091784    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 00:21:44.091938 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.091873    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 00:21:44.091938 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.091877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qbf9b\""
Sep 17 00:21:44.091938 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.091929    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 00:21:44.102704 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.102685    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669bd445f5-h8hg8"]
Sep 17 00:21:44.245142 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.245109    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-webhook-cert\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.245305 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.245157    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbxrq\" (UniqueName: \"kubernetes.io/projected/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-kube-api-access-kbxrq\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.245305 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.245218    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-metrics-certs\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.245662 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.245646    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-lsmrz"]
Sep 17 00:21:44.248127 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.248111    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.258378 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.258356    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-lsmrz"]
Sep 17 00:21:44.346269 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.346198    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-metrics-certs\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.346269 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.346241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xz4qr\" (UniqueName: \"kubernetes.io/projected/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-kube-api-access-xz4qr\") pod \"maas-controller-6f5bf55f6d-lsmrz\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") " pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.346458 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.346311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-webhook-cert\") pod \"maas-controller-6f5bf55f6d-lsmrz\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") " pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.346458 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.346338    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-webhook-cert\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.346458 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:21:44.346346    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-metrics-tls: secret "maas-controller-metrics-tls" not found
Sep 17 00:21:44.346458 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.346398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-metrics-certs\") pod \"maas-controller-6f5bf55f6d-lsmrz\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") " pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.346458 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:21:44.346406    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-metrics-certs podName:9a80a823-b69b-4ae3-82d8-b0766fd6cc1b nodeName:}" failed. No retries permitted until 2026-09-17 00:21:44.846386785 +0000 UTC m=+705.955162696 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-metrics-certs") pod "maas-controller-669bd445f5-h8hg8" (UID: "9a80a823-b69b-4ae3-82d8-b0766fd6cc1b") : secret "maas-controller-metrics-tls" not found
Sep 17 00:21:44.346641 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:21:44.346470    2565 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Sep 17 00:21:44.346641 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:21:44.346536    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-webhook-cert podName:9a80a823-b69b-4ae3-82d8-b0766fd6cc1b nodeName:}" failed. No retries permitted until 2026-09-17 00:21:44.846512299 +0000 UTC m=+705.955288196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-webhook-cert") pod "maas-controller-669bd445f5-h8hg8" (UID: "9a80a823-b69b-4ae3-82d8-b0766fd6cc1b") : secret "maas-controller-webhook-cert" not found
Sep 17 00:21:44.346641 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.346584    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbxrq\" (UniqueName: \"kubernetes.io/projected/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-kube-api-access-kbxrq\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.357662 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.357638    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbxrq\" (UniqueName: \"kubernetes.io/projected/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-kube-api-access-kbxrq\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.447157 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.447130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-webhook-cert\") pod \"maas-controller-6f5bf55f6d-lsmrz\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") " pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.447300 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.447171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-metrics-certs\") pod \"maas-controller-6f5bf55f6d-lsmrz\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") " pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.447369 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.447326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xz4qr\" (UniqueName: \"kubernetes.io/projected/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-kube-api-access-xz4qr\") pod \"maas-controller-6f5bf55f6d-lsmrz\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") " pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.449567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.449547    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-webhook-cert\") pod \"maas-controller-6f5bf55f6d-lsmrz\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") " pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.449668 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.449596    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-metrics-certs\") pod \"maas-controller-6f5bf55f6d-lsmrz\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") " pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.454581 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.454563    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xz4qr\" (UniqueName: \"kubernetes.io/projected/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-kube-api-access-xz4qr\") pod \"maas-controller-6f5bf55f6d-lsmrz\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") " pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.558964 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.558937    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:44.825603 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.825579    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-lsmrz"]
Sep 17 00:21:44.827482 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:21:44.827454    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3748d0c5_6c5f_4e49_8103_1cb1a8523d4c.slice/crio-82bda84179940959a06db8bcb4c138bc81ec9863881357fe3e2e67402c86812f WatchSource:0}: Error finding container 82bda84179940959a06db8bcb4c138bc81ec9863881357fe3e2e67402c86812f: Status 404 returned error can't find the container with id 82bda84179940959a06db8bcb4c138bc81ec9863881357fe3e2e67402c86812f
Sep 17 00:21:44.851468 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.851446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-metrics-certs\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.851564 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.851528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-webhook-cert\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.853757 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.853711    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-metrics-certs\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.853819 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.853760    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-webhook-cert\") pod \"maas-controller-669bd445f5-h8hg8\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") " pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:44.999096 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:44.999069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:45.267385 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:45.267358    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669bd445f5-h8hg8"]
Sep 17 00:21:45.269590 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:21:45.269566    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a80a823_b69b_4ae3_82d8_b0766fd6cc1b.slice/crio-345e92b7a6e150c6246743ee0d5de7591e1d18acb174b395127918428a98d6b3 WatchSource:0}: Error finding container 345e92b7a6e150c6246743ee0d5de7591e1d18acb174b395127918428a98d6b3: Status 404 returned error can't find the container with id 345e92b7a6e150c6246743ee0d5de7591e1d18acb174b395127918428a98d6b3
Sep 17 00:21:45.302932 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:45.302904    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz" event={"ID":"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c","Type":"ContainerStarted","Data":"82bda84179940959a06db8bcb4c138bc81ec9863881357fe3e2e67402c86812f"}
Sep 17 00:21:45.304011 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:45.303988    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669bd445f5-h8hg8" event={"ID":"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b","Type":"ContainerStarted","Data":"345e92b7a6e150c6246743ee0d5de7591e1d18acb174b395127918428a98d6b3"}
Sep 17 00:21:48.323990 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:48.323953    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz" event={"ID":"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c","Type":"ContainerStarted","Data":"f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5"}
Sep 17 00:21:48.324461 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:48.324051    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:48.325489 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:48.325465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669bd445f5-h8hg8" event={"ID":"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b","Type":"ContainerStarted","Data":"732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b"}
Sep 17 00:21:48.325604 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:48.325591    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:48.343347 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:48.343300    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz" podStartSLOduration=1.68990421 podStartE2EDuration="4.343286867s" totalImagesPullingTime="2.653382657s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:21:48.342466231 +0000 UTC m=+709.451242168" watchObservedRunningTime="2026-09-17 00:21:48.343286867 +0000 UTC m=+709.452062784"
Sep 17 00:21:48.359060 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:48.359008    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-669bd445f5-h8hg8" podStartSLOduration=2.137572928 podStartE2EDuration="4.358989427s" totalImagesPullingTime="2.221416499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:21:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:21:48.358175044 +0000 UTC m=+709.466950959" watchObservedRunningTime="2026-09-17 00:21:48.358989427 +0000 UTC m=+709.467765343"
Sep 17 00:21:59.332559 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.332469    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:21:59.333212 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.332715    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:59.391668 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.391636    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669bd445f5-h8hg8"]
Sep 17 00:21:59.391869 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.391844    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-669bd445f5-h8hg8" podUID="9a80a823-b69b-4ae3-82d8-b0766fd6cc1b" containerName="manager" containerID="cri-o://732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b" gracePeriod=30
Sep 17 00:21:59.647365 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.647334    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:21:59.678709 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.678681    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbxrq\" (UniqueName: \"kubernetes.io/projected/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-kube-api-access-kbxrq\") pod \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") "
Sep 17 00:21:59.678823 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.678716    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-metrics-certs\") pod \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") "
Sep 17 00:21:59.678823 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.678743    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-webhook-cert\") pod \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\" (UID: \"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b\") "
Sep 17 00:21:59.680831 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.680802    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9a80a823-b69b-4ae3-82d8-b0766fd6cc1b" (UID: "9a80a823-b69b-4ae3-82d8-b0766fd6cc1b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:21:59.680990 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.680974    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9a80a823-b69b-4ae3-82d8-b0766fd6cc1b" (UID: "9a80a823-b69b-4ae3-82d8-b0766fd6cc1b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:21:59.681261 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.681234    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-kube-api-access-kbxrq" (OuterVolumeSpecName: "kube-api-access-kbxrq") pod "9a80a823-b69b-4ae3-82d8-b0766fd6cc1b" (UID: "9a80a823-b69b-4ae3-82d8-b0766fd6cc1b"). InnerVolumeSpecName "kube-api-access-kbxrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:21:59.780041 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.780013    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbxrq\" (UniqueName: \"kubernetes.io/projected/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-kube-api-access-kbxrq\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:21:59.780041 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.780038    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-metrics-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:21:59.780180 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:21:59.780047    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b-webhook-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:22:00.384043 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:00.384003    2565 generic.go:356] "Generic (PLEG): container finished" podID="9a80a823-b69b-4ae3-82d8-b0766fd6cc1b" containerID="732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b" exitCode=0
Sep 17 00:22:00.384430 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:00.384052    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669bd445f5-h8hg8"
Sep 17 00:22:00.384430 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:00.384089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669bd445f5-h8hg8" event={"ID":"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b","Type":"ContainerDied","Data":"732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b"}
Sep 17 00:22:00.384430 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:00.384146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669bd445f5-h8hg8" event={"ID":"9a80a823-b69b-4ae3-82d8-b0766fd6cc1b","Type":"ContainerDied","Data":"345e92b7a6e150c6246743ee0d5de7591e1d18acb174b395127918428a98d6b3"}
Sep 17 00:22:00.384430 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:00.384172    2565 scope.go:117] "RemoveContainer" containerID="732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b"
Sep 17 00:22:00.393008 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:00.392987    2565 scope.go:117] "RemoveContainer" containerID="732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b"
Sep 17 00:22:00.393268 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:22:00.393248    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b\": container with ID starting with 732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b not found: ID does not exist" containerID="732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b"
Sep 17 00:22:00.393333 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:00.393280    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b"} err="failed to get container status \"732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b\": rpc error: code = NotFound desc = could not find container \"732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b\": container with ID starting with 732de93983406541be600e857fc1f75d7fc60eff2484c04dc2320445b561525b not found: ID does not exist"
Sep 17 00:22:00.404500 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:00.404472    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669bd445f5-h8hg8"]
Sep 17 00:22:00.408244 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:00.408224    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-669bd445f5-h8hg8"]
Sep 17 00:22:01.389595 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:01.389559    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a80a823-b69b-4ae3-82d8-b0766fd6cc1b" path="/var/lib/kubelet/pods/9a80a823-b69b-4ae3-82d8-b0766fd6cc1b/volumes"
Sep 17 00:22:21.313543 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.313508    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"]
Sep 17 00:22:21.313925 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.313881    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a80a823-b69b-4ae3-82d8-b0766fd6cc1b" containerName="manager"
Sep 17 00:22:21.313925 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.313892    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a80a823-b69b-4ae3-82d8-b0766fd6cc1b" containerName="manager"
Sep 17 00:22:21.314003 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.313987    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a80a823-b69b-4ae3-82d8-b0766fd6cc1b" containerName="manager"
Sep 17 00:22:21.326338 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.326312    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"]
Sep 17 00:22:21.326459 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.326412    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:21.329582 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.329558    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 17 00:22:21.329720 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.329558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-kljzn\""
Sep 17 00:22:21.462645 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.462599    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d509778-e992-481b-8d0f-a7f012c044d8-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-xg9bn\" (UID: \"7d509778-e992-481b-8d0f-a7f012c044d8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:21.462826 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.462678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmj5\" (UniqueName: \"kubernetes.io/projected/7d509778-e992-481b-8d0f-a7f012c044d8-kube-api-access-rhmj5\") pod \"payload-pre-processing-59fbc47bf8-xg9bn\" (UID: \"7d509778-e992-481b-8d0f-a7f012c044d8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:21.563469 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.563423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmj5\" (UniqueName: \"kubernetes.io/projected/7d509778-e992-481b-8d0f-a7f012c044d8-kube-api-access-rhmj5\") pod \"payload-pre-processing-59fbc47bf8-xg9bn\" (UID: \"7d509778-e992-481b-8d0f-a7f012c044d8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:21.563649 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.563582    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d509778-e992-481b-8d0f-a7f012c044d8-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-xg9bn\" (UID: \"7d509778-e992-481b-8d0f-a7f012c044d8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:21.564553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.564523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7d509778-e992-481b-8d0f-a7f012c044d8-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-xg9bn\" (UID: \"7d509778-e992-481b-8d0f-a7f012c044d8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:21.575753 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.575725    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmj5\" (UniqueName: \"kubernetes.io/projected/7d509778-e992-481b-8d0f-a7f012c044d8-kube-api-access-rhmj5\") pod \"payload-pre-processing-59fbc47bf8-xg9bn\" (UID: \"7d509778-e992-481b-8d0f-a7f012c044d8\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:21.637038 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.637001    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:21.940924 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.940885    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"]
Sep 17 00:22:21.943144 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:22:21.943098    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d509778_e992_481b_8d0f_a7f012c044d8.slice/crio-2ae70d741c4f0e37241e89d61e0049c5546bd373d71514a13f1513ab84714cc4 WatchSource:0}: Error finding container 2ae70d741c4f0e37241e89d61e0049c5546bd373d71514a13f1513ab84714cc4: Status 404 returned error can't find the container with id 2ae70d741c4f0e37241e89d61e0049c5546bd373d71514a13f1513ab84714cc4
Sep 17 00:22:21.945992 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:21.945973    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:22:22.489034 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:22.488998    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn" event={"ID":"7d509778-e992-481b-8d0f-a7f012c044d8","Type":"ContainerStarted","Data":"2ae70d741c4f0e37241e89d61e0049c5546bd373d71514a13f1513ab84714cc4"}
Sep 17 00:22:23.496116 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:23.496076    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn" event={"ID":"7d509778-e992-481b-8d0f-a7f012c044d8","Type":"ContainerStarted","Data":"39019d0b41f716f20f7d7fed96b51d74c87778ff79bb2e72da48b70dac47dd3a"}
Sep 17 00:22:23.496522 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:23.496220    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:23.512537 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:23.512488    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn" podStartSLOduration=1.139593551 podStartE2EDuration="2.5124741s" totalImagesPullingTime="1.372880549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:22:23.510629665 +0000 UTC m=+744.619405593" watchObservedRunningTime="2026-09-17 00:22:23.5124741 +0000 UTC m=+744.621250031"
Sep 17 00:22:29.092066 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:29.092024    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pr7x5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 00:22:29.092441 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:29.092097    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" podUID="16626e4d-960e-4f28-a622-96a0e93ebefa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 00:22:30.532225 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:30.532131    2565 generic.go:356] "Generic (PLEG): container finished" podID="16626e4d-960e-4f28-a622-96a0e93ebefa" containerID="c095b012d03e069b28320257c2e0a951f89237765f96a7bdf5a9f5fecc268cd2" exitCode=0
Sep 17 00:22:30.532710 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:30.532213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" event={"ID":"16626e4d-960e-4f28-a622-96a0e93ebefa","Type":"ContainerDied","Data":"c095b012d03e069b28320257c2e0a951f89237765f96a7bdf5a9f5fecc268cd2"}
Sep 17 00:22:30.532710 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:30.532567    2565 scope.go:117] "RemoveContainer" containerID="c095b012d03e069b28320257c2e0a951f89237765f96a7bdf5a9f5fecc268cd2"
Sep 17 00:22:30.533517 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:30.533488    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:22:30.533606 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:30.533549    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:22:30.533606 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:30.533581    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:22:31.538775 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:31.538741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" event={"ID":"16626e4d-960e-4f28-a622-96a0e93ebefa","Type":"ContainerStarted","Data":"69ee4ef5dde1238465bceb58a6d67b38aedaf8c86d0623a6d7f09310c18ba0a5"}
Sep 17 00:22:32.230131 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:32.230095    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:22:32.230371 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:32.230347    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pr7x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Sep 17 00:22:32.230415 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:32.230397    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" podUID="16626e4d-960e-4f28-a622-96a0e93ebefa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Sep 17 00:22:33.230956 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:33.230920    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pr7x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Sep 17 00:22:33.231336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:33.230984    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" podUID="16626e4d-960e-4f28-a622-96a0e93ebefa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Sep 17 00:22:34.230710 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:34.230680    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pr7x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Sep 17 00:22:34.230877 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:34.230734    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" podUID="16626e4d-960e-4f28-a622-96a0e93ebefa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Sep 17 00:22:34.504289 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:34.504215    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-xg9bn"
Sep 17 00:22:35.230388 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:35.230358    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pr7x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Sep 17 00:22:35.230553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:35.230410    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" podUID="16626e4d-960e-4f28-a622-96a0e93ebefa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Sep 17 00:22:36.230026 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:36.229989    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-pr7x5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body=
Sep 17 00:22:36.230399 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:36.230044    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5" podUID="16626e4d-960e-4f28-a622-96a0e93ebefa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused"
Sep 17 00:22:37.106843 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.106812    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"]
Sep 17 00:22:37.109241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.109221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.111873 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.111846    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 17 00:22:37.112081 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.112060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.112177 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.112158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.112266 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.112181    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69b5b0d0-2703-443d-8370-95ab9cd77c3c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.112266 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.112203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zbsc\" (UniqueName: \"kubernetes.io/projected/69b5b0d0-2703-443d-8370-95ab9cd77c3c-kube-api-access-5zbsc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.112266 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.112221    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.112369 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.112269    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.113137 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.113114    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 17 00:22:37.113293 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.113273    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jfhbm\""
Sep 17 00:22:37.113400 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.113296    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 17 00:22:37.118607 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.118580    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"]
Sep 17 00:22:37.213414 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.213386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.213558 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.213420    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69b5b0d0-2703-443d-8370-95ab9cd77c3c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.213558 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.213440    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zbsc\" (UniqueName: \"kubernetes.io/projected/69b5b0d0-2703-443d-8370-95ab9cd77c3c-kube-api-access-5zbsc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.213558 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.213459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.213558 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.213503    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.213558 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.213519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.213850 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.213806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.213850 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.213842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.213973 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.213888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.215691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.215670    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69b5b0d0-2703-443d-8370-95ab9cd77c3c-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.216015 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.215998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69b5b0d0-2703-443d-8370-95ab9cd77c3c-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.221887 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.221865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zbsc\" (UniqueName: \"kubernetes.io/projected/69b5b0d0-2703-443d-8370-95ab9cd77c3c-kube-api-access-5zbsc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb\" (UID: \"69b5b0d0-2703-443d-8370-95ab9cd77c3c\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.233079 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.233059    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:22:37.233371 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.233299    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:22:37.234071 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.234054    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-pr7x5"
Sep 17 00:22:37.421129 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.421052    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:37.691859 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:37.691838    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"]
Sep 17 00:22:37.694714 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:22:37.694680    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b5b0d0_2703_443d_8370_95ab9cd77c3c.slice/crio-2aaa584b8de7c77c79d908326c544a659b0d01e0dc5c770464eb2e04159b1b3c WatchSource:0}: Error finding container 2aaa584b8de7c77c79d908326c544a659b0d01e0dc5c770464eb2e04159b1b3c: Status 404 returned error can't find the container with id 2aaa584b8de7c77c79d908326c544a659b0d01e0dc5c770464eb2e04159b1b3c
Sep 17 00:22:38.593946 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:38.593881    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb" event={"ID":"69b5b0d0-2703-443d-8370-95ab9cd77c3c","Type":"ContainerStarted","Data":"2aaa584b8de7c77c79d908326c544a659b0d01e0dc5c770464eb2e04159b1b3c"}
Sep 17 00:22:39.599465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:39.599433    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb" event={"ID":"69b5b0d0-2703-443d-8370-95ab9cd77c3c","Type":"ContainerStarted","Data":"4f3c04ce21bd282e00e6023d51ae4e7b99ed0cd046acddc1f3b2346ed04a5e58"}
Sep 17 00:22:39.617812 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:39.617766    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb" podStartSLOduration=1.457598192 podStartE2EDuration="2.617752313s" totalImagesPullingTime="1.160154121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:22:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:22:39.615821841 +0000 UTC m=+760.724597758" watchObservedRunningTime="2026-09-17 00:22:39.617752313 +0000 UTC m=+760.726528240"
Sep 17 00:22:47.421138 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:47.421100    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:47.421571 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:47.421163    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:47.434315 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:47.434290    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:22:47.649473 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:22:47.649446    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb"
Sep 17 00:23:11.391189 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.391153    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"]
Sep 17 00:23:11.396557 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.396534    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"]
Sep 17 00:23:11.396721 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.396660    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.399348 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.399325    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 17 00:23:11.501563 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.501536    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.501708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.501571    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.501708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.501603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.501708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.501650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv676\" (UniqueName: \"kubernetes.io/projected/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-kube-api-access-dv676\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.501708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.501700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.501854 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.501742    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.603151 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.603118    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.603337 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.603182    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.603337 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.603215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.603337 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.603260    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.603337 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.603286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv676\" (UniqueName: \"kubernetes.io/projected/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-kube-api-access-dv676\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.603337 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.603330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.603803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.603774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.604274 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.604252    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.604371 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.604269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.605525 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.605507    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.606303 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.606277    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.611383 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.611364    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv676\" (UniqueName: \"kubernetes.io/projected/8c772b8d-8bdd-4ba6-8ae8-583c18c37fca-kube-api-access-dv676\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-248zw\" (UID: \"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.710676 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.710620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:11.978885 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:11.978863    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"]
Sep 17 00:23:11.980852 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:23:11.980825    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c772b8d_8bdd_4ba6_8ae8_583c18c37fca.slice/crio-3a259737cc23034c25b997229f4dfd5982d1b1862c560817a5e4222ddeeddb1c WatchSource:0}: Error finding container 3a259737cc23034c25b997229f4dfd5982d1b1862c560817a5e4222ddeeddb1c: Status 404 returned error can't find the container with id 3a259737cc23034c25b997229f4dfd5982d1b1862c560817a5e4222ddeeddb1c
Sep 17 00:23:12.756803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:12.756754    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw" event={"ID":"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca","Type":"ContainerStarted","Data":"9078ed9fa8724297b45c0cdddfa8098bbc69043ab9f67fc2ca08c532afdb94b2"}
Sep 17 00:23:12.757427 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:12.756859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw" event={"ID":"8c772b8d-8bdd-4ba6-8ae8-583c18c37fca","Type":"ContainerStarted","Data":"3a259737cc23034c25b997229f4dfd5982d1b1862c560817a5e4222ddeeddb1c"}
Sep 17 00:23:12.775524 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:12.775463    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw" podStartSLOduration=1.596021449 podStartE2EDuration="1.775440277s" totalImagesPullingTime="179.418828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:23:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:23:12.773527936 +0000 UTC m=+793.882303852" watchObservedRunningTime="2026-09-17 00:23:12.775440277 +0000 UTC m=+793.884216193"
Sep 17 00:23:21.711143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:21.711109    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:21.711547 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:21.711160    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:21.723810 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:21.723780    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:21.812280 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:21.812259    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-248zw"
Sep 17 00:23:32.604780 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.604740    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"]
Sep 17 00:23:32.608772 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.608753    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.611424 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.611402    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 17 00:23:32.617330 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.617306    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"]
Sep 17 00:23:32.683700 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.683667    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzbj4\" (UniqueName: \"kubernetes.io/projected/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-kube-api-access-lzbj4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.683843 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.683709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.683843 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.683770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.683944 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.683888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.683981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.683946    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.683981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.683970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.785301 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.785270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.785435 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.785337    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.785435 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.785367    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.785547 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.785452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.785605 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.785545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzbj4\" (UniqueName: \"kubernetes.io/projected/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-kube-api-access-lzbj4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.785605 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.785574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.785775 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.785745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.785924 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.785774    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.785924 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.785823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.788122 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.788085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.788328 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.788313    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.793313 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.793291    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzbj4\" (UniqueName: \"kubernetes.io/projected/f6237ae3-5ae6-450f-9b23-d7852ff1f3ee-kube-api-access-lzbj4\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7\" (UID: \"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:32.920937 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:32.920847    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:33.192374 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:33.192114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"]
Sep 17 00:23:33.194517 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:23:33.194496    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6237ae3_5ae6_450f_9b23_d7852ff1f3ee.slice/crio-8b8ad673bfe13094f1276976a5dce2e3173c0ff4cad709dde9fda7afe504b75e WatchSource:0}: Error finding container 8b8ad673bfe13094f1276976a5dce2e3173c0ff4cad709dde9fda7afe504b75e: Status 404 returned error can't find the container with id 8b8ad673bfe13094f1276976a5dce2e3173c0ff4cad709dde9fda7afe504b75e
Sep 17 00:23:33.860416 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:33.860381    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7" event={"ID":"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee","Type":"ContainerStarted","Data":"ce18dfa44171111f7cf0a9c4e9e2097ab0df0200888c36f7b5f7131533e1c692"}
Sep 17 00:23:33.860778 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:33.860435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7" event={"ID":"f6237ae3-5ae6-450f-9b23-d7852ff1f3ee","Type":"ContainerStarted","Data":"8b8ad673bfe13094f1276976a5dce2e3173c0ff4cad709dde9fda7afe504b75e"}
Sep 17 00:23:33.876610 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:33.876557    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7" podStartSLOduration=1.678053748 podStartE2EDuration="1.87653983s" totalImagesPullingTime="198.486082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:23:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:23:33.875479822 +0000 UTC m=+814.984255737" watchObservedRunningTime="2026-09-17 00:23:33.87653983 +0000 UTC m=+814.985315747"
Sep 17 00:23:42.921972 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:42.921930    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:42.922349 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:42.922016    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:42.934702 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:42.934679    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:23:43.924325 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:23:43.924296    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7"
Sep 17 00:24:59.356253 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:24:59.356171    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:24:59.358663 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:24:59.358643    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:25:20.055678 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.055645    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cddc7d965-k8z6c"]
Sep 17 00:25:20.059111 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.059093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cddc7d965-k8z6c"
Sep 17 00:25:20.065922 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.065881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cddc7d965-k8z6c"]
Sep 17 00:25:20.085729 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.085705    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czdj7\" (UniqueName: \"kubernetes.io/projected/c65268d6-5d64-482a-9d96-3acfec75ed81-kube-api-access-czdj7\") pod \"authorino-5cddc7d965-k8z6c\" (UID: \"c65268d6-5d64-482a-9d96-3acfec75ed81\") " pod="kuadrant-system/authorino-5cddc7d965-k8z6c"
Sep 17 00:25:20.085952 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.085786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c65268d6-5d64-482a-9d96-3acfec75ed81-tls-cert\") pod \"authorino-5cddc7d965-k8z6c\" (UID: \"c65268d6-5d64-482a-9d96-3acfec75ed81\") " pod="kuadrant-system/authorino-5cddc7d965-k8z6c"
Sep 17 00:25:20.186628 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.186595    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czdj7\" (UniqueName: \"kubernetes.io/projected/c65268d6-5d64-482a-9d96-3acfec75ed81-kube-api-access-czdj7\") pod \"authorino-5cddc7d965-k8z6c\" (UID: \"c65268d6-5d64-482a-9d96-3acfec75ed81\") " pod="kuadrant-system/authorino-5cddc7d965-k8z6c"
Sep 17 00:25:20.186778 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.186676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c65268d6-5d64-482a-9d96-3acfec75ed81-tls-cert\") pod \"authorino-5cddc7d965-k8z6c\" (UID: \"c65268d6-5d64-482a-9d96-3acfec75ed81\") " pod="kuadrant-system/authorino-5cddc7d965-k8z6c"
Sep 17 00:25:20.189100 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.189079    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c65268d6-5d64-482a-9d96-3acfec75ed81-tls-cert\") pod \"authorino-5cddc7d965-k8z6c\" (UID: \"c65268d6-5d64-482a-9d96-3acfec75ed81\") " pod="kuadrant-system/authorino-5cddc7d965-k8z6c"
Sep 17 00:25:20.193934 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.193915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czdj7\" (UniqueName: \"kubernetes.io/projected/c65268d6-5d64-482a-9d96-3acfec75ed81-kube-api-access-czdj7\") pod \"authorino-5cddc7d965-k8z6c\" (UID: \"c65268d6-5d64-482a-9d96-3acfec75ed81\") " pod="kuadrant-system/authorino-5cddc7d965-k8z6c"
Sep 17 00:25:20.369227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.369193    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cddc7d965-k8z6c"
Sep 17 00:25:20.639743 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:20.639720    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cddc7d965-k8z6c"]
Sep 17 00:25:20.641886 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:25:20.641860    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc65268d6_5d64_482a_9d96_3acfec75ed81.slice/crio-7947861c76abcbe3d2a24dda93bf2ba44d661de17ad695484ca958818d429abb WatchSource:0}: Error finding container 7947861c76abcbe3d2a24dda93bf2ba44d661de17ad695484ca958818d429abb: Status 404 returned error can't find the container with id 7947861c76abcbe3d2a24dda93bf2ba44d661de17ad695484ca958818d429abb
Sep 17 00:25:21.394735 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:21.394702    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cddc7d965-k8z6c" event={"ID":"c65268d6-5d64-482a-9d96-3acfec75ed81","Type":"ContainerStarted","Data":"7947861c76abcbe3d2a24dda93bf2ba44d661de17ad695484ca958818d429abb"}
Sep 17 00:25:22.402027 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.401979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cddc7d965-k8z6c" event={"ID":"c65268d6-5d64-482a-9d96-3acfec75ed81","Type":"ContainerStarted","Data":"be8c8a7c8022811e971a1b83bb8a3bf247851382d16e2f406f9422f277588598"}
Sep 17 00:25:22.419640 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.419587    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cddc7d965-k8z6c" podStartSLOduration=1.6706449509999999 podStartE2EDuration="2.419570468s" totalImagesPullingTime="748.925517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:22.418689604 +0000 UTC m=+923.527465520" watchObservedRunningTime="2026-09-17 00:25:22.419570468 +0000 UTC m=+923.528346383"
Sep 17 00:25:22.448359 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.448325    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7865f494bd-9d8m8"]
Sep 17 00:25:22.448574 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.448542    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7865f494bd-9d8m8" podUID="44e33f36-4ff8-45a0-83b7-704075bff4a8" containerName="authorino" containerID="cri-o://2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27" gracePeriod=30
Sep 17 00:25:22.709196 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.709166    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:25:22.812280 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.812245    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44e33f36-4ff8-45a0-83b7-704075bff4a8-tls-cert\") pod \"44e33f36-4ff8-45a0-83b7-704075bff4a8\" (UID: \"44e33f36-4ff8-45a0-83b7-704075bff4a8\") "
Sep 17 00:25:22.812280 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.812287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzfhf\" (UniqueName: \"kubernetes.io/projected/44e33f36-4ff8-45a0-83b7-704075bff4a8-kube-api-access-mzfhf\") pod \"44e33f36-4ff8-45a0-83b7-704075bff4a8\" (UID: \"44e33f36-4ff8-45a0-83b7-704075bff4a8\") "
Sep 17 00:25:22.814402 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.814364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44e33f36-4ff8-45a0-83b7-704075bff4a8-kube-api-access-mzfhf" (OuterVolumeSpecName: "kube-api-access-mzfhf") pod "44e33f36-4ff8-45a0-83b7-704075bff4a8" (UID: "44e33f36-4ff8-45a0-83b7-704075bff4a8"). InnerVolumeSpecName "kube-api-access-mzfhf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:25:22.822979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.822940    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44e33f36-4ff8-45a0-83b7-704075bff4a8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "44e33f36-4ff8-45a0-83b7-704075bff4a8" (UID: "44e33f36-4ff8-45a0-83b7-704075bff4a8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:25:22.913859 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.913822    2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/44e33f36-4ff8-45a0-83b7-704075bff4a8-tls-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:25:22.913859 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:22.913861    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzfhf\" (UniqueName: \"kubernetes.io/projected/44e33f36-4ff8-45a0-83b7-704075bff4a8-kube-api-access-mzfhf\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:25:23.408154 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:23.408126    2565 generic.go:356] "Generic (PLEG): container finished" podID="44e33f36-4ff8-45a0-83b7-704075bff4a8" containerID="2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27" exitCode=0
Sep 17 00:25:23.408454 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:23.408172    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7865f494bd-9d8m8"
Sep 17 00:25:23.408454 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:23.408201    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7865f494bd-9d8m8" event={"ID":"44e33f36-4ff8-45a0-83b7-704075bff4a8","Type":"ContainerDied","Data":"2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27"}
Sep 17 00:25:23.408454 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:23.408239    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7865f494bd-9d8m8" event={"ID":"44e33f36-4ff8-45a0-83b7-704075bff4a8","Type":"ContainerDied","Data":"4c202ed3c3f17773c6dc12cff82bdbb795a3b2b14e1473dd32781de2d9a9d24c"}
Sep 17 00:25:23.408454 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:23.408254    2565 scope.go:117] "RemoveContainer" containerID="2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27"
Sep 17 00:25:23.423497 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:23.423476    2565 scope.go:117] "RemoveContainer" containerID="2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27"
Sep 17 00:25:23.423789 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:25:23.423762    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27\": container with ID starting with 2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27 not found: ID does not exist" containerID="2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27"
Sep 17 00:25:23.423866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:23.423798    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27"} err="failed to get container status \"2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27\": rpc error: code = NotFound desc = could not find container \"2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27\": container with ID starting with 2d011642309fb8a875f15388b9033f1cb46319859c27e6740ee8dd29140d6f27 not found: ID does not exist"
Sep 17 00:25:23.427683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:23.427661    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7865f494bd-9d8m8"]
Sep 17 00:25:23.431098 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:23.431076    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7865f494bd-9d8m8"]
Sep 17 00:25:25.389242 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:25.389205    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44e33f36-4ff8-45a0-83b7-704075bff4a8" path="/var/lib/kubelet/pods/44e33f36-4ff8-45a0-83b7-704075bff4a8/volumes"
Sep 17 00:25:43.088068 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.088034    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"]
Sep 17 00:25:43.088508 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.088457    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44e33f36-4ff8-45a0-83b7-704075bff4a8" containerName="authorino"
Sep 17 00:25:43.088508 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.088469    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="44e33f36-4ff8-45a0-83b7-704075bff4a8" containerName="authorino"
Sep 17 00:25:43.088582 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.088543    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="44e33f36-4ff8-45a0-83b7-704075bff4a8" containerName="authorino"
Sep 17 00:25:43.098335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.098304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.100964 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.100941    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-cfe049-openshift-default-dockercfg-s4rtp\""
Sep 17 00:25:43.107848 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.107823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"]
Sep 17 00:25:43.192915 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.192864    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-data\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.193081 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.193004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-credential-socket\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.193081 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.193045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-certs\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.193081 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.193074    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-envoy\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.193217 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.193116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-podinfo\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.193266 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.193230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-socket\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.193318 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.193272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmmv\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-kube-api-access-drmmv\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.193373 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.193354    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52f37cd6-9067-4f28-96bd-19c0def3480b-istiod-ca-cert\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.193428 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.193417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-token\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.294676 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.294639    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52f37cd6-9067-4f28-96bd-19c0def3480b-istiod-ca-cert\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.294831 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.294683    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-token\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.294831 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.294735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-data\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.294831 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.294757    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-credential-socket\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.294831 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.294780    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-certs\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.294831 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.294805    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-envoy\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.295104 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.294841    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-podinfo\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.295104 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.294875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-socket\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.295104 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.294926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drmmv\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-kube-api-access-drmmv\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.295275 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.295174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-credential-socket\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.295275 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.295234    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-certs\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.295405 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.295384    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-socket\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.295513 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.295486    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52f37cd6-9067-4f28-96bd-19c0def3480b-istiod-ca-cert\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.295564 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.295516    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-data\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.297236 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.297209    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-envoy\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.297358 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.297336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-podinfo\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.304201 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.304175    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmmv\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-kube-api-access-drmmv\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.304358 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.304333    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-token\") pod \"e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") " pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.411975 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.411876    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:43.695250 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.695222    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"]
Sep 17 00:25:43.696920 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:25:43.696879    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52f37cd6_9067_4f28_96bd_19c0def3480b.slice/crio-96d34ae0b13ab315ba95c0658e574001eb53baeb701d3aa0670575239c6151aa WatchSource:0}: Error finding container 96d34ae0b13ab315ba95c0658e574001eb53baeb701d3aa0670575239c6151aa: Status 404 returned error can't find the container with id 96d34ae0b13ab315ba95c0658e574001eb53baeb701d3aa0670575239c6151aa
Sep 17 00:25:43.698800 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.698771    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:43.698861 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.698835    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:43.698946 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:43.698870    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:44.514726 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:44.514692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" event={"ID":"52f37cd6-9067-4f28-96bd-19c0def3480b","Type":"ContainerStarted","Data":"87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7"}
Sep 17 00:25:44.515134 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:44.514746    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" event={"ID":"52f37cd6-9067-4f28-96bd-19c0def3480b","Type":"ContainerStarted","Data":"96d34ae0b13ab315ba95c0658e574001eb53baeb701d3aa0670575239c6151aa"}
Sep 17 00:25:44.536967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:44.536919    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" podStartSLOduration=1.536885848 podStartE2EDuration="1.536885848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:44.535606022 +0000 UTC m=+945.644381937" watchObservedRunningTime="2026-09-17 00:25:44.536885848 +0000 UTC m=+945.645661763"
Sep 17 00:25:45.412354 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:45.412319    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:45.417307 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:45.417285    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:45.519374 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:45.519339    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:45.520330 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:45.520310    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:25:45.838938 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:45.838890    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7840-af4377"]
Sep 17 00:25:45.842544 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:45.842527    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7840-af4377"
Sep 17 00:25:45.845346 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:45.845304    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hf767\""
Sep 17 00:25:45.847759 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:45.847736    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7840-af4377"]
Sep 17 00:25:45.917441 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:45.917411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptstp\" (UniqueName: \"kubernetes.io/projected/167b1983-4051-4a00-9746-f6c59b7295ba-kube-api-access-ptstp\") pod \"test-curl-7840-af4377\" (UID: \"167b1983-4051-4a00-9746-f6c59b7295ba\") " pod="opendatahub/test-curl-7840-af4377"
Sep 17 00:25:46.018731 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:46.018702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptstp\" (UniqueName: \"kubernetes.io/projected/167b1983-4051-4a00-9746-f6c59b7295ba-kube-api-access-ptstp\") pod \"test-curl-7840-af4377\" (UID: \"167b1983-4051-4a00-9746-f6c59b7295ba\") " pod="opendatahub/test-curl-7840-af4377"
Sep 17 00:25:46.025968 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:46.025943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptstp\" (UniqueName: \"kubernetes.io/projected/167b1983-4051-4a00-9746-f6c59b7295ba-kube-api-access-ptstp\") pod \"test-curl-7840-af4377\" (UID: \"167b1983-4051-4a00-9746-f6c59b7295ba\") " pod="opendatahub/test-curl-7840-af4377"
Sep 17 00:25:46.154548 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:46.154479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7840-af4377"
Sep 17 00:25:46.430106 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:46.430082    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7840-af4377"]
Sep 17 00:25:46.431604 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:25:46.431572    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod167b1983_4051_4a00_9746_f6c59b7295ba.slice/crio-9281483c8f53d0fa5d207ed42c5a843a0bc10bc0a45ef75dfa1f716c25760ebe WatchSource:0}: Error finding container 9281483c8f53d0fa5d207ed42c5a843a0bc10bc0a45ef75dfa1f716c25760ebe: Status 404 returned error can't find the container with id 9281483c8f53d0fa5d207ed42c5a843a0bc10bc0a45ef75dfa1f716c25760ebe
Sep 17 00:25:46.525436 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:46.525401    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7840-af4377" event={"ID":"167b1983-4051-4a00-9746-f6c59b7295ba","Type":"ContainerStarted","Data":"9281483c8f53d0fa5d207ed42c5a843a0bc10bc0a45ef75dfa1f716c25760ebe"}
Sep 17 00:25:49.404581 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.404545    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"]
Sep 17 00:25:49.408225 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.408208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:25:49.410629 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.410608    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-2faea3-dockercfg-6dfjg\""
Sep 17 00:25:49.410755 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.410645    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-2faea3\""
Sep 17 00:25:49.415377 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.415355    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"]
Sep 17 00:25:49.444455 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.444431    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"]
Sep 17 00:25:49.447958 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.447942    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:25:49.455809 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.455784    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"]
Sep 17 00:25:49.544834 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.544791    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7840-af4377" event={"ID":"167b1983-4051-4a00-9746-f6c59b7295ba","Type":"ContainerStarted","Data":"e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af"}
Sep 17 00:25:49.553700 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.553665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdvcn\" (UniqueName: \"kubernetes.io/projected/99a9568f-1e43-46ed-8143-7872572f1617-kube-api-access-pdvcn\") pod \"payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb\" (UID: \"99a9568f-1e43-46ed-8143-7872572f1617\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:25:49.553861 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.553719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d251dd-857c-4c32-9437-461f13dd2c96-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b\" (UID: \"d8d251dd-857c-4c32-9437-461f13dd2c96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:25:49.553861 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.553808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgn79\" (UniqueName: \"kubernetes.io/projected/d8d251dd-857c-4c32-9437-461f13dd2c96-kube-api-access-hgn79\") pod \"payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b\" (UID: \"d8d251dd-857c-4c32-9437-461f13dd2c96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:25:49.554038 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.553880    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a9568f-1e43-46ed-8143-7872572f1617-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb\" (UID: \"99a9568f-1e43-46ed-8143-7872572f1617\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:25:49.559300 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.559256    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7840-af4377" podStartSLOduration=1.969477485 podStartE2EDuration="4.559240631s" totalImagesPullingTime="2.589763146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:49.557834858 +0000 UTC m=+950.666610774" watchObservedRunningTime="2026-09-17 00:25:49.559240631 +0000 UTC m=+950.668016819"
Sep 17 00:25:49.655217 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.655122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a9568f-1e43-46ed-8143-7872572f1617-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb\" (UID: \"99a9568f-1e43-46ed-8143-7872572f1617\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:25:49.655375 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.655261    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdvcn\" (UniqueName: \"kubernetes.io/projected/99a9568f-1e43-46ed-8143-7872572f1617-kube-api-access-pdvcn\") pod \"payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb\" (UID: \"99a9568f-1e43-46ed-8143-7872572f1617\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:25:49.655375 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.655303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d251dd-857c-4c32-9437-461f13dd2c96-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b\" (UID: \"d8d251dd-857c-4c32-9437-461f13dd2c96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:25:49.655375 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.655347    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgn79\" (UniqueName: \"kubernetes.io/projected/d8d251dd-857c-4c32-9437-461f13dd2c96-kube-api-access-hgn79\") pod \"payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b\" (UID: \"d8d251dd-857c-4c32-9437-461f13dd2c96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:25:49.655926 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.655886    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a9568f-1e43-46ed-8143-7872572f1617-plugins-config-volume\") pod \"payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb\" (UID: \"99a9568f-1e43-46ed-8143-7872572f1617\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:25:49.656016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.655995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d251dd-857c-4c32-9437-461f13dd2c96-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b\" (UID: \"d8d251dd-857c-4c32-9437-461f13dd2c96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:25:49.663005 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.662976    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgn79\" (UniqueName: \"kubernetes.io/projected/d8d251dd-857c-4c32-9437-461f13dd2c96-kube-api-access-hgn79\") pod \"payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b\" (UID: \"d8d251dd-857c-4c32-9437-461f13dd2c96\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:25:49.663142 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.663122    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdvcn\" (UniqueName: \"kubernetes.io/projected/99a9568f-1e43-46ed-8143-7872572f1617-kube-api-access-pdvcn\") pod \"payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb\" (UID: \"99a9568f-1e43-46ed-8143-7872572f1617\") " pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:25:49.720492 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.720460    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:25:49.758805 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.758767    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:25:49.998764 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:49.998739    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"]
Sep 17 00:25:50.000615 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:25:50.000587    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8d251dd_857c_4c32_9437_461f13dd2c96.slice/crio-cc311ae9ca1448e49814035cda51060e426485770a8f57317f6929a8f5d6ff64 WatchSource:0}: Error finding container cc311ae9ca1448e49814035cda51060e426485770a8f57317f6929a8f5d6ff64: Status 404 returned error can't find the container with id cc311ae9ca1448e49814035cda51060e426485770a8f57317f6929a8f5d6ff64
Sep 17 00:25:50.049936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.049910    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"]
Sep 17 00:25:50.052429 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:25:50.052401    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99a9568f_1e43_46ed_8143_7872572f1617.slice/crio-85ae383c6fd0e247a5631bf365ef56e816283946800e347c556713c6500e63b8 WatchSource:0}: Error finding container 85ae383c6fd0e247a5631bf365ef56e816283946800e347c556713c6500e63b8: Status 404 returned error can't find the container with id 85ae383c6fd0e247a5631bf365ef56e816283946800e347c556713c6500e63b8
Sep 17 00:25:50.501269 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.501231    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"]
Sep 17 00:25:50.505425 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.505405    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:25:50.508083 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.508049    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-cfe049\""
Sep 17 00:25:50.508083 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.508071    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-cfe049-dockercfg-7p7n4\""
Sep 17 00:25:50.513830 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.513807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"]
Sep 17 00:25:50.522723 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.522697    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7840-af4377"]
Sep 17 00:25:50.531233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.531208    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7840-af4377"]
Sep 17 00:25:50.535786 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.535754    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"]
Sep 17 00:25:50.536215 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.536198    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="167b1983-4051-4a00-9746-f6c59b7295ba" containerName="test-curl-7840-af4377"
Sep 17 00:25:50.536215 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.536214    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="167b1983-4051-4a00-9746-f6c59b7295ba" containerName="test-curl-7840-af4377"
Sep 17 00:25:50.536369 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.536307    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="167b1983-4051-4a00-9746-f6c59b7295ba" containerName="test-curl-7840-af4377"
Sep 17 00:25:50.539458 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.539439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:25:50.552835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.552810    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"]
Sep 17 00:25:50.556214 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.556184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b" event={"ID":"d8d251dd-857c-4c32-9437-461f13dd2c96","Type":"ContainerStarted","Data":"d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1"}
Sep 17 00:25:50.556330 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.556253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:25:50.556330 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.556289    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b" event={"ID":"d8d251dd-857c-4c32-9437-461f13dd2c96","Type":"ContainerStarted","Data":"cc311ae9ca1448e49814035cda51060e426485770a8f57317f6929a8f5d6ff64"}
Sep 17 00:25:50.558133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.558110    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb" event={"ID":"99a9568f-1e43-46ed-8143-7872572f1617","Type":"ContainerStarted","Data":"60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592"}
Sep 17 00:25:50.558252 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.558146    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb" event={"ID":"99a9568f-1e43-46ed-8143-7872572f1617","Type":"ContainerStarted","Data":"85ae383c6fd0e247a5631bf365ef56e816283946800e347c556713c6500e63b8"}
Sep 17 00:25:50.558252 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.558186    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:25:50.558364 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:25:50.558331    2565 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7840-af4377" container="test-curl-7840-af4377"
Sep 17 00:25:50.580602 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.580544    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb" podStartSLOduration=1.580526446 podStartE2EDuration="1.580526446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:50.580077741 +0000 UTC m=+951.688853687" watchObservedRunningTime="2026-09-17 00:25:50.580526446 +0000 UTC m=+951.689302364"
Sep 17 00:25:50.596559 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.596521    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b" podStartSLOduration=1.596508668 podStartE2EDuration="1.596508668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:50.595195698 +0000 UTC m=+951.703971613" watchObservedRunningTime="2026-09-17 00:25:50.596508668 +0000 UTC m=+951.705284583"
Sep 17 00:25:50.668233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.668197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2832458-5253-4ee7-be7d-7f5002605763-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7\" (UID: \"d2832458-5253-4ee7-be7d-7f5002605763\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:25:50.668381 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.668268    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlxth\" (UniqueName: \"kubernetes.io/projected/a57f8665-f960-4dc2-a74c-7157ca76ab04-kube-api-access-tlxth\") pod \"payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz\" (UID: \"a57f8665-f960-4dc2-a74c-7157ca76ab04\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:25:50.668381 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.668331    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74qt9\" (UniqueName: \"kubernetes.io/projected/d2832458-5253-4ee7-be7d-7f5002605763-kube-api-access-74qt9\") pod \"payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7\" (UID: \"d2832458-5253-4ee7-be7d-7f5002605763\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:25:50.668500 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.668400    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a57f8665-f960-4dc2-a74c-7157ca76ab04-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz\" (UID: \"a57f8665-f960-4dc2-a74c-7157ca76ab04\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:25:50.769445 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.769351    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74qt9\" (UniqueName: \"kubernetes.io/projected/d2832458-5253-4ee7-be7d-7f5002605763-kube-api-access-74qt9\") pod \"payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7\" (UID: \"d2832458-5253-4ee7-be7d-7f5002605763\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:25:50.769683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.769658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a57f8665-f960-4dc2-a74c-7157ca76ab04-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz\" (UID: \"a57f8665-f960-4dc2-a74c-7157ca76ab04\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:25:50.769835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.769815    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2832458-5253-4ee7-be7d-7f5002605763-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7\" (UID: \"d2832458-5253-4ee7-be7d-7f5002605763\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:25:50.769986 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.769853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlxth\" (UniqueName: \"kubernetes.io/projected/a57f8665-f960-4dc2-a74c-7157ca76ab04-kube-api-access-tlxth\") pod \"payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz\" (UID: \"a57f8665-f960-4dc2-a74c-7157ca76ab04\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:25:50.770499 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.770476    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a57f8665-f960-4dc2-a74c-7157ca76ab04-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz\" (UID: \"a57f8665-f960-4dc2-a74c-7157ca76ab04\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:25:50.770581 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.770510    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2832458-5253-4ee7-be7d-7f5002605763-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7\" (UID: \"d2832458-5253-4ee7-be7d-7f5002605763\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:25:50.778272 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.778241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlxth\" (UniqueName: \"kubernetes.io/projected/a57f8665-f960-4dc2-a74c-7157ca76ab04-kube-api-access-tlxth\") pod \"payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz\" (UID: \"a57f8665-f960-4dc2-a74c-7157ca76ab04\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:25:50.778442 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.778425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74qt9\" (UniqueName: \"kubernetes.io/projected/d2832458-5253-4ee7-be7d-7f5002605763-kube-api-access-74qt9\") pod \"payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7\" (UID: \"d2832458-5253-4ee7-be7d-7f5002605763\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:25:50.817749 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.817720    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:25:50.855207 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:50.855173    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:25:51.088720 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.088692    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"]
Sep 17 00:25:51.091022 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:25:51.090997    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2832458_5253_4ee7_be7d_7f5002605763.slice/crio-a954c3bd564af24d8d372812b19df4872f9097a60fecb911f86a2954cabc899d WatchSource:0}: Error finding container a954c3bd564af24d8d372812b19df4872f9097a60fecb911f86a2954cabc899d: Status 404 returned error can't find the container with id a954c3bd564af24d8d372812b19df4872f9097a60fecb911f86a2954cabc899d
Sep 17 00:25:51.146613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.146585    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"]
Sep 17 00:25:51.147827 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:25:51.147797    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57f8665_f960_4dc2_a74c_7157ca76ab04.slice/crio-716870b3a69bcb4a3901637bd3b875595d39ffbd46e47cf48232ccff0b805c82 WatchSource:0}: Error finding container 716870b3a69bcb4a3901637bd3b875595d39ffbd46e47cf48232ccff0b805c82: Status 404 returned error can't find the container with id 716870b3a69bcb4a3901637bd3b875595d39ffbd46e47cf48232ccff0b805c82
Sep 17 00:25:51.567268 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.567172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7" event={"ID":"d2832458-5253-4ee7-be7d-7f5002605763","Type":"ContainerStarted","Data":"e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803"}
Sep 17 00:25:51.567268 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.567241    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7" event={"ID":"d2832458-5253-4ee7-be7d-7f5002605763","Type":"ContainerStarted","Data":"a954c3bd564af24d8d372812b19df4872f9097a60fecb911f86a2954cabc899d"}
Sep 17 00:25:51.568084 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.568056    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:25:51.570056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.570026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz" event={"ID":"a57f8665-f960-4dc2-a74c-7157ca76ab04","Type":"ContainerStarted","Data":"2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0"}
Sep 17 00:25:51.570197 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.570080    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz" event={"ID":"a57f8665-f960-4dc2-a74c-7157ca76ab04","Type":"ContainerStarted","Data":"716870b3a69bcb4a3901637bd3b875595d39ffbd46e47cf48232ccff0b805c82"}
Sep 17 00:25:51.570271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.570205    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7840-af4377" podUID="167b1983-4051-4a00-9746-f6c59b7295ba" containerName="test-curl-7840-af4377" containerID="cri-o://e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af" gracePeriod=2
Sep 17 00:25:51.584254 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.584191    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7" podStartSLOduration=1.584175667 podStartE2EDuration="1.584175667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:51.582742208 +0000 UTC m=+952.691518125" watchObservedRunningTime="2026-09-17 00:25:51.584175667 +0000 UTC m=+952.692951610"
Sep 17 00:25:51.598636 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:51.598596    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz" podStartSLOduration=1.598582284 podStartE2EDuration="1.598582284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:51.596866509 +0000 UTC m=+952.705642420" watchObservedRunningTime="2026-09-17 00:25:51.598582284 +0000 UTC m=+952.707358198"
Sep 17 00:25:52.576389 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:52.576351    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:25:53.751528 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:53.751506    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7840-af4377"
Sep 17 00:25:53.904414 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:53.904336    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptstp\" (UniqueName: \"kubernetes.io/projected/167b1983-4051-4a00-9746-f6c59b7295ba-kube-api-access-ptstp\") pod \"167b1983-4051-4a00-9746-f6c59b7295ba\" (UID: \"167b1983-4051-4a00-9746-f6c59b7295ba\") "
Sep 17 00:25:53.906377 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:53.906342    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/167b1983-4051-4a00-9746-f6c59b7295ba-kube-api-access-ptstp" (OuterVolumeSpecName: "kube-api-access-ptstp") pod "167b1983-4051-4a00-9746-f6c59b7295ba" (UID: "167b1983-4051-4a00-9746-f6c59b7295ba"). InnerVolumeSpecName "kube-api-access-ptstp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:25:54.005892 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:54.005857    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptstp\" (UniqueName: \"kubernetes.io/projected/167b1983-4051-4a00-9746-f6c59b7295ba-kube-api-access-ptstp\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:25:54.589007 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:54.588971    2565 generic.go:356] "Generic (PLEG): container finished" podID="167b1983-4051-4a00-9746-f6c59b7295ba" containerID="e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af" exitCode=137
Sep 17 00:25:54.589189 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:54.589012    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7840-af4377"
Sep 17 00:25:54.589189 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:54.589027    2565 scope.go:117] "RemoveContainer" containerID="e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af"
Sep 17 00:25:54.604815 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:25:54.604773    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7840-af4377\" is forbidden: User \"system:node:ip-10-0-135-192.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-192.ec2.internal' and this object" podUID="167b1983-4051-4a00-9746-f6c59b7295ba" pod="opendatahub/test-curl-7840-af4377"
Sep 17 00:25:54.607658 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:54.607635    2565 scope.go:117] "RemoveContainer" containerID="e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af"
Sep 17 00:25:54.607997 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:25:54.607976    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af\": container with ID starting with e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af not found: ID does not exist" containerID="e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af"
Sep 17 00:25:54.608058 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:54.608003    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af"} err="failed to get container status \"e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af\": rpc error: code = NotFound desc = could not find container \"e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af\": container with ID starting with e50bbd697b869eecbeeb6ebd64d2cf4c39fda4a3f9e3fabc5a80a64c12f1b6af not found: ID does not exist"
Sep 17 00:25:55.390774 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:55.390743    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="167b1983-4051-4a00-9746-f6c59b7295ba" path="/var/lib/kubelet/pods/167b1983-4051-4a00-9746-f6c59b7295ba/volumes"
Sep 17 00:25:56.896376 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:56.896338    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"]
Sep 17 00:25:56.900301 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:56.900281    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:56.902829 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:56.902806    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-f492a5-openshift-default-dockercfg-hjv8j\""
Sep 17 00:25:56.910462 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:56.910439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"]
Sep 17 00:25:57.039632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.039593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istiod-ca-cert\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.039632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.039636    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-credential-socket\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.039853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.039660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-envoy\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.039853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.039684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-data\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.039853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.039731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-socket\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.039853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.039763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-certs\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.039853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.039796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-podinfo\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.039853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.039812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-968ct\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-kube-api-access-968ct\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.040083 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.039867    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-token\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.140996 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.140964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istiod-ca-cert\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141172 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-credential-socket\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141172 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141043    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-envoy\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141172 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-data\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141172 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-socket\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141232    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-certs\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141280    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-podinfo\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-968ct\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-kube-api-access-968ct\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141348    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-token\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141456    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-socket\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141512    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-data\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141543    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-credential-socket\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141847 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141724    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istiod-ca-cert\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.141961 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.141943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-certs\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.147964 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.143743    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-podinfo\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.161921 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.153546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-968ct\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-kube-api-access-968ct\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.161921 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.154046    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-token\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.171954 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.167261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-envoy\") pod \"e2e-autores-f492a5-openshift-default-c55496f6-h9dc2\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") " pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.213568 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.213536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:57.522548 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.522516    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"]
Sep 17 00:25:57.524292 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:25:57.524263    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeac0e0f_402b_4b04_beb0_46ecad1ff78e.slice/crio-a3d6e6c6803fab5cddca4ea3d167dc92d6457de7fb6682195690fe7f54955aee WatchSource:0}: Error finding container a3d6e6c6803fab5cddca4ea3d167dc92d6457de7fb6682195690fe7f54955aee: Status 404 returned error can't find the container with id a3d6e6c6803fab5cddca4ea3d167dc92d6457de7fb6682195690fe7f54955aee
Sep 17 00:25:57.526507 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.526476    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:57.526596 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.526539    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:57.526596 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.526568    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:25:57.608966 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:57.608942    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" event={"ID":"beac0e0f-402b-4b04-beb0-46ecad1ff78e","Type":"ContainerStarted","Data":"a3d6e6c6803fab5cddca4ea3d167dc92d6457de7fb6682195690fe7f54955aee"}
Sep 17 00:25:58.616196 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:58.616159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" event={"ID":"beac0e0f-402b-4b04-beb0-46ecad1ff78e","Type":"ContainerStarted","Data":"ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81"}
Sep 17 00:25:58.638461 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:58.638415    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" podStartSLOduration=2.638396867 podStartE2EDuration="2.638396867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:25:58.636882772 +0000 UTC m=+959.745658679" watchObservedRunningTime="2026-09-17 00:25:58.638396867 +0000 UTC m=+959.747172782"
Sep 17 00:25:59.213830 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:59.213790    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:59.218730 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:59.218707    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:59.621360 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:59.621327    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:59.622293 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:59.622272    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:25:59.987063 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:59.986988    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"]
Sep 17 00:25:59.992192 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:59.992172    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:25:59.994584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:25:59.994564    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-4df62ae2\""
Sep 17 00:26:00.001277 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.001257    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"]
Sep 17 00:26:00.192372 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.192325    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnqgf\" (UniqueName: \"kubernetes.io/projected/2ddd9576-1c62-44f0-bbde-9b5419e84717-kube-api-access-jnqgf\") pod \"payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx\" (UID: \"2ddd9576-1c62-44f0-bbde-9b5419e84717\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:00.192543 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.192461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddd9576-1c62-44f0-bbde-9b5419e84717-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx\" (UID: \"2ddd9576-1c62-44f0-bbde-9b5419e84717\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:00.293069 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.292973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddd9576-1c62-44f0-bbde-9b5419e84717-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx\" (UID: \"2ddd9576-1c62-44f0-bbde-9b5419e84717\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:00.293069 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.293066    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnqgf\" (UniqueName: \"kubernetes.io/projected/2ddd9576-1c62-44f0-bbde-9b5419e84717-kube-api-access-jnqgf\") pod \"payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx\" (UID: \"2ddd9576-1c62-44f0-bbde-9b5419e84717\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:00.293715 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.293693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddd9576-1c62-44f0-bbde-9b5419e84717-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx\" (UID: \"2ddd9576-1c62-44f0-bbde-9b5419e84717\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:00.302772 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.302745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnqgf\" (UniqueName: \"kubernetes.io/projected/2ddd9576-1c62-44f0-bbde-9b5419e84717-kube-api-access-jnqgf\") pod \"payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx\" (UID: \"2ddd9576-1c62-44f0-bbde-9b5419e84717\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:00.302941 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.302872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:00.607168 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.607136    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"]
Sep 17 00:26:00.608890 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:26:00.608863    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddd9576_1c62_44f0_bbde_9b5419e84717.slice/crio-932d0ea8beb3d50b71613f3d103be5ed2b91fb0a1aa4ceb78d3689090f7cba1a WatchSource:0}: Error finding container 932d0ea8beb3d50b71613f3d103be5ed2b91fb0a1aa4ceb78d3689090f7cba1a: Status 404 returned error can't find the container with id 932d0ea8beb3d50b71613f3d103be5ed2b91fb0a1aa4ceb78d3689090f7cba1a
Sep 17 00:26:00.627419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:00.627388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx" event={"ID":"2ddd9576-1c62-44f0-bbde-9b5419e84717","Type":"ContainerStarted","Data":"932d0ea8beb3d50b71613f3d103be5ed2b91fb0a1aa4ceb78d3689090f7cba1a"}
Sep 17 00:26:01.572452 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.572419    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:26:01.572650 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.572514    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:26:01.636140 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.636103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx" event={"ID":"2ddd9576-1c62-44f0-bbde-9b5419e84717","Type":"ContainerStarted","Data":"4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44"}
Sep 17 00:26:01.636621 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.636167    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:01.671500 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.671425    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx" podStartSLOduration=2.67139765 podStartE2EDuration="2.67139765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:25:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:01.670168897 +0000 UTC m=+962.778944813" watchObservedRunningTime="2026-09-17 00:26:01.67139765 +0000 UTC m=+962.780173563"
Sep 17 00:26:01.787853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.787802    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"]
Sep 17 00:26:01.792248 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.792224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.795141 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.795114    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a146d6-openshift-default-dockercfg-5jb2f\""
Sep 17 00:26:01.808692 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.808664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-token\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.808824 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.808709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istiod-ca-cert\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.808824 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.808788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-socket\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.808993 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.808844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-certs\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.809058 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.808989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg9kj\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-kube-api-access-bg9kj\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.809161 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.809135    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-podinfo\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.809235 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.809196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-data\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.809297 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.809231    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-credential-socket\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.809391 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.809294    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-envoy\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.813164 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.813141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"]
Sep 17 00:26:01.910327 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-podinfo\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.910327 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910302    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-data\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.910509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910326    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-credential-socket\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.910509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910363    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-envoy\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.910509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-token\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.910509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910411    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istiod-ca-cert\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.910509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910444    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-socket\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.910509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910475    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-certs\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.910701 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910565    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg9kj\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-kube-api-access-bg9kj\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.910701 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910689    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-data\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.911011 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.910983    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-socket\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.911130 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.911031    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-credential-socket\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.911130 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.911055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-certs\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.911451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.911427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istiod-ca-cert\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.912743 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.912722    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-envoy\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.913042 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.913024    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-podinfo\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.922807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.922782    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-token\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:01.927315 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:01.927292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg9kj\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-kube-api-access-bg9kj\") pod \"e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") " pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:02.105392 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:02.105358    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:02.417691 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:02.417659    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"]
Sep 17 00:26:02.418732 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:26:02.418707    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod755cf129_b5f8_49c6_8972_2d36f2f5cdbb.slice/crio-6e8df8d43a64e6d3b1c6e1d2c7201eaf72fdecc40caed11724129098bc571b5c WatchSource:0}: Error finding container 6e8df8d43a64e6d3b1c6e1d2c7201eaf72fdecc40caed11724129098bc571b5c: Status 404 returned error can't find the container with id 6e8df8d43a64e6d3b1c6e1d2c7201eaf72fdecc40caed11724129098bc571b5c
Sep 17 00:26:02.421170 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:02.421137    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:02.421238 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:02.421202    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:02.421280 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:02.421236    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:02.646523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:02.646478    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" event={"ID":"755cf129-b5f8-49c6-8972-2d36f2f5cdbb","Type":"ContainerStarted","Data":"37fce11848fbf28373a44c0e49dce73ca464a8d15466f628adfb3b4171b68424"}
Sep 17 00:26:02.647031 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:02.646564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" event={"ID":"755cf129-b5f8-49c6-8972-2d36f2f5cdbb","Type":"ContainerStarted","Data":"6e8df8d43a64e6d3b1c6e1d2c7201eaf72fdecc40caed11724129098bc571b5c"}
Sep 17 00:26:02.676308 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:02.676234    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" podStartSLOduration=1.676209335 podStartE2EDuration="1.676209335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:26:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:02.672291113 +0000 UTC m=+963.781067028" watchObservedRunningTime="2026-09-17 00:26:02.676209335 +0000 UTC m=+963.784985251"
Sep 17 00:26:03.106497 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:03.106458    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:03.111961 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:03.111934    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:03.584751 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:03.584697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:26:03.584969 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:03.584786    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:26:03.654952 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:03.653215    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:03.655419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:03.655013    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:06.673847 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.673813    2565 generic.go:356] "Generic (PLEG): container finished" podID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerID="87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7" exitCode=0
Sep 17 00:26:06.674262 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.673888    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" event={"ID":"52f37cd6-9067-4f28-96bd-19c0def3480b","Type":"ContainerDied","Data":"87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7"}
Sep 17 00:26:06.674453 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.674424    2565 scope.go:117] "RemoveContainer" containerID="87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7"
Sep 17 00:26:06.676099 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.676056    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:06.676245 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.676136    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:06.676245 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.676181    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:06.983709 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.983624    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"]
Sep 17 00:26:06.987533 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.987510    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:06.989999 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.989981    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-a146d6\""
Sep 17 00:26:06.990112 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.990070    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-a146d6-dockercfg-xzjld\""
Sep 17 00:26:06.996868 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:06.996844    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"]
Sep 17 00:26:07.015886 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.015855    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"]
Sep 17 00:26:07.020237 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.020216    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:07.028809 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.028784    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"]
Sep 17 00:26:07.065309 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.065276    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd486\" (UniqueName: \"kubernetes.io/projected/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-kube-api-access-dd486\") pod \"payload-processing-e2e-inf-b-a146d6-67856d6767-29js9\" (UID: \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:07.065446 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.065328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab303a6-c26a-434c-9deb-3f15e6e74899-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc\" (UID: \"aab303a6-c26a-434c-9deb-3f15e6e74899\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:07.065446 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.065402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a146d6-67856d6767-29js9\" (UID: \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:07.065446 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.065425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n6rf\" (UniqueName: \"kubernetes.io/projected/aab303a6-c26a-434c-9deb-3f15e6e74899-kube-api-access-2n6rf\") pod \"payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc\" (UID: \"aab303a6-c26a-434c-9deb-3f15e6e74899\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:07.166136 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.166098    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab303a6-c26a-434c-9deb-3f15e6e74899-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc\" (UID: \"aab303a6-c26a-434c-9deb-3f15e6e74899\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:07.166321 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.166200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a146d6-67856d6767-29js9\" (UID: \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:07.166321 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.166236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n6rf\" (UniqueName: \"kubernetes.io/projected/aab303a6-c26a-434c-9deb-3f15e6e74899-kube-api-access-2n6rf\") pod \"payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc\" (UID: \"aab303a6-c26a-434c-9deb-3f15e6e74899\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:07.166321 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.166297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd486\" (UniqueName: \"kubernetes.io/projected/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-kube-api-access-dd486\") pod \"payload-processing-e2e-inf-b-a146d6-67856d6767-29js9\" (UID: \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:07.166928 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.166890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-a146d6-67856d6767-29js9\" (UID: \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:07.167029 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.166935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab303a6-c26a-434c-9deb-3f15e6e74899-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc\" (UID: \"aab303a6-c26a-434c-9deb-3f15e6e74899\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:07.174080 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.174047    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n6rf\" (UniqueName: \"kubernetes.io/projected/aab303a6-c26a-434c-9deb-3f15e6e74899-kube-api-access-2n6rf\") pod \"payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc\" (UID: \"aab303a6-c26a-434c-9deb-3f15e6e74899\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:07.174189 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.174117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd486\" (UniqueName: \"kubernetes.io/projected/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-kube-api-access-dd486\") pod \"payload-processing-e2e-inf-b-a146d6-67856d6767-29js9\" (UID: \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\") " pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:07.299604 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.299530    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:07.332726 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.332699    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:07.585993 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.585967    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"]
Sep 17 00:26:07.587735 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:26:07.587705    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaab303a6_c26a_434c_9deb_3f15e6e74899.slice/crio-2e4f46f9c03621f13ea52d38cd872e9d7816ff6a943aa7e873325641c0132cd7 WatchSource:0}: Error finding container 2e4f46f9c03621f13ea52d38cd872e9d7816ff6a943aa7e873325641c0132cd7: Status 404 returned error can't find the container with id 2e4f46f9c03621f13ea52d38cd872e9d7816ff6a943aa7e873325641c0132cd7
Sep 17 00:26:07.622296 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.622272    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"]
Sep 17 00:26:07.626192 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:26:07.626164    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded989b98_5d19_4d87_aa1d_1f3fecf86a8d.slice/crio-3a4e11bf457852723c95dc26b73b6c71cd49cadef9ac45ae12bf5fba32977166 WatchSource:0}: Error finding container 3a4e11bf457852723c95dc26b73b6c71cd49cadef9ac45ae12bf5fba32977166: Status 404 returned error can't find the container with id 3a4e11bf457852723c95dc26b73b6c71cd49cadef9ac45ae12bf5fba32977166
Sep 17 00:26:07.681963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.681928    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc" event={"ID":"aab303a6-c26a-434c-9deb-3f15e6e74899","Type":"ContainerStarted","Data":"960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae"}
Sep 17 00:26:07.682374 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.681999    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:07.682374 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.682028    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc" event={"ID":"aab303a6-c26a-434c-9deb-3f15e6e74899","Type":"ContainerStarted","Data":"2e4f46f9c03621f13ea52d38cd872e9d7816ff6a943aa7e873325641c0132cd7"}
Sep 17 00:26:07.686840 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.686802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9" event={"ID":"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d","Type":"ContainerStarted","Data":"3a4e11bf457852723c95dc26b73b6c71cd49cadef9ac45ae12bf5fba32977166"}
Sep 17 00:26:07.689366 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.689340    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" event={"ID":"52f37cd6-9067-4f28-96bd-19c0def3480b","Type":"ContainerStarted","Data":"2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40"}
Sep 17 00:26:07.700803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:07.700753    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc" podStartSLOduration=1.7007349120000002 podStartE2EDuration="1.700734912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:07.698276334 +0000 UTC m=+968.807052250" watchObservedRunningTime="2026-09-17 00:26:07.700734912 +0000 UTC m=+968.809510831"
Sep 17 00:26:08.412857 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:08.412825    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:26:08.413147 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:08.413122    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:08.413246 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:08.413181    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 00:26:08.697139 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:08.697047    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9" event={"ID":"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d","Type":"ContainerStarted","Data":"dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb"}
Sep 17 00:26:08.697139 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:08.697118    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:08.713503 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:08.713456    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9" podStartSLOduration=2.7134388 podStartE2EDuration="2.7134388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:26:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:26:08.711926863 +0000 UTC m=+969.820702779" watchObservedRunningTime="2026-09-17 00:26:08.7134388 +0000 UTC m=+969.822214714"
Sep 17 00:26:09.412220 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:09.412182    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:09.412413 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:09.412238    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 00:26:10.412815 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:10.412774    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:10.413236 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:10.412832    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 00:26:11.412315 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:11.412279    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:11.412616 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:11.412582    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 00:26:12.413237 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:12.413197    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 17 00:26:12.413614 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:12.413253    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 17 00:26:12.650132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:12.650092    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:13.416761 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:13.416733    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:26:13.417166 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:13.417084    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:26:13.417702 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:13.417687    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:26:18.699130 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:18.699100    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:26:19.704188 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:19.704156    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:26:25.825364 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.825336    2565 generic.go:356] "Generic (PLEG): container finished" podID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerID="ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81" exitCode=0
Sep 17 00:26:25.825812 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.825416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" event={"ID":"beac0e0f-402b-4b04-beb0-46ecad1ff78e","Type":"ContainerDied","Data":"ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81"}
Sep 17 00:26:25.825959 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.825942    2565 scope.go:117] "RemoveContainer" containerID="ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81"
Sep 17 00:26:25.827133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.827110    2565 generic.go:356] "Generic (PLEG): container finished" podID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerID="37fce11848fbf28373a44c0e49dce73ca464a8d15466f628adfb3b4171b68424" exitCode=0
Sep 17 00:26:25.827227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.827155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" event={"ID":"755cf129-b5f8-49c6-8972-2d36f2f5cdbb","Type":"ContainerDied","Data":"37fce11848fbf28373a44c0e49dce73ca464a8d15466f628adfb3b4171b68424"}
Sep 17 00:26:25.827227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.827195    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:25.827308 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.827284    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:25.827344 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.827319    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:25.827527 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.827513    2565 scope.go:117] "RemoveContainer" containerID="37fce11848fbf28373a44c0e49dce73ca464a8d15466f628adfb3b4171b68424"
Sep 17 00:26:25.828621 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.828597    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:25.828720 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.828668    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:25.828786 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:25.828716    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:26:26.185235 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.185149    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"]
Sep 17 00:26:26.188271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.188242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"
Sep 17 00:26:26.190869 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.190848    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:26:26.195336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.195311    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"]
Sep 17 00:26:26.283499 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.283464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/836d1b71-805a-48c6-80e4-078fb5b9a3dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk\" (UID: \"836d1b71-805a-48c6-80e4-078fb5b9a3dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"
Sep 17 00:26:26.384718 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.384671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/836d1b71-805a-48c6-80e4-078fb5b9a3dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk\" (UID: \"836d1b71-805a-48c6-80e4-078fb5b9a3dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"
Sep 17 00:26:26.385545 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.385519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/836d1b71-805a-48c6-80e4-078fb5b9a3dd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk\" (UID: \"836d1b71-805a-48c6-80e4-078fb5b9a3dd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"
Sep 17 00:26:26.502882 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.502764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"
Sep 17 00:26:26.832918 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.832879    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"]
Sep 17 00:26:26.833787 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:26:26.833758    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836d1b71_805a_48c6_80e4_078fb5b9a3dd.slice/crio-2f7569f7b67f5372070bc25184f71ef24f0cf85445286438bb68dccd648f280b WatchSource:0}: Error finding container 2f7569f7b67f5372070bc25184f71ef24f0cf85445286438bb68dccd648f280b: Status 404 returned error can't find the container with id 2f7569f7b67f5372070bc25184f71ef24f0cf85445286438bb68dccd648f280b
Sep 17 00:26:26.836937 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.836886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" event={"ID":"beac0e0f-402b-4b04-beb0-46ecad1ff78e","Type":"ContainerStarted","Data":"58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800"}
Sep 17 00:26:26.839205 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:26.839186    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" event={"ID":"755cf129-b5f8-49c6-8972-2d36f2f5cdbb","Type":"ContainerStarted","Data":"ea1e4ef58f77e9af887dcf5d691d4d0596b77796df5c8c15b1579020f3150aa0"}
Sep 17 00:26:27.105864 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:27.105783    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:27.106072 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:27.106044    2565 patch_prober.go:28] interesting pod/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:26:27.106156 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:27.106106    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 17 00:26:27.213944 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:27.213906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:26:27.214974 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:27.214941    2565 patch_prober.go:28] interesting pod/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 00:26:27.215101 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:27.214998    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 00:26:27.850637 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:27.849979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk" event={"ID":"836d1b71-805a-48c6-80e4-078fb5b9a3dd","Type":"ContainerStarted","Data":"2f7569f7b67f5372070bc25184f71ef24f0cf85445286438bb68dccd648f280b"}
Sep 17 00:26:28.105837 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:28.105742    2565 patch_prober.go:28] interesting pod/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:26:28.105837 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:28.105807    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 17 00:26:28.214637 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:28.214599    2565 patch_prober.go:28] interesting pod/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 00:26:28.214819 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:28.214678    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 00:26:29.106496 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:29.106461    2565 patch_prober.go:28] interesting pod/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:26:29.106966 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:29.106521    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 17 00:26:29.214703 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:29.214663    2565 patch_prober.go:28] interesting pod/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 00:26:29.214882 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:29.214734    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 00:26:29.621348 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:29.621294    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:26:30.106793 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:30.106751    2565 patch_prober.go:28] interesting pod/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:26:30.107301 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:30.106822    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 17 00:26:30.215026 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:30.214859    2565 patch_prober.go:28] interesting pod/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 00:26:30.215026 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:30.214935    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 00:26:31.106097 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:31.106060    2565 patch_prober.go:28] interesting pod/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:26:31.106282 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:31.106118    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 17 00:26:31.214851 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:31.214815    2565 patch_prober.go:28] interesting pod/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body=
Sep 17 00:26:31.215234 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:31.214877    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused"
Sep 17 00:26:31.901518 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:31.901481    2565 generic.go:356] "Generic (PLEG): container finished" podID="836d1b71-805a-48c6-80e4-078fb5b9a3dd" containerID="84ae9bc9e9f843fc987098d1c9d53d18e85972accd1a534d173d832b8a84c6ba" exitCode=0
Sep 17 00:26:31.901700 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:31.901543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk" event={"ID":"836d1b71-805a-48c6-80e4-078fb5b9a3dd","Type":"ContainerDied","Data":"84ae9bc9e9f843fc987098d1c9d53d18e85972accd1a534d173d832b8a84c6ba"}
Sep 17 00:26:32.106449 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:32.106412    2565 patch_prober.go:28] interesting pod/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Sep 17 00:26:32.106652 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:32.106476    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Sep 17 00:26:32.218363 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:32.218334    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:26:32.219336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:32.219317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:26:33.047907 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.047872    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"
Sep 17 00:26:33.109567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.109536    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:33.109953 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.109927    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:33.110580 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.110564    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:26:33.171256 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.171183    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/836d1b71-805a-48c6-80e4-078fb5b9a3dd-maas-api-service-ca\") pod \"836d1b71-805a-48c6-80e4-078fb5b9a3dd\" (UID: \"836d1b71-805a-48c6-80e4-078fb5b9a3dd\") "
Sep 17 00:26:33.171611 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.171585    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/836d1b71-805a-48c6-80e4-078fb5b9a3dd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "836d1b71-805a-48c6-80e4-078fb5b9a3dd" (UID: "836d1b71-805a-48c6-80e4-078fb5b9a3dd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:26:33.272285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.272251    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/836d1b71-805a-48c6-80e4-078fb5b9a3dd-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:26:33.914134 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.914098    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"
Sep 17 00:26:33.914134 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.914127    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk" event={"ID":"836d1b71-805a-48c6-80e4-078fb5b9a3dd","Type":"ContainerDied","Data":"2f7569f7b67f5372070bc25184f71ef24f0cf85445286438bb68dccd648f280b"}
Sep 17 00:26:33.914348 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:33.914177    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f7569f7b67f5372070bc25184f71ef24f0cf85445286438bb68dccd648f280b"
Sep 17 00:26:37.454858 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.454822    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"]
Sep 17 00:26:37.455347 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.455241    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx" podUID="2ddd9576-1c62-44f0-bbde-9b5419e84717" containerName="payload-pre-processing" containerID="cri-o://4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44" gracePeriod=30
Sep 17 00:26:37.603684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.603649    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"]
Sep 17 00:26:37.605737 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.605713    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-4df62ae2-rwzrk"]
Sep 17 00:26:37.726596 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.726513    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:37.817834 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.817804    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddd9576-1c62-44f0-bbde-9b5419e84717-plugins-config-volume\") pod \"2ddd9576-1c62-44f0-bbde-9b5419e84717\" (UID: \"2ddd9576-1c62-44f0-bbde-9b5419e84717\") "
Sep 17 00:26:37.818028 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.817849    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnqgf\" (UniqueName: \"kubernetes.io/projected/2ddd9576-1c62-44f0-bbde-9b5419e84717-kube-api-access-jnqgf\") pod \"2ddd9576-1c62-44f0-bbde-9b5419e84717\" (UID: \"2ddd9576-1c62-44f0-bbde-9b5419e84717\") "
Sep 17 00:26:37.818220 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.818195    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ddd9576-1c62-44f0-bbde-9b5419e84717-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ddd9576-1c62-44f0-bbde-9b5419e84717" (UID: "2ddd9576-1c62-44f0-bbde-9b5419e84717"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:26:37.820044 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.820016    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ddd9576-1c62-44f0-bbde-9b5419e84717-kube-api-access-jnqgf" (OuterVolumeSpecName: "kube-api-access-jnqgf") pod "2ddd9576-1c62-44f0-bbde-9b5419e84717" (UID: "2ddd9576-1c62-44f0-bbde-9b5419e84717"). InnerVolumeSpecName "kube-api-access-jnqgf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:26:37.919539 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.919503    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ddd9576-1c62-44f0-bbde-9b5419e84717-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:26:37.919539 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.919534    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnqgf\" (UniqueName: \"kubernetes.io/projected/2ddd9576-1c62-44f0-bbde-9b5419e84717-kube-api-access-jnqgf\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:26:37.939355 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.939323    2565 generic.go:356] "Generic (PLEG): container finished" podID="2ddd9576-1c62-44f0-bbde-9b5419e84717" containerID="4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44" exitCode=0
Sep 17 00:26:37.939488 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.939376    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"
Sep 17 00:26:37.939488 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.939408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx" event={"ID":"2ddd9576-1c62-44f0-bbde-9b5419e84717","Type":"ContainerDied","Data":"4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44"}
Sep 17 00:26:37.939604 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.939486    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx" event={"ID":"2ddd9576-1c62-44f0-bbde-9b5419e84717","Type":"ContainerDied","Data":"932d0ea8beb3d50b71613f3d103be5ed2b91fb0a1aa4ceb78d3689090f7cba1a"}
Sep 17 00:26:37.939604 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.939512    2565 scope.go:117] "RemoveContainer" containerID="4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44"
Sep 17 00:26:37.948848 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.948827    2565 scope.go:117] "RemoveContainer" containerID="4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44"
Sep 17 00:26:37.949202 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:26:37.949182    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44\": container with ID starting with 4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44 not found: ID does not exist" containerID="4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44"
Sep 17 00:26:37.949259 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.949210    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44"} err="failed to get container status \"4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44\": rpc error: code = NotFound desc = could not find container \"4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44\": container with ID starting with 4366a7613fb352d6c22af9357b7594539f450ba43cdf58b1fede95df40444c44 not found: ID does not exist"
Sep 17 00:26:37.960820 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.960797    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"]
Sep 17 00:26:37.964274 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:37.964252    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-4df62ae2-6cc95f7d58-n55gx"]
Sep 17 00:26:39.391067 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:39.391034    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ddd9576-1c62-44f0-bbde-9b5419e84717" path="/var/lib/kubelet/pods/2ddd9576-1c62-44f0-bbde-9b5419e84717/volumes"
Sep 17 00:26:39.391431 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:26:39.391380    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="836d1b71-805a-48c6-80e4-078fb5b9a3dd" path="/var/lib/kubelet/pods/836d1b71-805a-48c6-80e4-078fb5b9a3dd/volumes"
Sep 17 00:27:06.915634 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.915596    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"]
Sep 17 00:27:06.916313 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.916290    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="836d1b71-805a-48c6-80e4-078fb5b9a3dd" containerName="revoke-keys"
Sep 17 00:27:06.916313 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.916314    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="836d1b71-805a-48c6-80e4-078fb5b9a3dd" containerName="revoke-keys"
Sep 17 00:27:06.916460 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.916332    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ddd9576-1c62-44f0-bbde-9b5419e84717" containerName="payload-pre-processing"
Sep 17 00:27:06.916460 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.916340    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ddd9576-1c62-44f0-bbde-9b5419e84717" containerName="payload-pre-processing"
Sep 17 00:27:06.916570 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.916469    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="836d1b71-805a-48c6-80e4-078fb5b9a3dd" containerName="revoke-keys"
Sep 17 00:27:06.916570 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.916490    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ddd9576-1c62-44f0-bbde-9b5419e84717" containerName="payload-pre-processing"
Sep 17 00:27:06.921893 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.921865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"
Sep 17 00:27:06.924451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.924432    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:27:06.931752 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.931720    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"]
Sep 17 00:27:06.995916 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:06.995870    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9294e2-3e69-4e30-bdde-0fa013050a7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q\" (UID: \"8f9294e2-3e69-4e30-bdde-0fa013050a7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"
Sep 17 00:27:07.097010 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:07.096971    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9294e2-3e69-4e30-bdde-0fa013050a7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q\" (UID: \"8f9294e2-3e69-4e30-bdde-0fa013050a7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"
Sep 17 00:27:07.097586 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:07.097564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9294e2-3e69-4e30-bdde-0fa013050a7c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q\" (UID: \"8f9294e2-3e69-4e30-bdde-0fa013050a7c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"
Sep 17 00:27:07.250892 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:07.250818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"
Sep 17 00:27:07.526925 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:07.526867    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"]
Sep 17 00:27:07.528102 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:27:07.528073    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9294e2_3e69_4e30_bdde_0fa013050a7c.slice/crio-a4e1d943b7b31bcaa6852b845408648e226648860aa4fb1aeff5c4e0e23eba0d WatchSource:0}: Error finding container a4e1d943b7b31bcaa6852b845408648e226648860aa4fb1aeff5c4e0e23eba0d: Status 404 returned error can't find the container with id a4e1d943b7b31bcaa6852b845408648e226648860aa4fb1aeff5c4e0e23eba0d
Sep 17 00:27:08.114559 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:08.114474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q" event={"ID":"8f9294e2-3e69-4e30-bdde-0fa013050a7c","Type":"ContainerStarted","Data":"704d92ab61ea91244d07f37aa800054390229caf401cba46325027d938e87971"}
Sep 17 00:27:08.114559 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:08.114546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q" event={"ID":"8f9294e2-3e69-4e30-bdde-0fa013050a7c","Type":"ContainerStarted","Data":"a4e1d943b7b31bcaa6852b845408648e226648860aa4fb1aeff5c4e0e23eba0d"}
Sep 17 00:27:08.130485 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:08.130434    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q" podStartSLOduration=2.130418026 podStartE2EDuration="2.130418026s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:27:08.127396056 +0000 UTC m=+1029.236171971" watchObservedRunningTime="2026-09-17 00:27:08.130418026 +0000 UTC m=+1029.239193971"
Sep 17 00:27:09.122242 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:09.122207    2565 generic.go:356] "Generic (PLEG): container finished" podID="8f9294e2-3e69-4e30-bdde-0fa013050a7c" containerID="704d92ab61ea91244d07f37aa800054390229caf401cba46325027d938e87971" exitCode=0
Sep 17 00:27:09.122709 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:09.122253    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q" event={"ID":"8f9294e2-3e69-4e30-bdde-0fa013050a7c","Type":"ContainerDied","Data":"704d92ab61ea91244d07f37aa800054390229caf401cba46325027d938e87971"}
Sep 17 00:27:10.253777 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:10.253750    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"
Sep 17 00:27:10.330311 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:10.330281    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9294e2-3e69-4e30-bdde-0fa013050a7c-maas-api-service-ca\") pod \"8f9294e2-3e69-4e30-bdde-0fa013050a7c\" (UID: \"8f9294e2-3e69-4e30-bdde-0fa013050a7c\") "
Sep 17 00:27:10.330627 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:10.330605    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f9294e2-3e69-4e30-bdde-0fa013050a7c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8f9294e2-3e69-4e30-bdde-0fa013050a7c" (UID: "8f9294e2-3e69-4e30-bdde-0fa013050a7c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:27:10.431723 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:10.431647    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f9294e2-3e69-4e30-bdde-0fa013050a7c-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:27:11.135710 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:11.135677    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q" event={"ID":"8f9294e2-3e69-4e30-bdde-0fa013050a7c","Type":"ContainerDied","Data":"a4e1d943b7b31bcaa6852b845408648e226648860aa4fb1aeff5c4e0e23eba0d"}
Sep 17 00:27:11.135861 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:11.135725    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4e1d943b7b31bcaa6852b845408648e226648860aa4fb1aeff5c4e0e23eba0d"
Sep 17 00:27:11.135861 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:11.135723    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"
Sep 17 00:27:12.752272 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:12.752231    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"]
Sep 17 00:27:12.755193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:12.755170    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3932eef5-z7n8q"]
Sep 17 00:27:13.390193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:13.390161    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f9294e2-3e69-4e30-bdde-0fa013050a7c" path="/var/lib/kubelet/pods/8f9294e2-3e69-4e30-bdde-0fa013050a7c/volumes"
Sep 17 00:27:18.220636 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.220600    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"]
Sep 17 00:27:18.221136 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.221121    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9294e2-3e69-4e30-bdde-0fa013050a7c" containerName="revoke-keys"
Sep 17 00:27:18.221189 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.221138    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9294e2-3e69-4e30-bdde-0fa013050a7c" containerName="revoke-keys"
Sep 17 00:27:18.221226 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.221206    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f9294e2-3e69-4e30-bdde-0fa013050a7c" containerName="revoke-keys"
Sep 17 00:27:18.224706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.224690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:18.227442 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.227414    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-56ff2313-dockercfg-l42qd\""
Sep 17 00:27:18.227595 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.227578    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-56ff2313\""
Sep 17 00:27:18.234539 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.234514    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"]
Sep 17 00:27:18.313297 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.313118    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dxjb\" (UniqueName: \"kubernetes.io/projected/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-kube-api-access-5dxjb\") pod \"payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm\" (UID: \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:18.313297 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.313220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm\" (UID: \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:18.413939 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.413876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dxjb\" (UniqueName: \"kubernetes.io/projected/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-kube-api-access-5dxjb\") pod \"payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm\" (UID: \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:18.414114 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.413982    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm\" (UID: \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:18.414747 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.414728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm\" (UID: \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:18.421249 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.421224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dxjb\" (UniqueName: \"kubernetes.io/projected/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-kube-api-access-5dxjb\") pod \"payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm\" (UID: \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:18.536953 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.536872    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:18.812726 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:18.812700    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"]
Sep 17 00:27:18.814374 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:27:18.814345    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c4fe82_eebf_4b01_920f_1e4d4158d3a5.slice/crio-653f0e4d8a18a942dbd5181ccf3752fc00b7fb33a65c4e423f1979fbe9309c96 WatchSource:0}: Error finding container 653f0e4d8a18a942dbd5181ccf3752fc00b7fb33a65c4e423f1979fbe9309c96: Status 404 returned error can't find the container with id 653f0e4d8a18a942dbd5181ccf3752fc00b7fb33a65c4e423f1979fbe9309c96
Sep 17 00:27:19.182967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:19.182893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm" event={"ID":"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5","Type":"ContainerStarted","Data":"d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5"}
Sep 17 00:27:19.183164 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:19.182994    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm" event={"ID":"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5","Type":"ContainerStarted","Data":"653f0e4d8a18a942dbd5181ccf3752fc00b7fb33a65c4e423f1979fbe9309c96"}
Sep 17 00:27:19.183164 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:19.183046    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:19.200698 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:19.200643    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm" podStartSLOduration=1.200627328 podStartE2EDuration="1.200627328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:27:19.199421029 +0000 UTC m=+1040.308196946" watchObservedRunningTime="2026-09-17 00:27:19.200627328 +0000 UTC m=+1040.309403243"
Sep 17 00:27:30.189947 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:30.189891    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:41.786409 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:41.786378    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"]
Sep 17 00:27:41.790431 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:41.790413    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"
Sep 17 00:27:41.792982 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:41.792959    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:27:41.797398 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:41.797369    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"]
Sep 17 00:27:41.830234 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:41.830196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1788b3f5-c1de-40cd-bd72-047558c4263f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-56ff2313-njwwf\" (UID: \"1788b3f5-c1de-40cd-bd72-047558c4263f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"
Sep 17 00:27:41.931732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:41.931702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1788b3f5-c1de-40cd-bd72-047558c4263f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-56ff2313-njwwf\" (UID: \"1788b3f5-c1de-40cd-bd72-047558c4263f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"
Sep 17 00:27:41.932374 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:41.932355    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1788b3f5-c1de-40cd-bd72-047558c4263f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-56ff2313-njwwf\" (UID: \"1788b3f5-c1de-40cd-bd72-047558c4263f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"
Sep 17 00:27:42.102871 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:42.102846    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"
Sep 17 00:27:42.370742 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:42.370719    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"]
Sep 17 00:27:42.372058 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:27:42.372031    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1788b3f5_c1de_40cd_bd72_047558c4263f.slice/crio-bbed6478554fb379e8c4361da029fe4311a00955a56dc2f73143772c99ef652c WatchSource:0}: Error finding container bbed6478554fb379e8c4361da029fe4311a00955a56dc2f73143772c99ef652c: Status 404 returned error can't find the container with id bbed6478554fb379e8c4361da029fe4311a00955a56dc2f73143772c99ef652c
Sep 17 00:27:43.315711 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:43.315611    2565 generic.go:356] "Generic (PLEG): container finished" podID="1788b3f5-c1de-40cd-bd72-047558c4263f" containerID="42786a1c193bd1aeec59f258f06f57c026d13120b3ec99290539df5ad2918d75" exitCode=0
Sep 17 00:27:43.315711 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:43.315664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf" event={"ID":"1788b3f5-c1de-40cd-bd72-047558c4263f","Type":"ContainerDied","Data":"42786a1c193bd1aeec59f258f06f57c026d13120b3ec99290539df5ad2918d75"}
Sep 17 00:27:43.315711 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:43.315706    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf" event={"ID":"1788b3f5-c1de-40cd-bd72-047558c4263f","Type":"ContainerStarted","Data":"bbed6478554fb379e8c4361da029fe4311a00955a56dc2f73143772c99ef652c"}
Sep 17 00:27:44.459407 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:44.459382    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"
Sep 17 00:27:44.557409 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:44.557378    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1788b3f5-c1de-40cd-bd72-047558c4263f-maas-api-service-ca\") pod \"1788b3f5-c1de-40cd-bd72-047558c4263f\" (UID: \"1788b3f5-c1de-40cd-bd72-047558c4263f\") "
Sep 17 00:27:44.557776 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:44.557749    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1788b3f5-c1de-40cd-bd72-047558c4263f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1788b3f5-c1de-40cd-bd72-047558c4263f" (UID: "1788b3f5-c1de-40cd-bd72-047558c4263f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:27:44.658973 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:44.658937    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1788b3f5-c1de-40cd-bd72-047558c4263f-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:27:45.328255 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:45.328226    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"
Sep 17 00:27:45.328424 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:45.328256    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf" event={"ID":"1788b3f5-c1de-40cd-bd72-047558c4263f","Type":"ContainerDied","Data":"bbed6478554fb379e8c4361da029fe4311a00955a56dc2f73143772c99ef652c"}
Sep 17 00:27:45.328424 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:45.328299    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbed6478554fb379e8c4361da029fe4311a00955a56dc2f73143772c99ef652c"
Sep 17 00:27:47.566135 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.566099    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"]
Sep 17 00:27:47.566617 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.566350    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm" podUID="b9c4fe82-eebf-4b01-920f-1e4d4158d3a5" containerName="payload-pre-processing" containerID="cri-o://d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5" gracePeriod=30
Sep 17 00:27:47.707990 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.707944    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"]
Sep 17 00:27:47.710358 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.710322    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-56ff2313-njwwf"]
Sep 17 00:27:47.834752 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.834722    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:47.891335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.891301    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dxjb\" (UniqueName: \"kubernetes.io/projected/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-kube-api-access-5dxjb\") pod \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\" (UID: \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\") "
Sep 17 00:27:47.891505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.891489    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-plugins-config-volume\") pod \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\" (UID: \"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5\") "
Sep 17 00:27:47.892213 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.892184    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9c4fe82-eebf-4b01-920f-1e4d4158d3a5" (UID: "b9c4fe82-eebf-4b01-920f-1e4d4158d3a5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:27:47.894535 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.894511    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-kube-api-access-5dxjb" (OuterVolumeSpecName: "kube-api-access-5dxjb") pod "b9c4fe82-eebf-4b01-920f-1e4d4158d3a5" (UID: "b9c4fe82-eebf-4b01-920f-1e4d4158d3a5"). InnerVolumeSpecName "kube-api-access-5dxjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:27:47.993093 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.993059    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:27:47.993093 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:47.993086    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dxjb\" (UniqueName: \"kubernetes.io/projected/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5-kube-api-access-5dxjb\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:27:48.347458 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:48.347423    2565 generic.go:356] "Generic (PLEG): container finished" podID="b9c4fe82-eebf-4b01-920f-1e4d4158d3a5" containerID="d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5" exitCode=0
Sep 17 00:27:48.347652 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:48.347486    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"
Sep 17 00:27:48.347652 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:48.347505    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm" event={"ID":"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5","Type":"ContainerDied","Data":"d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5"}
Sep 17 00:27:48.347652 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:48.347565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm" event={"ID":"b9c4fe82-eebf-4b01-920f-1e4d4158d3a5","Type":"ContainerDied","Data":"653f0e4d8a18a942dbd5181ccf3752fc00b7fb33a65c4e423f1979fbe9309c96"}
Sep 17 00:27:48.347652 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:48.347588    2565 scope.go:117] "RemoveContainer" containerID="d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5"
Sep 17 00:27:48.357434 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:48.357417    2565 scope.go:117] "RemoveContainer" containerID="d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5"
Sep 17 00:27:48.357709 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:27:48.357693    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5\": container with ID starting with d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5 not found: ID does not exist" containerID="d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5"
Sep 17 00:27:48.357764 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:48.357717    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5"} err="failed to get container status \"d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5\": rpc error: code = NotFound desc = could not find container \"d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5\": container with ID starting with d634f413c4a5fbdf81b95aafcf050c60c71332c677bbcb54724b315432794cc5 not found: ID does not exist"
Sep 17 00:27:48.373234 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:48.373205    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"]
Sep 17 00:27:48.375570 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:48.375538    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-56ff2313-558dfd74c8-5mdkm"]
Sep 17 00:27:49.393532 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:49.393499    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1788b3f5-c1de-40cd-bd72-047558c4263f" path="/var/lib/kubelet/pods/1788b3f5-c1de-40cd-bd72-047558c4263f/volumes"
Sep 17 00:27:49.393929 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:49.393891    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c4fe82-eebf-4b01-920f-1e4d4158d3a5" path="/var/lib/kubelet/pods/b9c4fe82-eebf-4b01-920f-1e4d4158d3a5/volumes"
Sep 17 00:27:58.983176 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.983099    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"]
Sep 17 00:27:58.983632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.983614    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1788b3f5-c1de-40cd-bd72-047558c4263f" containerName="revoke-keys"
Sep 17 00:27:58.983679 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.983634    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1788b3f5-c1de-40cd-bd72-047558c4263f" containerName="revoke-keys"
Sep 17 00:27:58.983679 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.983646    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c4fe82-eebf-4b01-920f-1e4d4158d3a5" containerName="payload-pre-processing"
Sep 17 00:27:58.983679 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.983652    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c4fe82-eebf-4b01-920f-1e4d4158d3a5" containerName="payload-pre-processing"
Sep 17 00:27:58.983778 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.983746    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1788b3f5-c1de-40cd-bd72-047558c4263f" containerName="revoke-keys"
Sep 17 00:27:58.983778 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.983755    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c4fe82-eebf-4b01-920f-1e4d4158d3a5" containerName="payload-pre-processing"
Sep 17 00:27:58.986809 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.986791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:58.989553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.989529    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-f492a5\"/\"openshift-service-ca.crt\""
Sep 17 00:27:58.990839 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.990814    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-f492a5\"/\"default-dockercfg-88qq4\""
Sep 17 00:27:58.991140 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.991122    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-f492a5\"/\"kube-root-ca.crt\""
Sep 17 00:27:58.991391 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.991372    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-f492a5\"/\"autores-model-f492a5-kserve-self-signed-certs\""
Sep 17 00:27:58.997272 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:58.997240    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"]
Sep 17 00:27:59.102487 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.102456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eea119-5cd8-4a6c-83a2-56dc60805046-tls-certs\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.102487 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.102489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-dshm\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.102738 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.102512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df7rq\" (UniqueName: \"kubernetes.io/projected/04eea119-5cd8-4a6c-83a2-56dc60805046-kube-api-access-df7rq\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.102738 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.102643    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-home\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.102738 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.102722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-tmp-dir\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.102879 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.102758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-model-cache\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.203937 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.203880    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eea119-5cd8-4a6c-83a2-56dc60805046-tls-certs\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.203937 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.203932    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-dshm\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.204126 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.203964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df7rq\" (UniqueName: \"kubernetes.io/projected/04eea119-5cd8-4a6c-83a2-56dc60805046-kube-api-access-df7rq\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.204126 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.204021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-home\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.204126 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.204077    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-tmp-dir\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.204126 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.204104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-model-cache\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.204420 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.204401    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-home\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.204505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.204453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-model-cache\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.204563 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.204528    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-tmp-dir\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.206245 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.206223    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-dshm\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.206479 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.206461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eea119-5cd8-4a6c-83a2-56dc60805046-tls-certs\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.211849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.211826    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df7rq\" (UniqueName: \"kubernetes.io/projected/04eea119-5cd8-4a6c-83a2-56dc60805046-kube-api-access-df7rq\") pod \"autores-model-f492a5-kserve-6b669f6995-9mdtb\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") " pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.305556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.305498    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-f492a5\"/\"default-dockercfg-88qq4\""
Sep 17 00:27:59.313632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.313612    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:27:59.589573 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:27:59.589547    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"]
Sep 17 00:27:59.591177 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:27:59.591150    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04eea119_5cd8_4a6c_83a2_56dc60805046.slice/crio-d89b809a1a437f48881136a122375058ce8d1735febdce79fd28c6e3c77722f3 WatchSource:0}: Error finding container d89b809a1a437f48881136a122375058ce8d1735febdce79fd28c6e3c77722f3: Status 404 returned error can't find the container with id d89b809a1a437f48881136a122375058ce8d1735febdce79fd28c6e3c77722f3
Sep 17 00:28:00.423545 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:00.423504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb" event={"ID":"04eea119-5cd8-4a6c-83a2-56dc60805046","Type":"ContainerStarted","Data":"5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42"}
Sep 17 00:28:00.423545 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:00.423549    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb" event={"ID":"04eea119-5cd8-4a6c-83a2-56dc60805046","Type":"ContainerStarted","Data":"d89b809a1a437f48881136a122375058ce8d1735febdce79fd28c6e3c77722f3"}
Sep 17 00:28:00.440251 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:00.440198    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb" podStartSLOduration=2.440183047 podStartE2EDuration="2.440183047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:27:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:28:00.438294741 +0000 UTC m=+1081.547070668" watchObservedRunningTime="2026-09-17 00:28:00.440183047 +0000 UTC m=+1081.548958962"
Sep 17 00:28:09.314192 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:09.314156    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:28:09.314612 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:09.314224    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:28:09.326777 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:09.326751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:28:09.484945 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:09.484917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:28:22.197095 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:22.197055    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"]
Sep 17 00:28:22.201347 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:22.201325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"
Sep 17 00:28:22.205283 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:22.204796    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:28:22.206891 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:22.206864    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"]
Sep 17 00:28:22.337314 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:22.337283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c33dc1-389b-48a6-baaf-dc522d95689e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566\" (UID: \"58c33dc1-389b-48a6-baaf-dc522d95689e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"
Sep 17 00:28:22.438064 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:22.438030    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c33dc1-389b-48a6-baaf-dc522d95689e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566\" (UID: \"58c33dc1-389b-48a6-baaf-dc522d95689e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"
Sep 17 00:28:22.438640 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:22.438620    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c33dc1-389b-48a6-baaf-dc522d95689e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566\" (UID: \"58c33dc1-389b-48a6-baaf-dc522d95689e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"
Sep 17 00:28:22.515583 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:22.515504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"
Sep 17 00:28:22.785865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:22.785839    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"]
Sep 17 00:28:22.787923 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:28:22.787876    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c33dc1_389b_48a6_baaf_dc522d95689e.slice/crio-86708a06a9919dc7ff7e28d544a7a4e846ae16e9562b72c5cbfc69e2a3d74a09 WatchSource:0}: Error finding container 86708a06a9919dc7ff7e28d544a7a4e846ae16e9562b72c5cbfc69e2a3d74a09: Status 404 returned error can't find the container with id 86708a06a9919dc7ff7e28d544a7a4e846ae16e9562b72c5cbfc69e2a3d74a09
Sep 17 00:28:23.556747 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:23.556711    2565 generic.go:356] "Generic (PLEG): container finished" podID="58c33dc1-389b-48a6-baaf-dc522d95689e" containerID="427e83b42234d604d659434a0bfce5436932d622859dc6cc52efbc98e403c935" exitCode=0
Sep 17 00:28:23.557155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:23.556802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566" event={"ID":"58c33dc1-389b-48a6-baaf-dc522d95689e","Type":"ContainerDied","Data":"427e83b42234d604d659434a0bfce5436932d622859dc6cc52efbc98e403c935"}
Sep 17 00:28:23.557155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:23.556864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566" event={"ID":"58c33dc1-389b-48a6-baaf-dc522d95689e","Type":"ContainerStarted","Data":"86708a06a9919dc7ff7e28d544a7a4e846ae16e9562b72c5cbfc69e2a3d74a09"}
Sep 17 00:28:24.698450 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:24.698426    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"
Sep 17 00:28:24.762026 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:24.761997    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c33dc1-389b-48a6-baaf-dc522d95689e-maas-api-service-ca\") pod \"58c33dc1-389b-48a6-baaf-dc522d95689e\" (UID: \"58c33dc1-389b-48a6-baaf-dc522d95689e\") "
Sep 17 00:28:24.762408 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:24.762386    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58c33dc1-389b-48a6-baaf-dc522d95689e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "58c33dc1-389b-48a6-baaf-dc522d95689e" (UID: "58c33dc1-389b-48a6-baaf-dc522d95689e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:28:24.863446 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:24.863409    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/58c33dc1-389b-48a6-baaf-dc522d95689e-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:28:25.570575 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:25.570537    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566" event={"ID":"58c33dc1-389b-48a6-baaf-dc522d95689e","Type":"ContainerDied","Data":"86708a06a9919dc7ff7e28d544a7a4e846ae16e9562b72c5cbfc69e2a3d74a09"}
Sep 17 00:28:25.570575 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:25.570562    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"
Sep 17 00:28:25.570783 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:25.570597    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86708a06a9919dc7ff7e28d544a7a4e846ae16e9562b72c5cbfc69e2a3d74a09"
Sep 17 00:28:34.098315 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.098274    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"]
Sep 17 00:28:34.102258 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.102230    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e10e0b5-r8566"]
Sep 17 00:28:34.555320 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.555249    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"]
Sep 17 00:28:34.555709 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.555697    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58c33dc1-389b-48a6-baaf-dc522d95689e" containerName="revoke-keys"
Sep 17 00:28:34.555754 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.555711    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="58c33dc1-389b-48a6-baaf-dc522d95689e" containerName="revoke-keys"
Sep 17 00:28:34.555820 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.555810    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="58c33dc1-389b-48a6-baaf-dc522d95689e" containerName="revoke-keys"
Sep 17 00:28:34.559015 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.558995    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"
Sep 17 00:28:34.561549 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.561530    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:28:34.567255 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.567194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"]
Sep 17 00:28:34.654718 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.654677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22a78b3-ea3e-4899-86d6-50ba199c895f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-f492a5-hvsvq\" (UID: \"e22a78b3-ea3e-4899-86d6-50ba199c895f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"
Sep 17 00:28:34.755718 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.755680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22a78b3-ea3e-4899-86d6-50ba199c895f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-f492a5-hvsvq\" (UID: \"e22a78b3-ea3e-4899-86d6-50ba199c895f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"
Sep 17 00:28:34.756328 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.756306    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22a78b3-ea3e-4899-86d6-50ba199c895f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-f492a5-hvsvq\" (UID: \"e22a78b3-ea3e-4899-86d6-50ba199c895f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"
Sep 17 00:28:34.872775 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:34.872737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"
Sep 17 00:28:35.150480 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:35.150452    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"]
Sep 17 00:28:35.152525 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:28:35.152496    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22a78b3_ea3e_4899_86d6_50ba199c895f.slice/crio-ab1af941a3114b47f67d728cf12c164ca3251581fea7a9b202e0a1ac0bcdab76 WatchSource:0}: Error finding container ab1af941a3114b47f67d728cf12c164ca3251581fea7a9b202e0a1ac0bcdab76: Status 404 returned error can't find the container with id ab1af941a3114b47f67d728cf12c164ca3251581fea7a9b202e0a1ac0bcdab76
Sep 17 00:28:35.390289 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:35.390254    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58c33dc1-389b-48a6-baaf-dc522d95689e" path="/var/lib/kubelet/pods/58c33dc1-389b-48a6-baaf-dc522d95689e/volumes"
Sep 17 00:28:35.637022 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:35.636976    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq" event={"ID":"e22a78b3-ea3e-4899-86d6-50ba199c895f","Type":"ContainerStarted","Data":"fd0fb28a874928493b5616d3155b98d7f17638b85925406b2eec655db9217a66"}
Sep 17 00:28:35.637354 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:35.637049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq" event={"ID":"e22a78b3-ea3e-4899-86d6-50ba199c895f","Type":"ContainerStarted","Data":"ab1af941a3114b47f67d728cf12c164ca3251581fea7a9b202e0a1ac0bcdab76"}
Sep 17 00:28:35.652966 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:35.652885    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq" podStartSLOduration=1.6528690579999998 podStartE2EDuration="1.652869058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:28:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:28:35.651322836 +0000 UTC m=+1116.760098752" watchObservedRunningTime="2026-09-17 00:28:35.652869058 +0000 UTC m=+1116.761645203"
Sep 17 00:28:36.645252 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:36.645216    2565 generic.go:356] "Generic (PLEG): container finished" podID="e22a78b3-ea3e-4899-86d6-50ba199c895f" containerID="fd0fb28a874928493b5616d3155b98d7f17638b85925406b2eec655db9217a66" exitCode=0
Sep 17 00:28:36.645661 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:36.645273    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq" event={"ID":"e22a78b3-ea3e-4899-86d6-50ba199c895f","Type":"ContainerDied","Data":"fd0fb28a874928493b5616d3155b98d7f17638b85925406b2eec655db9217a66"}
Sep 17 00:28:37.788342 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:37.788316    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"
Sep 17 00:28:37.888922 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:37.888861    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22a78b3-ea3e-4899-86d6-50ba199c895f-maas-api-service-ca\") pod \"e22a78b3-ea3e-4899-86d6-50ba199c895f\" (UID: \"e22a78b3-ea3e-4899-86d6-50ba199c895f\") "
Sep 17 00:28:37.889292 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:37.889263    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e22a78b3-ea3e-4899-86d6-50ba199c895f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e22a78b3-ea3e-4899-86d6-50ba199c895f" (UID: "e22a78b3-ea3e-4899-86d6-50ba199c895f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:28:37.990486 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:37.990409    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e22a78b3-ea3e-4899-86d6-50ba199c895f-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:28:38.658298 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:38.658263    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"
Sep 17 00:28:38.658469 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:38.658304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq" event={"ID":"e22a78b3-ea3e-4899-86d6-50ba199c895f","Type":"ContainerDied","Data":"ab1af941a3114b47f67d728cf12c164ca3251581fea7a9b202e0a1ac0bcdab76"}
Sep 17 00:28:38.658469 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:38.658353    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab1af941a3114b47f67d728cf12c164ca3251581fea7a9b202e0a1ac0bcdab76"
Sep 17 00:28:45.547801 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:45.547758    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"]
Sep 17 00:28:45.551654 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:45.551626    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-f492a5-hvsvq"]
Sep 17 00:28:47.391368 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:47.391322    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e22a78b3-ea3e-4899-86d6-50ba199c895f" path="/var/lib/kubelet/pods/e22a78b3-ea3e-4899-86d6-50ba199c895f/volumes"
Sep 17 00:28:50.878431 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:28:50.878399    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"]
Sep 17 00:29:05.897645 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:05.897590    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb" podUID="04eea119-5cd8-4a6c-83a2-56dc60805046" containerName="main" containerID="cri-o://5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42" gracePeriod=45
Sep 17 00:29:06.158072 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.158002    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:29:06.270530 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.270497    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-df7rq\" (UniqueName: \"kubernetes.io/projected/04eea119-5cd8-4a6c-83a2-56dc60805046-kube-api-access-df7rq\") pod \"04eea119-5cd8-4a6c-83a2-56dc60805046\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") "
Sep 17 00:29:06.270684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.270583    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-tmp-dir\") pod \"04eea119-5cd8-4a6c-83a2-56dc60805046\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") "
Sep 17 00:29:06.270684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.270623    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-model-cache\") pod \"04eea119-5cd8-4a6c-83a2-56dc60805046\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") "
Sep 17 00:29:06.270684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.270653    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-dshm\") pod \"04eea119-5cd8-4a6c-83a2-56dc60805046\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") "
Sep 17 00:29:06.270684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.270677    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eea119-5cd8-4a6c-83a2-56dc60805046-tls-certs\") pod \"04eea119-5cd8-4a6c-83a2-56dc60805046\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") "
Sep 17 00:29:06.270842 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.270740    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-home\") pod \"04eea119-5cd8-4a6c-83a2-56dc60805046\" (UID: \"04eea119-5cd8-4a6c-83a2-56dc60805046\") "
Sep 17 00:29:06.270951 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.270889    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-model-cache" (OuterVolumeSpecName: "model-cache") pod "04eea119-5cd8-4a6c-83a2-56dc60805046" (UID: "04eea119-5cd8-4a6c-83a2-56dc60805046"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:29:06.271010 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.270931    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "04eea119-5cd8-4a6c-83a2-56dc60805046" (UID: "04eea119-5cd8-4a6c-83a2-56dc60805046"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:29:06.271074 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.271050    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-home" (OuterVolumeSpecName: "home") pod "04eea119-5cd8-4a6c-83a2-56dc60805046" (UID: "04eea119-5cd8-4a6c-83a2-56dc60805046"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:29:06.271331 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.271310    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-tmp-dir\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:06.271436 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.271335    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-model-cache\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:06.271436 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.271347    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-home\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:06.272814 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.272786    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04eea119-5cd8-4a6c-83a2-56dc60805046-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "04eea119-5cd8-4a6c-83a2-56dc60805046" (UID: "04eea119-5cd8-4a6c-83a2-56dc60805046"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:29:06.272938 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.272862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-dshm" (OuterVolumeSpecName: "dshm") pod "04eea119-5cd8-4a6c-83a2-56dc60805046" (UID: "04eea119-5cd8-4a6c-83a2-56dc60805046"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:29:06.272938 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.272862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04eea119-5cd8-4a6c-83a2-56dc60805046-kube-api-access-df7rq" (OuterVolumeSpecName: "kube-api-access-df7rq") pod "04eea119-5cd8-4a6c-83a2-56dc60805046" (UID: "04eea119-5cd8-4a6c-83a2-56dc60805046"). InnerVolumeSpecName "kube-api-access-df7rq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:29:06.372060 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.372034    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-df7rq\" (UniqueName: \"kubernetes.io/projected/04eea119-5cd8-4a6c-83a2-56dc60805046-kube-api-access-df7rq\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:06.372060 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.372058    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/04eea119-5cd8-4a6c-83a2-56dc60805046-dshm\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:06.372194 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.372068    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/04eea119-5cd8-4a6c-83a2-56dc60805046-tls-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:06.817942 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.817888    2565 generic.go:356] "Generic (PLEG): container finished" podID="04eea119-5cd8-4a6c-83a2-56dc60805046" containerID="5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42" exitCode=0
Sep 17 00:29:06.817942 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.817930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb" event={"ID":"04eea119-5cd8-4a6c-83a2-56dc60805046","Type":"ContainerDied","Data":"5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42"}
Sep 17 00:29:06.818155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.817960    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"
Sep 17 00:29:06.818155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.817979    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb" event={"ID":"04eea119-5cd8-4a6c-83a2-56dc60805046","Type":"ContainerDied","Data":"d89b809a1a437f48881136a122375058ce8d1735febdce79fd28c6e3c77722f3"}
Sep 17 00:29:06.818155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.818004    2565 scope.go:117] "RemoveContainer" containerID="5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42"
Sep 17 00:29:06.828288 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.828271    2565 scope.go:117] "RemoveContainer" containerID="5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42"
Sep 17 00:29:06.828554 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:29:06.828536    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42\": container with ID starting with 5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42 not found: ID does not exist" containerID="5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42"
Sep 17 00:29:06.828601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.828561    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42"} err="failed to get container status \"5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42\": rpc error: code = NotFound desc = could not find container \"5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42\": container with ID starting with 5fd1a138f4ad95bddf5595a8dec0a0d540f7079826aa358e1f7d3853571afc42 not found: ID does not exist"
Sep 17 00:29:06.841768 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.841746    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"]
Sep 17 00:29:06.843883 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:06.843861    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-f492a5/autores-model-f492a5-kserve-6b669f6995-9mdtb"]
Sep 17 00:29:07.390690 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:07.390653    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04eea119-5cd8-4a6c-83a2-56dc60805046" path="/var/lib/kubelet/pods/04eea119-5cd8-4a6c-83a2-56dc60805046/volumes"
Sep 17 00:29:24.918141 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:24.918043    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"]
Sep 17 00:29:24.918591 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:24.918292    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy" containerID="cri-o://58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800" gracePeriod=30
Sep 17 00:29:30.175119 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.175087    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:29:30.193271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193171    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-certs\") pod \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") "
Sep 17 00:29:30.193271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193233    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-podinfo\") pod \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") "
Sep 17 00:29:30.193271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193264    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-envoy\") pod \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") "
Sep 17 00:29:30.193523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193311    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-data\") pod \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") "
Sep 17 00:29:30.193523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193337    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-token\") pod \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") "
Sep 17 00:29:30.193523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193367    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-968ct\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-kube-api-access-968ct\") pod \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") "
Sep 17 00:29:30.193523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193399    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istiod-ca-cert\") pod \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") "
Sep 17 00:29:30.193523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193439    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-credential-socket\") pod \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") "
Sep 17 00:29:30.194423 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193527    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-socket\") pod \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\" (UID: \"beac0e0f-402b-4b04-beb0-46ecad1ff78e\") "
Sep 17 00:29:30.194423 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.193755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-data" (OuterVolumeSpecName: "istio-data") pod "beac0e0f-402b-4b04-beb0-46ecad1ff78e" (UID: "beac0e0f-402b-4b04-beb0-46ecad1ff78e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:29:30.194423 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.194284    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:30.194970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.194657    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "beac0e0f-402b-4b04-beb0-46ecad1ff78e" (UID: "beac0e0f-402b-4b04-beb0-46ecad1ff78e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:29:30.194970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.194654    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "beac0e0f-402b-4b04-beb0-46ecad1ff78e" (UID: "beac0e0f-402b-4b04-beb0-46ecad1ff78e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:29:30.194970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.194861    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "beac0e0f-402b-4b04-beb0-46ecad1ff78e" (UID: "beac0e0f-402b-4b04-beb0-46ecad1ff78e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:29:30.194970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.194963    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "beac0e0f-402b-4b04-beb0-46ecad1ff78e" (UID: "beac0e0f-402b-4b04-beb0-46ecad1ff78e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:29:30.196507 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.196457    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-kube-api-access-968ct" (OuterVolumeSpecName: "kube-api-access-968ct") pod "beac0e0f-402b-4b04-beb0-46ecad1ff78e" (UID: "beac0e0f-402b-4b04-beb0-46ecad1ff78e"). InnerVolumeSpecName "kube-api-access-968ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:29:30.197572 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.197456    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-token" (OuterVolumeSpecName: "istio-token") pod "beac0e0f-402b-4b04-beb0-46ecad1ff78e" (UID: "beac0e0f-402b-4b04-beb0-46ecad1ff78e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:29:30.197572 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.197521    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "beac0e0f-402b-4b04-beb0-46ecad1ff78e" (UID: "beac0e0f-402b-4b04-beb0-46ecad1ff78e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:29:30.197840 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.197810    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "beac0e0f-402b-4b04-beb0-46ecad1ff78e" (UID: "beac0e0f-402b-4b04-beb0-46ecad1ff78e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:29:30.295560 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.295518    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:30.295560 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.295560    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:30.295560 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.295569    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:30.295796 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.295578    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-968ct\" (UniqueName: \"kubernetes.io/projected/beac0e0f-402b-4b04-beb0-46ecad1ff78e-kube-api-access-968ct\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:30.295796 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.295588    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/beac0e0f-402b-4b04-beb0-46ecad1ff78e-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:30.295796 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.295599    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:30.295796 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.295610    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:30.295796 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.295619    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/beac0e0f-402b-4b04-beb0-46ecad1ff78e-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:29:30.959990 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.959954    2565 generic.go:356] "Generic (PLEG): container finished" podID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerID="58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800" exitCode=0
Sep 17 00:29:30.960152 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.960008    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"
Sep 17 00:29:30.960152 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.960030    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" event={"ID":"beac0e0f-402b-4b04-beb0-46ecad1ff78e","Type":"ContainerDied","Data":"58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800"}
Sep 17 00:29:30.960152 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.960079    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2" event={"ID":"beac0e0f-402b-4b04-beb0-46ecad1ff78e","Type":"ContainerDied","Data":"a3d6e6c6803fab5cddca4ea3d167dc92d6457de7fb6682195690fe7f54955aee"}
Sep 17 00:29:30.960152 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.960103    2565 scope.go:117] "RemoveContainer" containerID="58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800"
Sep 17 00:29:30.970404 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.970387    2565 scope.go:117] "RemoveContainer" containerID="ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81"
Sep 17 00:29:30.979455 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.979440    2565 scope.go:117] "RemoveContainer" containerID="58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800"
Sep 17 00:29:30.979693 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:29:30.979673    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800\": container with ID starting with 58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800 not found: ID does not exist" containerID="58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800"
Sep 17 00:29:30.979734 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.979702    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800"} err="failed to get container status \"58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800\": rpc error: code = NotFound desc = could not find container \"58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800\": container with ID starting with 58384996b463f94bddff384e62f67d2191cabd53f57935a65969262c7f3bd800 not found: ID does not exist"
Sep 17 00:29:30.979734 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.979717    2565 scope.go:117] "RemoveContainer" containerID="ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81"
Sep 17 00:29:30.980007 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:29:30.979987    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81\": container with ID starting with ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81 not found: ID does not exist" containerID="ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81"
Sep 17 00:29:30.980056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.980014    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81"} err="failed to get container status \"ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81\": rpc error: code = NotFound desc = could not find container \"ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81\": container with ID starting with ba48b189bf7df5110228ff98b628c627ca6706a14cb08743994a200a81be1b81 not found: ID does not exist"
Sep 17 00:29:30.983868 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.983847    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"]
Sep 17 00:29:30.987703 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:30.987683    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-f492a5-openshift-default-c55496f6-h9dc2"]
Sep 17 00:29:31.389585 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:31.389551    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" path="/var/lib/kubelet/pods/beac0e0f-402b-4b04-beb0-46ecad1ff78e/volumes"
Sep 17 00:29:33.984397 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.984363    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"]
Sep 17 00:29:33.984989 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.984950    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy"
Sep 17 00:29:33.984989 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.984973    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy"
Sep 17 00:29:33.985155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.985006    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e22a78b3-ea3e-4899-86d6-50ba199c895f" containerName="revoke-keys"
Sep 17 00:29:33.985155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.985012    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e22a78b3-ea3e-4899-86d6-50ba199c895f" containerName="revoke-keys"
Sep 17 00:29:33.985155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.985025    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04eea119-5cd8-4a6c-83a2-56dc60805046" containerName="main"
Sep 17 00:29:33.985155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.985032    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="04eea119-5cd8-4a6c-83a2-56dc60805046" containerName="main"
Sep 17 00:29:33.985155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.985122    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy"
Sep 17 00:29:33.985155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.985133    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e22a78b3-ea3e-4899-86d6-50ba199c895f" containerName="revoke-keys"
Sep 17 00:29:33.985155 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.985140    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="04eea119-5cd8-4a6c-83a2-56dc60805046" containerName="main"
Sep 17 00:29:33.989495 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.989479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:33.992071 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.992048    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2faea3\"/\"kube-root-ca.crt\""
Sep 17 00:29:33.993282 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.993260    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-2faea3\"/\"openshift-service-ca.crt\""
Sep 17 00:29:33.993394 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.993327    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2faea3\"/\"premium-w4-2faea3-kserve-self-signed-certs\""
Sep 17 00:29:33.993394 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.993367    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-2faea3\"/\"default-dockercfg-66bd9\""
Sep 17 00:29:33.997850 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:33.997828    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"]
Sep 17 00:29:34.031278 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.031253    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-dshm\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.031425 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.031288    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-model-cache\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.031425 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.031311    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fa0a282-e20b-4b70-b82b-61e232f9896b-tls-certs\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.031425 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.031375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-home\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.031425 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.031406    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw8l4\" (UniqueName: \"kubernetes.io/projected/9fa0a282-e20b-4b70-b82b-61e232f9896b-kube-api-access-xw8l4\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.031589 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.031452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-tmp-dir\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.132483 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.132459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-dshm\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.132617 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.132494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-model-cache\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.132617 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.132517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fa0a282-e20b-4b70-b82b-61e232f9896b-tls-certs\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.132617 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.132546    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-home\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.132617 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.132577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw8l4\" (UniqueName: \"kubernetes.io/projected/9fa0a282-e20b-4b70-b82b-61e232f9896b-kube-api-access-xw8l4\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.132819 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.132645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-tmp-dir\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.133001 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.132973    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-model-cache\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.133122 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.133040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-home\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.133122 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.133078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-tmp-dir\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.134741 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.134723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-dshm\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.134887 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.134870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fa0a282-e20b-4b70-b82b-61e232f9896b-tls-certs\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.140250 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.140231    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw8l4\" (UniqueName: \"kubernetes.io/projected/9fa0a282-e20b-4b70-b82b-61e232f9896b-kube-api-access-xw8l4\") pod \"premium-w4-2faea3-kserve-6f9cc868c4-92jl2\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") " pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.300135 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.300041    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:34.569235 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.569163    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"]
Sep 17 00:29:34.571618 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:29:34.571594    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fa0a282_e20b_4b70_b82b_61e232f9896b.slice/crio-9bcc2cb3095467e940bca79c30890c1576d77ca3edc6360c604adc52d1649949 WatchSource:0}: Error finding container 9bcc2cb3095467e940bca79c30890c1576d77ca3edc6360c604adc52d1649949: Status 404 returned error can't find the container with id 9bcc2cb3095467e940bca79c30890c1576d77ca3edc6360c604adc52d1649949
Sep 17 00:29:34.985148 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.985107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2" event={"ID":"9fa0a282-e20b-4b70-b82b-61e232f9896b","Type":"ContainerStarted","Data":"7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244"}
Sep 17 00:29:34.985520 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:34.985157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2" event={"ID":"9fa0a282-e20b-4b70-b82b-61e232f9896b","Type":"ContainerStarted","Data":"9bcc2cb3095467e940bca79c30890c1576d77ca3edc6360c604adc52d1649949"}
Sep 17 00:29:35.002494 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:35.002449    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2" podStartSLOduration=2.002433995 podStartE2EDuration="2.002433995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:29:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:29:35.000213362 +0000 UTC m=+1176.108989302" watchObservedRunningTime="2026-09-17 00:29:35.002433995 +0000 UTC m=+1176.111209910"
Sep 17 00:29:44.300317 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:44.300278    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:44.300748 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:44.300334    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:44.313160 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:44.313136    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:45.052199 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:45.052168    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:29:53.807824 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.807779    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"]
Sep 17 00:29:53.808617 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.808596    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy"
Sep 17 00:29:53.808679 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.808622    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy"
Sep 17 00:29:53.808749 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.808738    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="beac0e0f-402b-4b04-beb0-46ecad1ff78e" containerName="istio-proxy"
Sep 17 00:29:53.812584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.812542    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:53.818451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.818423    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a146d6\"/\"test-model-a146d6-kserve-self-signed-certs\""
Sep 17 00:29:53.818584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.818526    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a146d6\"/\"default-dockercfg-7xddn\""
Sep 17 00:29:53.818694 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.818670    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a146d6\"/\"openshift-service-ca.crt\""
Sep 17 00:29:53.818820 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.818761    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a146d6\"/\"kube-root-ca.crt\""
Sep 17 00:29:53.824856 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.824826    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"]
Sep 17 00:29:53.923221 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.923187    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mccjj\" (UniqueName: \"kubernetes.io/projected/8f32f757-8101-4aee-bc0b-ef93ec2970d0-kube-api-access-mccjj\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:53.923426 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.923234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tmp-dir\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:53.923426 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.923260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tls-certs\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:53.923426 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.923381    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-home\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:53.923612 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.923440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-model-cache\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:53.923612 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:53.923473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-dshm\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.024240 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.024211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mccjj\" (UniqueName: \"kubernetes.io/projected/8f32f757-8101-4aee-bc0b-ef93ec2970d0-kube-api-access-mccjj\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.024240 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.024244    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tmp-dir\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.024502 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.024264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tls-certs\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.024502 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.024334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-home\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.024502 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.024362    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-model-cache\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.024502 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.024390    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-dshm\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.024746 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.024723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tmp-dir\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.024788 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.024750    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-home\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.024834 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.024761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-model-cache\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.026686 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.026662    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-dshm\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.026852 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.026836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tls-certs\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.031758 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.031735    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mccjj\" (UniqueName: \"kubernetes.io/projected/8f32f757-8101-4aee-bc0b-ef93ec2970d0-kube-api-access-mccjj\") pod \"test-model-a146d6-kserve-766d9877cc-flsbv\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") " pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.125641 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.125606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:29:54.400339 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:54.400314    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"]
Sep 17 00:29:54.402285 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:29:54.402257    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8f32f757_8101_4aee_bc0b_ef93ec2970d0.slice/crio-bdb4fe34ccf9a00b5d42eb0e1d2952ae7dd7fcb38435bb700333e7e5e9bf8603 WatchSource:0}: Error finding container bdb4fe34ccf9a00b5d42eb0e1d2952ae7dd7fcb38435bb700333e7e5e9bf8603: Status 404 returned error can't find the container with id bdb4fe34ccf9a00b5d42eb0e1d2952ae7dd7fcb38435bb700333e7e5e9bf8603
Sep 17 00:29:55.101345 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:55.101301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv" event={"ID":"8f32f757-8101-4aee-bc0b-ef93ec2970d0","Type":"ContainerStarted","Data":"9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e"}
Sep 17 00:29:55.101710 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:55.101354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv" event={"ID":"8f32f757-8101-4aee-bc0b-ef93ec2970d0","Type":"ContainerStarted","Data":"bdb4fe34ccf9a00b5d42eb0e1d2952ae7dd7fcb38435bb700333e7e5e9bf8603"}
Sep 17 00:29:55.119879 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:55.119825    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv" podStartSLOduration=2.119810074 podStartE2EDuration="2.119810074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:29:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:29:55.118394443 +0000 UTC m=+1196.227170358" watchObservedRunningTime="2026-09-17 00:29:55.119810074 +0000 UTC m=+1196.228585988"
Sep 17 00:29:59.398769 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:59.398740    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:29:59.402458 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:29:59.402436    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:30:00.135310 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.135276    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p"]
Sep 17 00:30:00.140775 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.140752    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn"]
Sep 17 00:30:00.140929 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.140880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p"
Sep 17 00:30:00.143465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.143440    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:30:00.144295 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.144271    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk"]
Sep 17 00:30:00.144577 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.144560    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn"
Sep 17 00:30:00.151979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.148275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn"]
Sep 17 00:30:00.151979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.148375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk"
Sep 17 00:30:00.151979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.148887    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p"]
Sep 17 00:30:00.152844 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.152253    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk"]
Sep 17 00:30:00.158771 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.158751    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh"]
Sep 17 00:30:00.163184 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.163166    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh"
Sep 17 00:30:00.165253 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.165237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p"
Sep 17 00:30:00.172522 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.172505    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh"]
Sep 17 00:30:00.176847 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.176827    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn"
Sep 17 00:30:00.213240 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.212657    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk"
Sep 17 00:30:00.223528 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.222747    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh"
Sep 17 00:30:00.451473 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.451442    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p"]
Sep 17 00:30:00.453207 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:30:00.453175    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be54c36_6895_4721_948c_2b7b9002a730.slice/crio-3e04767c013b126d80031e2d892b456f615ba5843f81a286140f40644922291f WatchSource:0}: Error finding container 3e04767c013b126d80031e2d892b456f615ba5843f81a286140f40644922291f: Status 404 returned error can't find the container with id 3e04767c013b126d80031e2d892b456f615ba5843f81a286140f40644922291f
Sep 17 00:30:00.464015 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.463991    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn"]
Sep 17 00:30:00.467108 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:30:00.467084    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1a72094_f1c5_4792_ad2e_3fab3a66972d.slice/crio-6f0bdbed110b7c1034d7cf70761983f241c27d80c77ee41a7d7bbe47c92b1d56 WatchSource:0}: Error finding container 6f0bdbed110b7c1034d7cf70761983f241c27d80c77ee41a7d7bbe47c92b1d56: Status 404 returned error can't find the container with id 6f0bdbed110b7c1034d7cf70761983f241c27d80c77ee41a7d7bbe47c92b1d56
Sep 17 00:30:00.515369 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.515349    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk"]
Sep 17 00:30:00.517660 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:30:00.517636    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3223f659_4815_47a7_a7ec_81cbcbbfe84c.slice/crio-2d00ee6a453e345d6c032278cdda01d70d7e02fe557730e2a657f020cd5255a4 WatchSource:0}: Error finding container 2d00ee6a453e345d6c032278cdda01d70d7e02fe557730e2a657f020cd5255a4: Status 404 returned error can't find the container with id 2d00ee6a453e345d6c032278cdda01d70d7e02fe557730e2a657f020cd5255a4
Sep 17 00:30:00.536380 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:00.536360    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh"]
Sep 17 00:30:00.537216 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:30:00.537196    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0f88aaf_4def_445d_a031_02fcf66b550a.slice/crio-45253cb3f1017fcbce3e5e1ddcc9a29e95d944fb4fb7654262c99aa1086861fc WatchSource:0}: Error finding container 45253cb3f1017fcbce3e5e1ddcc9a29e95d944fb4fb7654262c99aa1086861fc: Status 404 returned error can't find the container with id 45253cb3f1017fcbce3e5e1ddcc9a29e95d944fb4fb7654262c99aa1086861fc
Sep 17 00:30:01.138377 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.138343    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh" event={"ID":"c0f88aaf-4def-445d-a031-02fcf66b550a","Type":"ContainerStarted","Data":"7ecf0c572ba439b65060b1dcc021dd6654f49789266e6699df1c0074b2da6716"}
Sep 17 00:30:01.138601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.138395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh" event={"ID":"c0f88aaf-4def-445d-a031-02fcf66b550a","Type":"ContainerStarted","Data":"45253cb3f1017fcbce3e5e1ddcc9a29e95d944fb4fb7654262c99aa1086861fc"}
Sep 17 00:30:01.139874 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.139848    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p" event={"ID":"6be54c36-6895-4721-948c-2b7b9002a730","Type":"ContainerStarted","Data":"f22629060c8f2d2382952c1200e2622ac3bae6ddb05982ba86a2bc001da38aa9"}
Sep 17 00:30:01.139996 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.139913    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p" event={"ID":"6be54c36-6895-4721-948c-2b7b9002a730","Type":"ContainerStarted","Data":"3e04767c013b126d80031e2d892b456f615ba5843f81a286140f40644922291f"}
Sep 17 00:30:01.141363 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.141341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk" event={"ID":"3223f659-4815-47a7-a7ec-81cbcbbfe84c","Type":"ContainerStarted","Data":"e3428c432e50ef7e4fadcf00da7e045038487aa6bafa4a4012ce1677623ee76d"}
Sep 17 00:30:01.141433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.141377    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk" event={"ID":"3223f659-4815-47a7-a7ec-81cbcbbfe84c","Type":"ContainerStarted","Data":"2d00ee6a453e345d6c032278cdda01d70d7e02fe557730e2a657f020cd5255a4"}
Sep 17 00:30:01.142869 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.142849    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn" event={"ID":"a1a72094-f1c5-4792-ad2e-3fab3a66972d","Type":"ContainerStarted","Data":"6bafcad615c9c8c6fae192ac9689f1825452003b32f449f2202ff1bbd01034ce"}
Sep 17 00:30:01.143005 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.142892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn" event={"ID":"a1a72094-f1c5-4792-ad2e-3fab3a66972d","Type":"ContainerStarted","Data":"6f0bdbed110b7c1034d7cf70761983f241c27d80c77ee41a7d7bbe47c92b1d56"}
Sep 17 00:30:01.154162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.154118    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh" podStartSLOduration=1.15410516 podStartE2EDuration="1.15410516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:01.152309974 +0000 UTC m=+1202.261085891" watchObservedRunningTime="2026-09-17 00:30:01.15410516 +0000 UTC m=+1202.262881074"
Sep 17 00:30:01.166940 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.166868    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk" podStartSLOduration=1.166857499 podStartE2EDuration="1.166857499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:01.165754561 +0000 UTC m=+1202.274530479" watchObservedRunningTime="2026-09-17 00:30:01.166857499 +0000 UTC m=+1202.275633413"
Sep 17 00:30:01.180535 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.180494    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn" podStartSLOduration=1.180477559 podStartE2EDuration="1.180477559s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:01.178981634 +0000 UTC m=+1202.287757563" watchObservedRunningTime="2026-09-17 00:30:01.180477559 +0000 UTC m=+1202.289253496"
Sep 17 00:30:01.193727 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:01.193685    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p" podStartSLOduration=1.193671465 podStartE2EDuration="1.193671465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:01.192405341 +0000 UTC m=+1202.301181255" watchObservedRunningTime="2026-09-17 00:30:01.193671465 +0000 UTC m=+1202.302447413"
Sep 17 00:30:02.150260 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:02.150223    2565 generic.go:356] "Generic (PLEG): container finished" podID="c0f88aaf-4def-445d-a031-02fcf66b550a" containerID="7ecf0c572ba439b65060b1dcc021dd6654f49789266e6699df1c0074b2da6716" exitCode=0
Sep 17 00:30:02.150648 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:02.150310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh" event={"ID":"c0f88aaf-4def-445d-a031-02fcf66b550a","Type":"ContainerDied","Data":"7ecf0c572ba439b65060b1dcc021dd6654f49789266e6699df1c0074b2da6716"}
Sep 17 00:30:02.152034 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:02.152009    2565 generic.go:356] "Generic (PLEG): container finished" podID="6be54c36-6895-4721-948c-2b7b9002a730" containerID="f22629060c8f2d2382952c1200e2622ac3bae6ddb05982ba86a2bc001da38aa9" exitCode=0
Sep 17 00:30:02.152115 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:02.152094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p" event={"ID":"6be54c36-6895-4721-948c-2b7b9002a730","Type":"ContainerDied","Data":"f22629060c8f2d2382952c1200e2622ac3bae6ddb05982ba86a2bc001da38aa9"}
Sep 17 00:30:02.153589 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:02.153565    2565 generic.go:356] "Generic (PLEG): container finished" podID="3223f659-4815-47a7-a7ec-81cbcbbfe84c" containerID="e3428c432e50ef7e4fadcf00da7e045038487aa6bafa4a4012ce1677623ee76d" exitCode=0
Sep 17 00:30:02.153679 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:02.153650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk" event={"ID":"3223f659-4815-47a7-a7ec-81cbcbbfe84c","Type":"ContainerDied","Data":"e3428c432e50ef7e4fadcf00da7e045038487aa6bafa4a4012ce1677623ee76d"}
Sep 17 00:30:02.155137 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:02.155115    2565 generic.go:356] "Generic (PLEG): container finished" podID="a1a72094-f1c5-4792-ad2e-3fab3a66972d" containerID="6bafcad615c9c8c6fae192ac9689f1825452003b32f449f2202ff1bbd01034ce" exitCode=0
Sep 17 00:30:02.155220 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:02.155164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn" event={"ID":"a1a72094-f1c5-4792-ad2e-3fab3a66972d","Type":"ContainerDied","Data":"6bafcad615c9c8c6fae192ac9689f1825452003b32f449f2202ff1bbd01034ce"}
Sep 17 00:30:03.312608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:03.312587    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn"
Sep 17 00:30:03.357622 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:03.357591    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p"
Sep 17 00:30:03.397304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:03.397275    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh"
Sep 17 00:30:03.401351 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:03.401330    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk"
Sep 17 00:30:04.126369 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.126332    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:30:04.126566 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.126390    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:30:04.138656 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.138632    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:30:04.168990 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.168958    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh" event={"ID":"c0f88aaf-4def-445d-a031-02fcf66b550a","Type":"ContainerDied","Data":"45253cb3f1017fcbce3e5e1ddcc9a29e95d944fb4fb7654262c99aa1086861fc"}
Sep 17 00:30:04.169132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.169003    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45253cb3f1017fcbce3e5e1ddcc9a29e95d944fb4fb7654262c99aa1086861fc"
Sep 17 00:30:04.169132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.168967    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh"
Sep 17 00:30:04.170364 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.170336    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p"
Sep 17 00:30:04.170476 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.170380    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p" event={"ID":"6be54c36-6895-4721-948c-2b7b9002a730","Type":"ContainerDied","Data":"3e04767c013b126d80031e2d892b456f615ba5843f81a286140f40644922291f"}
Sep 17 00:30:04.170476 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.170426    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e04767c013b126d80031e2d892b456f615ba5843f81a286140f40644922291f"
Sep 17 00:30:04.171804 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.171778    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk"
Sep 17 00:30:04.171947 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.171803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk" event={"ID":"3223f659-4815-47a7-a7ec-81cbcbbfe84c","Type":"ContainerDied","Data":"2d00ee6a453e345d6c032278cdda01d70d7e02fe557730e2a657f020cd5255a4"}
Sep 17 00:30:04.171947 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.171838    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d00ee6a453e345d6c032278cdda01d70d7e02fe557730e2a657f020cd5255a4"
Sep 17 00:30:04.173750 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.173729    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn" event={"ID":"a1a72094-f1c5-4792-ad2e-3fab3a66972d","Type":"ContainerDied","Data":"6f0bdbed110b7c1034d7cf70761983f241c27d80c77ee41a7d7bbe47c92b1d56"}
Sep 17 00:30:04.173863 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.173749    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826750-c22bn"
Sep 17 00:30:04.173863 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.173772    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f0bdbed110b7c1034d7cf70761983f241c27d80c77ee41a7d7bbe47c92b1d56"
Sep 17 00:30:04.187920 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:04.187882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:30:10.093687 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.093653    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"]
Sep 17 00:30:10.094372 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094351    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be54c36-6895-4721-948c-2b7b9002a730" containerName="cleanup"
Sep 17 00:30:10.094465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094374    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be54c36-6895-4721-948c-2b7b9002a730" containerName="cleanup"
Sep 17 00:30:10.094465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094387    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3223f659-4815-47a7-a7ec-81cbcbbfe84c" containerName="cleanup"
Sep 17 00:30:10.094465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094395    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3223f659-4815-47a7-a7ec-81cbcbbfe84c" containerName="cleanup"
Sep 17 00:30:10.094465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094414    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1a72094-f1c5-4792-ad2e-3fab3a66972d" containerName="cleanup"
Sep 17 00:30:10.094465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094422    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1a72094-f1c5-4792-ad2e-3fab3a66972d" containerName="cleanup"
Sep 17 00:30:10.094465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094439    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0f88aaf-4def-445d-a031-02fcf66b550a" containerName="cleanup"
Sep 17 00:30:10.094465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094447    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0f88aaf-4def-445d-a031-02fcf66b550a" containerName="cleanup"
Sep 17 00:30:10.094807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094579    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1a72094-f1c5-4792-ad2e-3fab3a66972d" containerName="cleanup"
Sep 17 00:30:10.094807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094596    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0f88aaf-4def-445d-a031-02fcf66b550a" containerName="cleanup"
Sep 17 00:30:10.094807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094609    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be54c36-6895-4721-948c-2b7b9002a730" containerName="cleanup"
Sep 17 00:30:10.094807 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.094620    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3223f659-4815-47a7-a7ec-81cbcbbfe84c" containerName="cleanup"
Sep 17 00:30:10.098090 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.098069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.100502 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.100482    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-44007f60-openshift-default-dockercfg-bmkq2\""
Sep 17 00:30:10.108178 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.108154    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"]
Sep 17 00:30:10.190606 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.190551    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-podinfo\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.190606 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.190607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxwjc\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-kube-api-access-nxwjc\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.190930 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.190691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istiod-ca-cert\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.190930 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.190734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-socket\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.190930 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.190768    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-credential-socket\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.190930 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.190835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-envoy\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.191134 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.190960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-data\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.191134 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.191029    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-token\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.191134 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.191062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-certs\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292256 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-data\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-token\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292368    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-certs\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-podinfo\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxwjc\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-kube-api-access-nxwjc\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292667 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istiod-ca-cert\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292667 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292609    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-socket\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292667 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-data\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292667 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-credential-socket\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.292872 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-envoy\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.293023 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.292980    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-socket\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.293143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.293049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-credential-socket\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.293143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.293049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-certs\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.293317 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.293295    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istiod-ca-cert\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.294813 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.294793    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-podinfo\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.294921 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.294863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-envoy\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.300387 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.300365    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxwjc\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-kube-api-access-nxwjc\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.300556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.300539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-token\") pod \"e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") " pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.410295 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.410209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:10.745312 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.745140    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"]
Sep 17 00:30:10.747332 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.746460    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:30:10.747332 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.746609    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:30:10.747332 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:10.746695    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:30:11.219453 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:11.219417    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" event={"ID":"4dab5770-b9a3-4e33-a4b5-3e42912f5092","Type":"ContainerStarted","Data":"3761852529b8ea98c2db539831085017198b0eb40e53b64f134b63b77d497bfe"}
Sep 17 00:30:11.219844 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:11.219484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" event={"ID":"4dab5770-b9a3-4e33-a4b5-3e42912f5092","Type":"ContainerStarted","Data":"aa713e9d3f9d2401fa5152835fdf2cc6a254d5c53f2b297583cb079bf5987849"}
Sep 17 00:30:11.243310 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:11.243263    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" podStartSLOduration=1.243247321 podStartE2EDuration="1.243247321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:30:11.240104889 +0000 UTC m=+1212.348880836" watchObservedRunningTime="2026-09-17 00:30:11.243247321 +0000 UTC m=+1212.352023236"
Sep 17 00:30:11.410687 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:11.410658    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:11.415619 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:11.415581    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:12.226376 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:12.226344    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:12.227371 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:12.227352    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:43.268112 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:43.268069    2565 patch_prober.go:28] interesting pod/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 17 00:30:43.268497 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:43.268157    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 17 00:30:44.422932 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:44.422845    2565 generic.go:356] "Generic (PLEG): container finished" podID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerID="3761852529b8ea98c2db539831085017198b0eb40e53b64f134b63b77d497bfe" exitCode=0
Sep 17 00:30:44.422932 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:44.422921    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" event={"ID":"4dab5770-b9a3-4e33-a4b5-3e42912f5092","Type":"ContainerDied","Data":"3761852529b8ea98c2db539831085017198b0eb40e53b64f134b63b77d497bfe"}
Sep 17 00:30:44.423373 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:44.423357    2565 scope.go:117] "RemoveContainer" containerID="3761852529b8ea98c2db539831085017198b0eb40e53b64f134b63b77d497bfe"
Sep 17 00:30:44.424654 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:44.424627    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:30:44.424732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:44.424711    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:30:44.424769 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:44.424744    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:30:45.432069 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:45.432033    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" event={"ID":"4dab5770-b9a3-4e33-a4b5-3e42912f5092","Type":"ContainerStarted","Data":"d284789fb631ac714a761dfe14bebbb460d8232d845dce518771cf167a36c7eb"}
Sep 17 00:30:46.410570 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:46.410537    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:46.410844 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:46.410821    2565 patch_prober.go:28] interesting pod/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:30:46.410986 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:46.410877    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 00:30:47.410516 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:47.410480    2565 patch_prober.go:28] interesting pod/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:30:47.410933 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:47.410542    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 00:30:48.410735 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:48.410699    2565 patch_prober.go:28] interesting pod/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:30:48.411148 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:48.410755    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 00:30:49.410991 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:49.410958    2565 patch_prober.go:28] interesting pod/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:30:49.411362 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:49.411007    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 00:30:50.411563 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:50.411519    2565 patch_prober.go:28] interesting pod/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 17 00:30:50.412039 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:50.411592    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 17 00:30:51.414732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:51.414702    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:51.415244 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:51.415141    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:51.415832 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:51.415809    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:30:52.927220 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:52.927120    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"]
Sep 17 00:30:52.932627 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:52.932602    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"
Sep 17 00:30:52.936489 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:52.936228    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:30:52.937853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:52.937824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"]
Sep 17 00:30:53.033427 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:53.033394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3288e4b8-40ba-4772-94bc-8206356e08cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-44007f60-dddq9\" (UID: \"3288e4b8-40ba-4772-94bc-8206356e08cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"
Sep 17 00:30:53.134872 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:53.134834    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3288e4b8-40ba-4772-94bc-8206356e08cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-44007f60-dddq9\" (UID: \"3288e4b8-40ba-4772-94bc-8206356e08cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"
Sep 17 00:30:53.135463 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:53.135443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3288e4b8-40ba-4772-94bc-8206356e08cb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-44007f60-dddq9\" (UID: \"3288e4b8-40ba-4772-94bc-8206356e08cb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"
Sep 17 00:30:53.246359 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:53.246276    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"
Sep 17 00:30:53.516639 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:53.516602    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"]
Sep 17 00:30:53.518402 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:30:53.518380    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3288e4b8_40ba_4772_94bc_8206356e08cb.slice/crio-76210b23c981b0b380ab636e0c0878634c1360c08f5e12182091f445a7339917 WatchSource:0}: Error finding container 76210b23c981b0b380ab636e0c0878634c1360c08f5e12182091f445a7339917: Status 404 returned error can't find the container with id 76210b23c981b0b380ab636e0c0878634c1360c08f5e12182091f445a7339917
Sep 17 00:30:54.501489 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:54.501445    2565 generic.go:356] "Generic (PLEG): container finished" podID="3288e4b8-40ba-4772-94bc-8206356e08cb" containerID="862cda38b90d5219b183e679e49ed856ec25706546d1ba93395f161a8617b2fb" exitCode=0
Sep 17 00:30:54.501856 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:54.501503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9" event={"ID":"3288e4b8-40ba-4772-94bc-8206356e08cb","Type":"ContainerDied","Data":"862cda38b90d5219b183e679e49ed856ec25706546d1ba93395f161a8617b2fb"}
Sep 17 00:30:54.501856 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:54.501554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9" event={"ID":"3288e4b8-40ba-4772-94bc-8206356e08cb","Type":"ContainerStarted","Data":"76210b23c981b0b380ab636e0c0878634c1360c08f5e12182091f445a7339917"}
Sep 17 00:30:55.644783 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:55.644760    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"
Sep 17 00:30:55.764340 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:55.764266    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3288e4b8-40ba-4772-94bc-8206356e08cb-maas-api-service-ca\") pod \"3288e4b8-40ba-4772-94bc-8206356e08cb\" (UID: \"3288e4b8-40ba-4772-94bc-8206356e08cb\") "
Sep 17 00:30:55.764654 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:55.764631    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3288e4b8-40ba-4772-94bc-8206356e08cb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3288e4b8-40ba-4772-94bc-8206356e08cb" (UID: "3288e4b8-40ba-4772-94bc-8206356e08cb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:30:55.865768 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:55.865724    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3288e4b8-40ba-4772-94bc-8206356e08cb-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:30:56.515639 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:56.515607    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"
Sep 17 00:30:56.515819 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:56.515643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9" event={"ID":"3288e4b8-40ba-4772-94bc-8206356e08cb","Type":"ContainerDied","Data":"76210b23c981b0b380ab636e0c0878634c1360c08f5e12182091f445a7339917"}
Sep 17 00:30:56.515819 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:30:56.515690    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76210b23c981b0b380ab636e0c0878634c1360c08f5e12182091f445a7339917"
Sep 17 00:31:03.717452 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:03.717409    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"]
Sep 17 00:31:03.719888 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:03.719862    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44007f60-dddq9"]
Sep 17 00:31:05.389971 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:05.389935    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3288e4b8-40ba-4772-94bc-8206356e08cb" path="/var/lib/kubelet/pods/3288e4b8-40ba-4772-94bc-8206356e08cb/volumes"
Sep 17 00:31:10.387441 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:10.387405    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"]
Sep 17 00:31:10.387865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:10.387635    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy" containerID="cri-o://d284789fb631ac714a761dfe14bebbb460d8232d845dce518771cf167a36c7eb" gracePeriod=30
Sep 17 00:31:15.634198 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.634169    2565 generic.go:356] "Generic (PLEG): container finished" podID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerID="d284789fb631ac714a761dfe14bebbb460d8232d845dce518771cf167a36c7eb" exitCode=0
Sep 17 00:31:15.634556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.634242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" event={"ID":"4dab5770-b9a3-4e33-a4b5-3e42912f5092","Type":"ContainerDied","Data":"d284789fb631ac714a761dfe14bebbb460d8232d845dce518771cf167a36c7eb"}
Sep 17 00:31:15.634556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.634296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb" event={"ID":"4dab5770-b9a3-4e33-a4b5-3e42912f5092","Type":"ContainerDied","Data":"aa713e9d3f9d2401fa5152835fdf2cc6a254d5c53f2b297583cb079bf5987849"}
Sep 17 00:31:15.634556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.634313    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa713e9d3f9d2401fa5152835fdf2cc6a254d5c53f2b297583cb079bf5987849"
Sep 17 00:31:15.634556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.634327    2565 scope.go:117] "RemoveContainer" containerID="3761852529b8ea98c2db539831085017198b0eb40e53b64f134b63b77d497bfe"
Sep 17 00:31:15.644027 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.644003    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:31:15.747483 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.747400    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"]
Sep 17 00:31:15.747974 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.747955    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy"
Sep 17 00:31:15.747974 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.747974    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy"
Sep 17 00:31:15.748143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.747990    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy"
Sep 17 00:31:15.748143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.747998    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy"
Sep 17 00:31:15.748143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.748020    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3288e4b8-40ba-4772-94bc-8206356e08cb" containerName="revoke-keys"
Sep 17 00:31:15.748143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.748029    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3288e4b8-40ba-4772-94bc-8206356e08cb" containerName="revoke-keys"
Sep 17 00:31:15.748350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.748185    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3288e4b8-40ba-4772-94bc-8206356e08cb" containerName="revoke-keys"
Sep 17 00:31:15.748350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.748198    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy"
Sep 17 00:31:15.748350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.748212    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" containerName="istio-proxy"
Sep 17 00:31:15.750887 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.750865    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"
Sep 17 00:31:15.753603 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.753566    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:31:15.758153 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.758129    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"]
Sep 17 00:31:15.759823 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.759791    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-podinfo\") pod \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") "
Sep 17 00:31:15.759959 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.759846    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-credential-socket\") pod \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") "
Sep 17 00:31:15.759959 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.759886    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-envoy\") pod \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") "
Sep 17 00:31:15.760094 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.759983    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istiod-ca-cert\") pod \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") "
Sep 17 00:31:15.760094 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.760035    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-socket\") pod \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") "
Sep 17 00:31:15.760094 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.760080    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-certs\") pod \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") "
Sep 17 00:31:15.760260 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.760118    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-data\") pod \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") "
Sep 17 00:31:15.760260 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.760219    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-token\") pod \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") "
Sep 17 00:31:15.760260 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.760257    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxwjc\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-kube-api-access-nxwjc\") pod \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\" (UID: \"4dab5770-b9a3-4e33-a4b5-3e42912f5092\") "
Sep 17 00:31:15.761594 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.761242    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4dab5770-b9a3-4e33-a4b5-3e42912f5092" (UID: "4dab5770-b9a3-4e33-a4b5-3e42912f5092"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:31:15.761594 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.761364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4dab5770-b9a3-4e33-a4b5-3e42912f5092" (UID: "4dab5770-b9a3-4e33-a4b5-3e42912f5092"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:31:15.761594 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.761442    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-data" (OuterVolumeSpecName: "istio-data") pod "4dab5770-b9a3-4e33-a4b5-3e42912f5092" (UID: "4dab5770-b9a3-4e33-a4b5-3e42912f5092"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:31:15.767263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.763127    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4dab5770-b9a3-4e33-a4b5-3e42912f5092" (UID: "4dab5770-b9a3-4e33-a4b5-3e42912f5092"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:31:15.767263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.764263    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4dab5770-b9a3-4e33-a4b5-3e42912f5092" (UID: "4dab5770-b9a3-4e33-a4b5-3e42912f5092"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:31:15.767263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.764877    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:15.767263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.764926    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:15.767263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.764939    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:15.767263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.766943    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-kube-api-access-nxwjc" (OuterVolumeSpecName: "kube-api-access-nxwjc") pod "4dab5770-b9a3-4e33-a4b5-3e42912f5092" (UID: "4dab5770-b9a3-4e33-a4b5-3e42912f5092"). InnerVolumeSpecName "kube-api-access-nxwjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:31:15.767716 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.767694    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4dab5770-b9a3-4e33-a4b5-3e42912f5092" (UID: "4dab5770-b9a3-4e33-a4b5-3e42912f5092"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:31:15.768441 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.768400    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4dab5770-b9a3-4e33-a4b5-3e42912f5092" (UID: "4dab5770-b9a3-4e33-a4b5-3e42912f5092"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:31:15.769457 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.769431    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-token" (OuterVolumeSpecName: "istio-token") pod "4dab5770-b9a3-4e33-a4b5-3e42912f5092" (UID: "4dab5770-b9a3-4e33-a4b5-3e42912f5092"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:31:15.866050 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.866010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/febfae28-c07d-499a-8500-c7f7990cf6d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk\" (UID: \"febfae28-c07d-499a-8500-c7f7990cf6d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"
Sep 17 00:31:15.866222 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.866167    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:15.866222 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.866184    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxwjc\" (UniqueName: \"kubernetes.io/projected/4dab5770-b9a3-4e33-a4b5-3e42912f5092-kube-api-access-nxwjc\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:15.866222 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.866196    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:15.866222 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.866210    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:15.866373 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.866223    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4dab5770-b9a3-4e33-a4b5-3e42912f5092-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:15.866373 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.866236    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4dab5770-b9a3-4e33-a4b5-3e42912f5092-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:15.967361 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.967327    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/febfae28-c07d-499a-8500-c7f7990cf6d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk\" (UID: \"febfae28-c07d-499a-8500-c7f7990cf6d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"
Sep 17 00:31:15.968127 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:15.968100    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/febfae28-c07d-499a-8500-c7f7990cf6d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk\" (UID: \"febfae28-c07d-499a-8500-c7f7990cf6d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"
Sep 17 00:31:16.067736 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:16.067662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"
Sep 17 00:31:16.336149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:16.336125    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"]
Sep 17 00:31:16.338059 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:31:16.338036    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfebfae28_c07d_499a_8500_c7f7990cf6d1.slice/crio-49129f69c17acf20fd35edfdbff9379295ba549dd2939d21da260692cc03f08a WatchSource:0}: Error finding container 49129f69c17acf20fd35edfdbff9379295ba549dd2939d21da260692cc03f08a: Status 404 returned error can't find the container with id 49129f69c17acf20fd35edfdbff9379295ba549dd2939d21da260692cc03f08a
Sep 17 00:31:16.642816 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:16.641754    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"
Sep 17 00:31:16.643844 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:16.643796    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk" event={"ID":"febfae28-c07d-499a-8500-c7f7990cf6d1","Type":"ContainerStarted","Data":"49129f69c17acf20fd35edfdbff9379295ba549dd2939d21da260692cc03f08a"}
Sep 17 00:31:16.676925 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:16.676881    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"]
Sep 17 00:31:16.680388 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:16.680365    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-44007f60-openshift-default-d97d4d88d-7g9tb"]
Sep 17 00:31:17.390451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:17.390413    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4dab5770-b9a3-4e33-a4b5-3e42912f5092" path="/var/lib/kubelet/pods/4dab5770-b9a3-4e33-a4b5-3e42912f5092/volumes"
Sep 17 00:31:17.651857 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:17.651820    2565 generic.go:356] "Generic (PLEG): container finished" podID="febfae28-c07d-499a-8500-c7f7990cf6d1" containerID="f53b7751e00535d94d0f25afdf74ee0ecf2c38bb59f593a87ed3932ac1634886" exitCode=0
Sep 17 00:31:17.652255 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:17.651865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk" event={"ID":"febfae28-c07d-499a-8500-c7f7990cf6d1","Type":"ContainerDied","Data":"f53b7751e00535d94d0f25afdf74ee0ecf2c38bb59f593a87ed3932ac1634886"}
Sep 17 00:31:18.795968 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:18.795942    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"
Sep 17 00:31:18.903717 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:18.903690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/febfae28-c07d-499a-8500-c7f7990cf6d1-maas-api-service-ca\") pod \"febfae28-c07d-499a-8500-c7f7990cf6d1\" (UID: \"febfae28-c07d-499a-8500-c7f7990cf6d1\") "
Sep 17 00:31:18.904071 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:18.904047    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/febfae28-c07d-499a-8500-c7f7990cf6d1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "febfae28-c07d-499a-8500-c7f7990cf6d1" (UID: "febfae28-c07d-499a-8500-c7f7990cf6d1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:31:19.004877 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:19.004790    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/febfae28-c07d-499a-8500-c7f7990cf6d1-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:31:19.664926 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:19.664821    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk" event={"ID":"febfae28-c07d-499a-8500-c7f7990cf6d1","Type":"ContainerDied","Data":"49129f69c17acf20fd35edfdbff9379295ba549dd2939d21da260692cc03f08a"}
Sep 17 00:31:19.664926 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:19.664838    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"
Sep 17 00:31:19.664926 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:19.664876    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49129f69c17acf20fd35edfdbff9379295ba549dd2939d21da260692cc03f08a"
Sep 17 00:31:23.946125 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:23.946093    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"]
Sep 17 00:31:23.946589 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:23.946555    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="febfae28-c07d-499a-8500-c7f7990cf6d1" containerName="revoke-keys"
Sep 17 00:31:23.946589 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:23.946566    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="febfae28-c07d-499a-8500-c7f7990cf6d1" containerName="revoke-keys"
Sep 17 00:31:23.946711 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:23.946685    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="febfae28-c07d-499a-8500-c7f7990cf6d1" containerName="revoke-keys"
Sep 17 00:31:23.949009 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:23.948984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:23.951813 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:23.951778    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-48e479-openshift-default-dockercfg-xz252\""
Sep 17 00:31:23.962690 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:23.962664    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"]
Sep 17 00:31:24.046606 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.046569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-socket\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.046798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.046624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmsbh\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-kube-api-access-gmsbh\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.046798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.046658    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-token\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.046798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.046686    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-certs\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.046798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.046715    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-data\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.046798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.046792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-envoy\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.047154 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.046820    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9d827ba-5b11-4ee3-af08-1613f64c08de-istiod-ca-cert\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.047154 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.046848    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-credential-socket\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.047154 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.046913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-podinfo\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148204 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-socket\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148204 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148204    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmsbh\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-kube-api-access-gmsbh\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148226    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-token\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-certs\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148269    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-data\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148344    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-envoy\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148375    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9d827ba-5b11-4ee3-af08-1613f64c08de-istiod-ca-cert\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148433 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-credential-socket\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148738 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148472    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-podinfo\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148738 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148668    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-socket\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148738 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-certs\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148928 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-data\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.148928 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.148874    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-credential-socket\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.149193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.149171    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9d827ba-5b11-4ee3-af08-1613f64c08de-istiod-ca-cert\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.150759 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.150740    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-envoy\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.151007 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.150990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-podinfo\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.156096 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.156066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-token\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.156096 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.156077    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmsbh\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-kube-api-access-gmsbh\") pod \"e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") " pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.260769 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.260685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:24.534170 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.534141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"]
Sep 17 00:31:24.535201 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:31:24.535166    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9d827ba_5b11_4ee3_af08_1613f64c08de.slice/crio-e70abceaeddd74bd8f2be417d904ae59f00cae67d6df3b0a336071947b5f9741 WatchSource:0}: Error finding container e70abceaeddd74bd8f2be417d904ae59f00cae67d6df3b0a336071947b5f9741: Status 404 returned error can't find the container with id e70abceaeddd74bd8f2be417d904ae59f00cae67d6df3b0a336071947b5f9741
Sep 17 00:31:24.537652 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.537617    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:31:24.537779 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.537677    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:31:24.537779 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.537708    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:31:24.699796 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.699761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" event={"ID":"d9d827ba-5b11-4ee3-af08-1613f64c08de","Type":"ContainerStarted","Data":"e990c747e6f692b096fdbcb819a5a630c1a82fcb7d0085bcbfe2e46aac3ce206"}
Sep 17 00:31:24.700023 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.699825    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" event={"ID":"d9d827ba-5b11-4ee3-af08-1613f64c08de","Type":"ContainerStarted","Data":"e70abceaeddd74bd8f2be417d904ae59f00cae67d6df3b0a336071947b5f9741"}
Sep 17 00:31:24.733564 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:24.733509    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" podStartSLOduration=1.733490181 podStartE2EDuration="1.733490181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:31:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:31:24.732743682 +0000 UTC m=+1285.841519597" watchObservedRunningTime="2026-09-17 00:31:24.733490181 +0000 UTC m=+1285.842266097"
Sep 17 00:31:25.261556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:25.261526    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:25.266704 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:25.266672    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:25.706744 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:25.706715    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:25.707620 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:25.707597    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:29.593798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:29.593769    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk"]
Sep 17 00:31:29.596039 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:29.596015    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-abe86c-29826750-77rpk"]
Sep 17 00:31:29.769814 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:29.769784    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"]
Sep 17 00:31:29.773013 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:29.772988    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-abe86c-jvlvk"]
Sep 17 00:31:31.390497 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:31.390462    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3223f659-4815-47a7-a7ec-81cbcbbfe84c" path="/var/lib/kubelet/pods/3223f659-4815-47a7-a7ec-81cbcbbfe84c/volumes"
Sep 17 00:31:31.390860 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:31.390805    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="febfae28-c07d-499a-8500-c7f7990cf6d1" path="/var/lib/kubelet/pods/febfae28-c07d-499a-8500-c7f7990cf6d1/volumes"
Sep 17 00:31:48.853863 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:48.853828    2565 generic.go:356] "Generic (PLEG): container finished" podID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerID="e990c747e6f692b096fdbcb819a5a630c1a82fcb7d0085bcbfe2e46aac3ce206" exitCode=0
Sep 17 00:31:48.854266 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:48.853891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" event={"ID":"d9d827ba-5b11-4ee3-af08-1613f64c08de","Type":"ContainerDied","Data":"e990c747e6f692b096fdbcb819a5a630c1a82fcb7d0085bcbfe2e46aac3ce206"}
Sep 17 00:31:48.854308 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:48.854293    2565 scope.go:117] "RemoveContainer" containerID="e990c747e6f692b096fdbcb819a5a630c1a82fcb7d0085bcbfe2e46aac3ce206"
Sep 17 00:31:48.855569 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:48.855542    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:31:48.855636 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:48.855613    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:31:48.855672 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:48.855662    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:31:49.866927 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:49.866538    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" event={"ID":"d9d827ba-5b11-4ee3-af08-1613f64c08de","Type":"ContainerStarted","Data":"c22b8e92a3ba9d216abe00457d7c45b7d692c8b8b2ee2f2ab69b4a7f57331dc7"}
Sep 17 00:31:50.261239 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:50.261134    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:50.261425 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:50.261269    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:31:50.261425 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:50.261331    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 17 00:31:51.261779 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:51.261731    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:31:51.262288 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:51.261802    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 17 00:31:52.264198 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:52.262932    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:31:52.264198 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:52.262997    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 17 00:31:53.262164 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:53.262114    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:31:53.262379 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:53.262201    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 17 00:31:54.261551 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:54.261514    2565 patch_prober.go:28] interesting pod/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused" start-of-body=
Sep 17 00:31:54.262036 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:54.261578    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.69:15021/healthz/ready\": dial tcp 10.133.0.69:15021: connect: connection refused"
Sep 17 00:31:55.265258 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:55.265227    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:55.265728 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:55.265643    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:31:55.266244 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:31:55.266224    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:32:04.714146 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.714110    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"]
Sep 17 00:32:04.717161 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.717139    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:04.719748 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.719727    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-edbd82\""
Sep 17 00:32:04.719869 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.719734    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-edbd82-dockercfg-r9vk4\""
Sep 17 00:32:04.727039 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.727016    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"]
Sep 17 00:32:04.744299 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.744269    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"]
Sep 17 00:32:04.746865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.746843    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:04.755834 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.755808    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"]
Sep 17 00:32:04.804665 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.804632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26\" (UID: \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:04.804822 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.804722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26548\" (UniqueName: \"kubernetes.io/projected/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-kube-api-access-26548\") pod \"payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26\" (UID: \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:04.804981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.804960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth\" (UID: \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:04.805077 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.804999    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxpj\" (UniqueName: \"kubernetes.io/projected/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-kube-api-access-4zxpj\") pod \"payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth\" (UID: \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:04.906336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.906299    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth\" (UID: \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:04.906336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.906336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxpj\" (UniqueName: \"kubernetes.io/projected/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-kube-api-access-4zxpj\") pod \"payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth\" (UID: \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:04.906589 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.906479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26\" (UID: \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:04.906589 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.906521    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26548\" (UniqueName: \"kubernetes.io/projected/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-kube-api-access-26548\") pod \"payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26\" (UID: \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:04.907086 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.907068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth\" (UID: \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:04.907220 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.907204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26\" (UID: \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:04.914436 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.914413    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxpj\" (UniqueName: \"kubernetes.io/projected/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-kube-api-access-4zxpj\") pod \"payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth\" (UID: \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:04.914436 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:04.914432    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26548\" (UniqueName: \"kubernetes.io/projected/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-kube-api-access-26548\") pod \"payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26\" (UID: \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:05.029622 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.029546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:05.059176 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.059148    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:05.307749 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.307718    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"]
Sep 17 00:32:05.308968 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:32:05.308945    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ce9622e_2369_4a1f_8839_b4bfabacd0d3.slice/crio-f3a66e17836ad0a373c2e024c5f541343a2d8697cb1f7956924235e239826ade WatchSource:0}: Error finding container f3a66e17836ad0a373c2e024c5f541343a2d8697cb1f7956924235e239826ade: Status 404 returned error can't find the container with id f3a66e17836ad0a373c2e024c5f541343a2d8697cb1f7956924235e239826ade
Sep 17 00:32:05.342534 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.342508    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"]
Sep 17 00:32:05.343570 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:32:05.343546    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fdb9b63_efe6_4acc_b519_469b0f8fff2a.slice/crio-aa76a4fdd7a842d2cfbb03986600b4bc63ddf9438539c2eb0bdc0f0e60c66938 WatchSource:0}: Error finding container aa76a4fdd7a842d2cfbb03986600b4bc63ddf9438539c2eb0bdc0f0e60c66938: Status 404 returned error can't find the container with id aa76a4fdd7a842d2cfbb03986600b4bc63ddf9438539c2eb0bdc0f0e60c66938
Sep 17 00:32:05.972377 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.972341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26" event={"ID":"1fdb9b63-efe6-4acc-b519-469b0f8fff2a","Type":"ContainerStarted","Data":"2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e"}
Sep 17 00:32:05.972834 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.972514    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:05.972834 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.972539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26" event={"ID":"1fdb9b63-efe6-4acc-b519-469b0f8fff2a","Type":"ContainerStarted","Data":"aa76a4fdd7a842d2cfbb03986600b4bc63ddf9438539c2eb0bdc0f0e60c66938"}
Sep 17 00:32:05.974101 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.974077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth" event={"ID":"1ce9622e-2369-4a1f-8839-b4bfabacd0d3","Type":"ContainerStarted","Data":"80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b"}
Sep 17 00:32:05.974235 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.974131    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth" event={"ID":"1ce9622e-2369-4a1f-8839-b4bfabacd0d3","Type":"ContainerStarted","Data":"f3a66e17836ad0a373c2e024c5f541343a2d8697cb1f7956924235e239826ade"}
Sep 17 00:32:05.974235 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.974164    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:05.988273 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:05.988232    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26" podStartSLOduration=1.988218309 podStartE2EDuration="1.988218309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:32:05.986757589 +0000 UTC m=+1327.095533529" watchObservedRunningTime="2026-09-17 00:32:05.988218309 +0000 UTC m=+1327.096994242"
Sep 17 00:32:06.002736 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:06.002690    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth" podStartSLOduration=2.002676306 podStartE2EDuration="2.002676306s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:32:06.000952869 +0000 UTC m=+1327.109728784" watchObservedRunningTime="2026-09-17 00:32:06.002676306 +0000 UTC m=+1327.111452273"
Sep 17 00:32:16.982538 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:16.982507    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:32:16.983010 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:16.982577    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:32:59.472322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:32:59.472289    2565 scope.go:117] "RemoveContainer" containerID="84ae9bc9e9f843fc987098d1c9d53d18e85972accd1a534d173d832b8a84c6ba"
Sep 17 00:33:16.085210 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:16.085170    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"]
Sep 17 00:33:16.088481 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:16.088464    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"
Sep 17 00:33:16.092367 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:16.092337    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:33:16.094780 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:16.094756    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"]
Sep 17 00:33:16.214842 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:16.214794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a6023aa-144b-4f9c-b346-0dbe869ed9db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf\" (UID: \"3a6023aa-144b-4f9c-b346-0dbe869ed9db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"
Sep 17 00:33:16.316412 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:16.316369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a6023aa-144b-4f9c-b346-0dbe869ed9db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf\" (UID: \"3a6023aa-144b-4f9c-b346-0dbe869ed9db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"
Sep 17 00:33:16.317018 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:16.316996    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a6023aa-144b-4f9c-b346-0dbe869ed9db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf\" (UID: \"3a6023aa-144b-4f9c-b346-0dbe869ed9db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"
Sep 17 00:33:16.401359 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:16.401274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"
Sep 17 00:33:16.671801 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:16.671775    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"]
Sep 17 00:33:16.673341 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:33:16.673309    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a6023aa_144b_4f9c_b346_0dbe869ed9db.slice/crio-18f88f6b740fe63f09702917d3ebab581586cae814d6c6bb479a26b43f1a9792 WatchSource:0}: Error finding container 18f88f6b740fe63f09702917d3ebab581586cae814d6c6bb479a26b43f1a9792: Status 404 returned error can't find the container with id 18f88f6b740fe63f09702917d3ebab581586cae814d6c6bb479a26b43f1a9792
Sep 17 00:33:17.419784 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:17.419747    2565 generic.go:356] "Generic (PLEG): container finished" podID="3a6023aa-144b-4f9c-b346-0dbe869ed9db" containerID="060b74f9c02d4438373622e51a6f9685488f8869b88fec72eb9b9163cb16aa75" exitCode=0
Sep 17 00:33:17.420179 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:17.419843    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf" event={"ID":"3a6023aa-144b-4f9c-b346-0dbe869ed9db","Type":"ContainerDied","Data":"060b74f9c02d4438373622e51a6f9685488f8869b88fec72eb9b9163cb16aa75"}
Sep 17 00:33:17.420179 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:17.419931    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf" event={"ID":"3a6023aa-144b-4f9c-b346-0dbe869ed9db","Type":"ContainerStarted","Data":"18f88f6b740fe63f09702917d3ebab581586cae814d6c6bb479a26b43f1a9792"}
Sep 17 00:33:18.565993 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:18.565970    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"
Sep 17 00:33:18.641670 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:18.641644    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a6023aa-144b-4f9c-b346-0dbe869ed9db-maas-api-service-ca\") pod \"3a6023aa-144b-4f9c-b346-0dbe869ed9db\" (UID: \"3a6023aa-144b-4f9c-b346-0dbe869ed9db\") "
Sep 17 00:33:18.641999 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:18.641979    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a6023aa-144b-4f9c-b346-0dbe869ed9db-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3a6023aa-144b-4f9c-b346-0dbe869ed9db" (UID: "3a6023aa-144b-4f9c-b346-0dbe869ed9db"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:33:18.743141 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:18.743079    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a6023aa-144b-4f9c-b346-0dbe869ed9db-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:19.432785 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:19.432750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf" event={"ID":"3a6023aa-144b-4f9c-b346-0dbe869ed9db","Type":"ContainerDied","Data":"18f88f6b740fe63f09702917d3ebab581586cae814d6c6bb479a26b43f1a9792"}
Sep 17 00:33:19.432785 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:19.432782    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"
Sep 17 00:33:19.433008 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:19.432798    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18f88f6b740fe63f09702917d3ebab581586cae814d6c6bb479a26b43f1a9792"
Sep 17 00:33:26.797952 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:26.797910    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"]
Sep 17 00:33:26.802103 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:26.802075    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-76944c-hkdpf"]
Sep 17 00:33:27.390133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:27.390098    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a6023aa-144b-4f9c-b346-0dbe869ed9db" path="/var/lib/kubelet/pods/3a6023aa-144b-4f9c-b346-0dbe869ed9db/volumes"
Sep 17 00:33:33.461932 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.461879    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"]
Sep 17 00:33:33.462735 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.462711    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a6023aa-144b-4f9c-b346-0dbe869ed9db" containerName="revoke-keys"
Sep 17 00:33:33.462805 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.462740    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a6023aa-144b-4f9c-b346-0dbe869ed9db" containerName="revoke-keys"
Sep 17 00:33:33.462880 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.462867    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a6023aa-144b-4f9c-b346-0dbe869ed9db" containerName="revoke-keys"
Sep 17 00:33:33.466087 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.466058    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"
Sep 17 00:33:33.469576 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.469554    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:33:33.470641 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.470615    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"]
Sep 17 00:33:33.480611 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.480579    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc\" (UID: \"1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"
Sep 17 00:33:33.581685 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.581651    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc\" (UID: \"1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"
Sep 17 00:33:33.582293 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.582274    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc\" (UID: \"1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"
Sep 17 00:33:33.780010 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:33.779925    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"
Sep 17 00:33:34.049387 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:34.049359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"]
Sep 17 00:33:34.524979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:34.524940    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc" event={"ID":"1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd","Type":"ContainerStarted","Data":"feb197c54e8af8277585b65e661fbe021f9727811ab1ba7a1e3fd3569e59037c"}
Sep 17 00:33:34.525387 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:34.525025    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc" event={"ID":"1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd","Type":"ContainerStarted","Data":"3e74413278993c9c370463c75807005a33914ea4b90e3198edc8e655bdf61cd9"}
Sep 17 00:33:34.542286 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:34.542239    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc" podStartSLOduration=1.5422241300000001 podStartE2EDuration="1.54222413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:33:34.540741733 +0000 UTC m=+1415.649517650" watchObservedRunningTime="2026-09-17 00:33:34.54222413 +0000 UTC m=+1415.651000070"
Sep 17 00:33:34.680915 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:34.680817    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"]
Sep 17 00:33:35.532868 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:35.532828    2565 generic.go:356] "Generic (PLEG): container finished" podID="1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd" containerID="feb197c54e8af8277585b65e661fbe021f9727811ab1ba7a1e3fd3569e59037c" exitCode=0
Sep 17 00:33:35.533234 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:35.532890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc" event={"ID":"1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd","Type":"ContainerDied","Data":"feb197c54e8af8277585b65e661fbe021f9727811ab1ba7a1e3fd3569e59037c"}
Sep 17 00:33:36.677940 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:36.677914    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"
Sep 17 00:33:36.714386 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:36.714356    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd-maas-api-service-ca\") pod \"1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd\" (UID: \"1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd\") "
Sep 17 00:33:36.714683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:36.714661    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd" (UID: "1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:33:36.714793 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:36.714773    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:37.546382 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:37.546354    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"
Sep 17 00:33:37.546543 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:37.546395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc" event={"ID":"1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd","Type":"ContainerDied","Data":"3e74413278993c9c370463c75807005a33914ea4b90e3198edc8e655bdf61cd9"}
Sep 17 00:33:37.546543 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:37.546441    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e74413278993c9c370463c75807005a33914ea4b90e3198edc8e655bdf61cd9"
Sep 17 00:33:43.937241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:43.937206    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p"]
Sep 17 00:33:43.939597 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:43.939574    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-a146d6-29826750-fj24p"]
Sep 17 00:33:43.957519 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:43.957490    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"]
Sep 17 00:33:43.957769 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:43.957739    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9" podUID="ed989b98-5d19-4d87-aa1d-1f3fecf86a8d" containerName="payload-processing" containerID="cri-o://dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb" gracePeriod=30
Sep 17 00:33:43.966197 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:43.966173    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"]
Sep 17 00:33:43.966450 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:43.966401    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc" podUID="aab303a6-c26a-434c-9deb-3f15e6e74899" containerName="payload-pre-processing" containerID="cri-o://960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae" gracePeriod=30
Sep 17 00:33:44.120283 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.120240    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"]
Sep 17 00:33:44.124544 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.124518    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-a146d6-r7wbc"]
Sep 17 00:33:44.259835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.259792    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:33:44.263374 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.263353    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:33:44.393870 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.393838    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab303a6-c26a-434c-9deb-3f15e6e74899-plugins-config-volume\") pod \"aab303a6-c26a-434c-9deb-3f15e6e74899\" (UID: \"aab303a6-c26a-434c-9deb-3f15e6e74899\") "
Sep 17 00:33:44.394038 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.393877    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dd486\" (UniqueName: \"kubernetes.io/projected/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-kube-api-access-dd486\") pod \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\" (UID: \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\") "
Sep 17 00:33:44.394038 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.393893    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-plugins-config-volume\") pod \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\" (UID: \"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d\") "
Sep 17 00:33:44.394038 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.393971    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n6rf\" (UniqueName: \"kubernetes.io/projected/aab303a6-c26a-434c-9deb-3f15e6e74899-kube-api-access-2n6rf\") pod \"aab303a6-c26a-434c-9deb-3f15e6e74899\" (UID: \"aab303a6-c26a-434c-9deb-3f15e6e74899\") "
Sep 17 00:33:44.394243 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.394219    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aab303a6-c26a-434c-9deb-3f15e6e74899-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aab303a6-c26a-434c-9deb-3f15e6e74899" (UID: "aab303a6-c26a-434c-9deb-3f15e6e74899"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:33:44.394345 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.394319    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ed989b98-5d19-4d87-aa1d-1f3fecf86a8d" (UID: "ed989b98-5d19-4d87-aa1d-1f3fecf86a8d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:33:44.394407 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.394347    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aab303a6-c26a-434c-9deb-3f15e6e74899-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:44.396128 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.396105    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-kube-api-access-dd486" (OuterVolumeSpecName: "kube-api-access-dd486") pod "ed989b98-5d19-4d87-aa1d-1f3fecf86a8d" (UID: "ed989b98-5d19-4d87-aa1d-1f3fecf86a8d"). InnerVolumeSpecName "kube-api-access-dd486". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:44.396223 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.396177    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aab303a6-c26a-434c-9deb-3f15e6e74899-kube-api-access-2n6rf" (OuterVolumeSpecName: "kube-api-access-2n6rf") pod "aab303a6-c26a-434c-9deb-3f15e6e74899" (UID: "aab303a6-c26a-434c-9deb-3f15e6e74899"). InnerVolumeSpecName "kube-api-access-2n6rf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:44.494997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.494887    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dd486\" (UniqueName: \"kubernetes.io/projected/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-kube-api-access-dd486\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:44.494997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.494948    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:44.494997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.494962    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n6rf\" (UniqueName: \"kubernetes.io/projected/aab303a6-c26a-434c-9deb-3f15e6e74899-kube-api-access-2n6rf\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:44.597516 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.597485    2565 generic.go:356] "Generic (PLEG): container finished" podID="aab303a6-c26a-434c-9deb-3f15e6e74899" containerID="960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae" exitCode=0
Sep 17 00:33:44.597675 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.597540    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"
Sep 17 00:33:44.597675 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.597575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc" event={"ID":"aab303a6-c26a-434c-9deb-3f15e6e74899","Type":"ContainerDied","Data":"960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae"}
Sep 17 00:33:44.597675 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.597625    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc" event={"ID":"aab303a6-c26a-434c-9deb-3f15e6e74899","Type":"ContainerDied","Data":"2e4f46f9c03621f13ea52d38cd872e9d7816ff6a943aa7e873325641c0132cd7"}
Sep 17 00:33:44.597675 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.597650    2565 scope.go:117] "RemoveContainer" containerID="960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae"
Sep 17 00:33:44.599037 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.599015    2565 generic.go:356] "Generic (PLEG): container finished" podID="ed989b98-5d19-4d87-aa1d-1f3fecf86a8d" containerID="dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb" exitCode=0
Sep 17 00:33:44.599144 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.599084    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"
Sep 17 00:33:44.599206 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.599148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9" event={"ID":"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d","Type":"ContainerDied","Data":"dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb"}
Sep 17 00:33:44.599206 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.599198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9" event={"ID":"ed989b98-5d19-4d87-aa1d-1f3fecf86a8d","Type":"ContainerDied","Data":"3a4e11bf457852723c95dc26b73b6c71cd49cadef9ac45ae12bf5fba32977166"}
Sep 17 00:33:44.614143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.614123    2565 scope.go:117] "RemoveContainer" containerID="960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae"
Sep 17 00:33:44.616802 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:33:44.614686    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae\": container with ID starting with 960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae not found: ID does not exist" containerID="960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae"
Sep 17 00:33:44.616802 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.614732    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae"} err="failed to get container status \"960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae\": rpc error: code = NotFound desc = could not find container \"960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae\": container with ID starting with 960067014ff4044a6b2c6a775ba733281080b81deeda29d51fd660c60a3afcae not found: ID does not exist"
Sep 17 00:33:44.616802 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.614772    2565 scope.go:117] "RemoveContainer" containerID="dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb"
Sep 17 00:33:44.626292 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.626252    2565 scope.go:117] "RemoveContainer" containerID="dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb"
Sep 17 00:33:44.626615 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:33:44.626585    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb\": container with ID starting with dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb not found: ID does not exist" containerID="dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb"
Sep 17 00:33:44.626720 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.626621    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb"} err="failed to get container status \"dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb\": rpc error: code = NotFound desc = could not find container \"dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb\": container with ID starting with dd95466c064a9fad39ff6ce946b374b2044ef2c4925d50f996c618dcc608abbb not found: ID does not exist"
Sep 17 00:33:44.628975 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.628950    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"]
Sep 17 00:33:44.632316 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.632293    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a146d6-866c948b6b-p5dbc"]
Sep 17 00:33:44.641882 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.641859    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"]
Sep 17 00:33:44.645601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:44.645579    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-a146d6-67856d6767-29js9"]
Sep 17 00:33:45.389528 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:45.389494    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd" path="/var/lib/kubelet/pods/1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd/volumes"
Sep 17 00:33:45.389867 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:45.389801    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6be54c36-6895-4721-948c-2b7b9002a730" path="/var/lib/kubelet/pods/6be54c36-6895-4721-948c-2b7b9002a730/volumes"
Sep 17 00:33:45.390139 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:45.390125    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aab303a6-c26a-434c-9deb-3f15e6e74899" path="/var/lib/kubelet/pods/aab303a6-c26a-434c-9deb-3f15e6e74899/volumes"
Sep 17 00:33:45.390462 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:45.390449    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed989b98-5d19-4d87-aa1d-1f3fecf86a8d" path="/var/lib/kubelet/pods/ed989b98-5d19-4d87-aa1d-1f3fecf86a8d/volumes"
Sep 17 00:33:49.700613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:49.700575    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv" podUID="8f32f757-8101-4aee-bc0b-ef93ec2970d0" containerName="main" containerID="cri-o://9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e" gracePeriod=45
Sep 17 00:33:49.950752 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:49.950696    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:33:50.046523 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.046494    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-home\") pod \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") "
Sep 17 00:33:50.046701 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.046552    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-model-cache\") pod \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") "
Sep 17 00:33:50.046701 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.046588    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-dshm\") pod \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") "
Sep 17 00:33:50.046701 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.046627    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mccjj\" (UniqueName: \"kubernetes.io/projected/8f32f757-8101-4aee-bc0b-ef93ec2970d0-kube-api-access-mccjj\") pod \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") "
Sep 17 00:33:50.046701 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.046675    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tmp-dir\") pod \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") "
Sep 17 00:33:50.046956 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.046739    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tls-certs\") pod \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\" (UID: \"8f32f757-8101-4aee-bc0b-ef93ec2970d0\") "
Sep 17 00:33:50.046956 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.046780    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-home" (OuterVolumeSpecName: "home") pod "8f32f757-8101-4aee-bc0b-ef93ec2970d0" (UID: "8f32f757-8101-4aee-bc0b-ef93ec2970d0"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:50.047258 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.047208    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-model-cache" (OuterVolumeSpecName: "model-cache") pod "8f32f757-8101-4aee-bc0b-ef93ec2970d0" (UID: "8f32f757-8101-4aee-bc0b-ef93ec2970d0"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:50.047511 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.047455    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8f32f757-8101-4aee-bc0b-ef93ec2970d0" (UID: "8f32f757-8101-4aee-bc0b-ef93ec2970d0"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:50.048087 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.048060    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tmp-dir\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:50.048179 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.048093    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-home\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:50.048179 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.048110    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-model-cache\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:50.049835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.049789    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8f32f757-8101-4aee-bc0b-ef93ec2970d0" (UID: "8f32f757-8101-4aee-bc0b-ef93ec2970d0"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:33:50.051946 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.050360    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-dshm" (OuterVolumeSpecName: "dshm") pod "8f32f757-8101-4aee-bc0b-ef93ec2970d0" (UID: "8f32f757-8101-4aee-bc0b-ef93ec2970d0"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:33:50.056100 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.056071    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f32f757-8101-4aee-bc0b-ef93ec2970d0-kube-api-access-mccjj" (OuterVolumeSpecName: "kube-api-access-mccjj") pod "8f32f757-8101-4aee-bc0b-ef93ec2970d0" (UID: "8f32f757-8101-4aee-bc0b-ef93ec2970d0"). InnerVolumeSpecName "kube-api-access-mccjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:33:50.148830 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.148805    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8f32f757-8101-4aee-bc0b-ef93ec2970d0-tls-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:50.148830 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.148830    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8f32f757-8101-4aee-bc0b-ef93ec2970d0-dshm\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:50.148999 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.148844    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mccjj\" (UniqueName: \"kubernetes.io/projected/8f32f757-8101-4aee-bc0b-ef93ec2970d0-kube-api-access-mccjj\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:33:50.639112 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.639078    2565 generic.go:356] "Generic (PLEG): container finished" podID="8f32f757-8101-4aee-bc0b-ef93ec2970d0" containerID="9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e" exitCode=0
Sep 17 00:33:50.639316 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.639135    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"
Sep 17 00:33:50.639316 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.639166    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv" event={"ID":"8f32f757-8101-4aee-bc0b-ef93ec2970d0","Type":"ContainerDied","Data":"9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e"}
Sep 17 00:33:50.639316 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.639214    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv" event={"ID":"8f32f757-8101-4aee-bc0b-ef93ec2970d0","Type":"ContainerDied","Data":"bdb4fe34ccf9a00b5d42eb0e1d2952ae7dd7fcb38435bb700333e7e5e9bf8603"}
Sep 17 00:33:50.639316 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.639236    2565 scope.go:117] "RemoveContainer" containerID="9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e"
Sep 17 00:33:50.649462 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.649445    2565 scope.go:117] "RemoveContainer" containerID="9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e"
Sep 17 00:33:50.649731 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:33:50.649712    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e\": container with ID starting with 9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e not found: ID does not exist" containerID="9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e"
Sep 17 00:33:50.649789 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.649739    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e"} err="failed to get container status \"9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e\": rpc error: code = NotFound desc = could not find container \"9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e\": container with ID starting with 9f2e0bab0c22c54044c511479518ddc54cfd5dd150d8073de3dbdb08d25b1b3e not found: ID does not exist"
Sep 17 00:33:50.659912 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.659873    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"]
Sep 17 00:33:50.663460 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:50.663440    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a146d6/test-model-a146d6-kserve-766d9877cc-flsbv"]
Sep 17 00:33:51.390016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:51.389980    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f32f757-8101-4aee-bc0b-ef93ec2970d0" path="/var/lib/kubelet/pods/8f32f757-8101-4aee-bc0b-ef93ec2970d0/volumes"
Sep 17 00:33:55.520056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:55.519973    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"]
Sep 17 00:33:55.520486 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:55.520198    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy" containerID="cri-o://ea1e4ef58f77e9af887dcf5d691d4d0596b77796df5c8c15b1579020f3150aa0" gracePeriod=30
Sep 17 00:33:59.494983 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:59.494954    2565 scope.go:117] "RemoveContainer" containerID="42786a1c193bd1aeec59f258f06f57c026d13120b3ec99290539df5ad2918d75"
Sep 17 00:33:59.503883 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:33:59.503860    2565 scope.go:117] "RemoveContainer" containerID="704d92ab61ea91244d07f37aa800054390229caf401cba46325027d938e87971"
Sep 17 00:34:00.711121 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.711091    2565 generic.go:356] "Generic (PLEG): container finished" podID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerID="ea1e4ef58f77e9af887dcf5d691d4d0596b77796df5c8c15b1579020f3150aa0" exitCode=0
Sep 17 00:34:00.711541 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.711165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" event={"ID":"755cf129-b5f8-49c6-8972-2d36f2f5cdbb","Type":"ContainerDied","Data":"ea1e4ef58f77e9af887dcf5d691d4d0596b77796df5c8c15b1579020f3150aa0"}
Sep 17 00:34:00.711541 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.711229    2565 scope.go:117] "RemoveContainer" containerID="37fce11848fbf28373a44c0e49dce73ca464a8d15466f628adfb3b4171b68424"
Sep 17 00:34:00.788586 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.788514    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:34:00.960110 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960073    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-token\") pod \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") "
Sep 17 00:34:00.960304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960133    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-socket\") pod \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") "
Sep 17 00:34:00.960304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960173    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istiod-ca-cert\") pod \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") "
Sep 17 00:34:00.960304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960234    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-envoy\") pod \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") "
Sep 17 00:34:00.960304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960259    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-credential-socket\") pod \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") "
Sep 17 00:34:00.960304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960287    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-certs\") pod \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") "
Sep 17 00:34:00.960579 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-data\") pod \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") "
Sep 17 00:34:00.960579 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960348    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-podinfo\") pod \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") "
Sep 17 00:34:00.960579 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960407    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg9kj\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-kube-api-access-bg9kj\") pod \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\" (UID: \"755cf129-b5f8-49c6-8972-2d36f2f5cdbb\") "
Sep 17 00:34:00.960579 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960491    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "755cf129-b5f8-49c6-8972-2d36f2f5cdbb" (UID: "755cf129-b5f8-49c6-8972-2d36f2f5cdbb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:34:00.960794 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960597    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "755cf129-b5f8-49c6-8972-2d36f2f5cdbb" (UID: "755cf129-b5f8-49c6-8972-2d36f2f5cdbb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:34:00.960794 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960615    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "755cf129-b5f8-49c6-8972-2d36f2f5cdbb" (UID: "755cf129-b5f8-49c6-8972-2d36f2f5cdbb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:34:00.960794 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960636    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-data" (OuterVolumeSpecName: "istio-data") pod "755cf129-b5f8-49c6-8972-2d36f2f5cdbb" (UID: "755cf129-b5f8-49c6-8972-2d36f2f5cdbb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:34:00.960794 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960695    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "755cf129-b5f8-49c6-8972-2d36f2f5cdbb" (UID: "755cf129-b5f8-49c6-8972-2d36f2f5cdbb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:34:00.961006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960835    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:34:00.961006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960858    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:34:00.961006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960873    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:34:00.961006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960888    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:34:00.961006 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.960919    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:34:00.962371 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.962342    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-token" (OuterVolumeSpecName: "istio-token") pod "755cf129-b5f8-49c6-8972-2d36f2f5cdbb" (UID: "755cf129-b5f8-49c6-8972-2d36f2f5cdbb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:34:00.962521 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.962446    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "755cf129-b5f8-49c6-8972-2d36f2f5cdbb" (UID: "755cf129-b5f8-49c6-8972-2d36f2f5cdbb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:34:00.962652 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.962633    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-kube-api-access-bg9kj" (OuterVolumeSpecName: "kube-api-access-bg9kj") pod "755cf129-b5f8-49c6-8972-2d36f2f5cdbb" (UID: "755cf129-b5f8-49c6-8972-2d36f2f5cdbb"). InnerVolumeSpecName "kube-api-access-bg9kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:34:00.962779 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:00.962755    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "755cf129-b5f8-49c6-8972-2d36f2f5cdbb" (UID: "755cf129-b5f8-49c6-8972-2d36f2f5cdbb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:34:01.062509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:01.062433    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:34:01.062509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:01.062468    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:34:01.062509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:01.062483    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg9kj\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-kube-api-access-bg9kj\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:34:01.062509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:01.062498    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/755cf129-b5f8-49c6-8972-2d36f2f5cdbb-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:34:01.718828 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:01.718756    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"
Sep 17 00:34:01.718828 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:01.718778    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv" event={"ID":"755cf129-b5f8-49c6-8972-2d36f2f5cdbb","Type":"ContainerDied","Data":"6e8df8d43a64e6d3b1c6e1d2c7201eaf72fdecc40caed11724129098bc571b5c"}
Sep 17 00:34:01.719637 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:01.718831    2565 scope.go:117] "RemoveContainer" containerID="ea1e4ef58f77e9af887dcf5d691d4d0596b77796df5c8c15b1579020f3150aa0"
Sep 17 00:34:01.737283 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:01.737253    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"]
Sep 17 00:34:01.743028 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:01.743003    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a146d6-openshift-default-5c4cd669dd-57vwv"]
Sep 17 00:34:03.389307 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:03.389278    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" path="/var/lib/kubelet/pods/755cf129-b5f8-49c6-8972-2d36f2f5cdbb/volumes"
Sep 17 00:34:04.475195 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475157    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"]
Sep 17 00:34:04.475637 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475624    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed989b98-5d19-4d87-aa1d-1f3fecf86a8d" containerName="payload-processing"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475639    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed989b98-5d19-4d87-aa1d-1f3fecf86a8d" containerName="payload-processing"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475649    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aab303a6-c26a-434c-9deb-3f15e6e74899" containerName="payload-pre-processing"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475655    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aab303a6-c26a-434c-9deb-3f15e6e74899" containerName="payload-pre-processing"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475667    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd" containerName="revoke-keys"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475673    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd" containerName="revoke-keys"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475682    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475687    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475695    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475700    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy"
Sep 17 00:34:04.475706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475708    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f32f757-8101-4aee-bc0b-ef93ec2970d0" containerName="main"
Sep 17 00:34:04.476059 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475717    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f32f757-8101-4aee-bc0b-ef93ec2970d0" containerName="main"
Sep 17 00:34:04.476059 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475795    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy"
Sep 17 00:34:04.476059 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475804    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f32f757-8101-4aee-bc0b-ef93ec2970d0" containerName="main"
Sep 17 00:34:04.476059 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475826    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aab303a6-c26a-434c-9deb-3f15e6e74899" containerName="payload-pre-processing"
Sep 17 00:34:04.476059 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475833    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fd7f8d2-7328-4027-8e4d-8ff7e4d60fbd" containerName="revoke-keys"
Sep 17 00:34:04.476059 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475840    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed989b98-5d19-4d87-aa1d-1f3fecf86a8d" containerName="payload-processing"
Sep 17 00:34:04.476059 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.475846    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="755cf129-b5f8-49c6-8972-2d36f2f5cdbb" containerName="istio-proxy"
Sep 17 00:34:04.479465 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.479446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:04.482312 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.482291    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-47a2db\""
Sep 17 00:34:04.482417 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.482341    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-47a2db-dockercfg-pp8nk\""
Sep 17 00:34:04.486934 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.486883    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"]
Sep 17 00:34:04.512588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.512565    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"]
Sep 17 00:34:04.515174 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.515158    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:04.526387 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.526366    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"]
Sep 17 00:34:04.596348 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.596251    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjnkg\" (UniqueName: \"kubernetes.io/projected/98423974-09c0-47ea-bef9-a0a3c76ecf4f-kube-api-access-rjnkg\") pod \"payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg\" (UID: \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:04.596506 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.596364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98423974-09c0-47ea-bef9-a0a3c76ecf4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg\" (UID: \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:04.697703 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.697669    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54166db-c714-478a-8282-e409d4645d91-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h\" (UID: \"b54166db-c714-478a-8282-e409d4645d91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:04.697868 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.697728    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjnkg\" (UniqueName: \"kubernetes.io/projected/98423974-09c0-47ea-bef9-a0a3c76ecf4f-kube-api-access-rjnkg\") pod \"payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg\" (UID: \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:04.697964 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.697862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxwrk\" (UniqueName: \"kubernetes.io/projected/b54166db-c714-478a-8282-e409d4645d91-kube-api-access-dxwrk\") pod \"payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h\" (UID: \"b54166db-c714-478a-8282-e409d4645d91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:04.697964 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.697937    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98423974-09c0-47ea-bef9-a0a3c76ecf4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg\" (UID: \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:04.698562 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.698541    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98423974-09c0-47ea-bef9-a0a3c76ecf4f-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg\" (UID: \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:04.705191 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.705169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjnkg\" (UniqueName: \"kubernetes.io/projected/98423974-09c0-47ea-bef9-a0a3c76ecf4f-kube-api-access-rjnkg\") pod \"payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg\" (UID: \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:04.791370 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.791286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:04.798544 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.798520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxwrk\" (UniqueName: \"kubernetes.io/projected/b54166db-c714-478a-8282-e409d4645d91-kube-api-access-dxwrk\") pod \"payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h\" (UID: \"b54166db-c714-478a-8282-e409d4645d91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:04.798668 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.798588    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54166db-c714-478a-8282-e409d4645d91-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h\" (UID: \"b54166db-c714-478a-8282-e409d4645d91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:04.799298 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.799276    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54166db-c714-478a-8282-e409d4645d91-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h\" (UID: \"b54166db-c714-478a-8282-e409d4645d91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:04.806174 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.806145    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxwrk\" (UniqueName: \"kubernetes.io/projected/b54166db-c714-478a-8282-e409d4645d91-kube-api-access-dxwrk\") pod \"payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h\" (UID: \"b54166db-c714-478a-8282-e409d4645d91\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:04.824813 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:04.824784    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:05.063673 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.063637    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"]
Sep 17 00:34:05.065019 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:34:05.064996    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98423974_09c0_47ea_bef9_a0a3c76ecf4f.slice/crio-1b40956af8b319b22f2cd4d18f79fe639ea9c6957f84b1aa928b507a844839a2 WatchSource:0}: Error finding container 1b40956af8b319b22f2cd4d18f79fe639ea9c6957f84b1aa928b507a844839a2: Status 404 returned error can't find the container with id 1b40956af8b319b22f2cd4d18f79fe639ea9c6957f84b1aa928b507a844839a2
Sep 17 00:34:05.110502 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.110467    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"]
Sep 17 00:34:05.112573 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:34:05.112540    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb54166db_c714_478a_8282_e409d4645d91.slice/crio-a595d606dd34095de3a8e37d907ad810f113e734cd88485b131ab02dfeb0b7ee WatchSource:0}: Error finding container a595d606dd34095de3a8e37d907ad810f113e734cd88485b131ab02dfeb0b7ee: Status 404 returned error can't find the container with id a595d606dd34095de3a8e37d907ad810f113e734cd88485b131ab02dfeb0b7ee
Sep 17 00:34:05.747662 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.747627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h" event={"ID":"b54166db-c714-478a-8282-e409d4645d91","Type":"ContainerStarted","Data":"f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17"}
Sep 17 00:34:05.748131 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.747691    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h" event={"ID":"b54166db-c714-478a-8282-e409d4645d91","Type":"ContainerStarted","Data":"a595d606dd34095de3a8e37d907ad810f113e734cd88485b131ab02dfeb0b7ee"}
Sep 17 00:34:05.748131 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.747852    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:05.749290 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.749266    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg" event={"ID":"98423974-09c0-47ea-bef9-a0a3c76ecf4f","Type":"ContainerStarted","Data":"ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63"}
Sep 17 00:34:05.749411 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.749302    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg" event={"ID":"98423974-09c0-47ea-bef9-a0a3c76ecf4f","Type":"ContainerStarted","Data":"1b40956af8b319b22f2cd4d18f79fe639ea9c6957f84b1aa928b507a844839a2"}
Sep 17 00:34:05.749411 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.749323    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:05.764446 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.764403    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h" podStartSLOduration=1.76438923 podStartE2EDuration="1.76438923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:05.762252374 +0000 UTC m=+1446.871028290" watchObservedRunningTime="2026-09-17 00:34:05.76438923 +0000 UTC m=+1446.873165144"
Sep 17 00:34:05.778139 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:05.778090    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg" podStartSLOduration=1.778073471 podStartE2EDuration="1.778073471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:34:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:05.777711372 +0000 UTC m=+1446.886487288" watchObservedRunningTime="2026-09-17 00:34:05.778073471 +0000 UTC m=+1446.886849387"
Sep 17 00:34:16.757344 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:16.757313    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:34:16.757742 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:16.757391    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:34:30.814508 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.814475    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"]
Sep 17 00:34:30.818497 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.818472    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:30.821113 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.821086    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-07f9f2-openshift-default-dockercfg-9t655\""
Sep 17 00:34:30.829885 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.829860    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"]
Sep 17 00:34:30.945309 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.945271    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-socket\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:30.945492 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.945314    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-podinfo\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:30.945492 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.945399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49wjf\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-kube-api-access-49wjf\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:30.945492 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.945461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-credential-socket\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:30.945644 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.945524    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-certs\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:30.945644 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.945564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-token\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:30.945644 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.945603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-data\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:30.945644 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.945617    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istiod-ca-cert\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:30.945644 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:30.945637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-envoy\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.046553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.046518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-socket\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.046553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.046554    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-podinfo\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.046774 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.046604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49wjf\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-kube-api-access-49wjf\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.046774 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.046655    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-credential-socket\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.046774 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.046707    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-certs\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.046970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.046786    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-token\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.046970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.046837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-data\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.046970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.046862    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istiod-ca-cert\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.046970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.046889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-envoy\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.047191 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.047009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-socket\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.047191 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.047026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-credential-socket\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.047191 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.047138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-certs\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.047308 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.047238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-data\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.047628 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.047602    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istiod-ca-cert\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.049118 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.049102    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-envoy\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.049470 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.049453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-podinfo\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.054636 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.054607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-token\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.054810 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.054796    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49wjf\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-kube-api-access-49wjf\") pod \"e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") " pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.133706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.133681    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:31.408082 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.408055    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"]
Sep 17 00:34:31.409327 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:34:31.409298    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fa43e42_85b4_4f37_a4cd_3a5569b1f4bb.slice/crio-976b8224edfc9ad4aa8a723bcb8fa96795c3a75f49f8f53461cdba4816423a00 WatchSource:0}: Error finding container 976b8224edfc9ad4aa8a723bcb8fa96795c3a75f49f8f53461cdba4816423a00: Status 404 returned error can't find the container with id 976b8224edfc9ad4aa8a723bcb8fa96795c3a75f49f8f53461cdba4816423a00
Sep 17 00:34:31.411737 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.411699    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:34:31.411803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.411787    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:34:31.411860 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.411843    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:34:31.904577 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.904539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" event={"ID":"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb","Type":"ContainerStarted","Data":"c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98"}
Sep 17 00:34:31.905001 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.904595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" event={"ID":"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb","Type":"ContainerStarted","Data":"976b8224edfc9ad4aa8a723bcb8fa96795c3a75f49f8f53461cdba4816423a00"}
Sep 17 00:34:31.925706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:31.925654    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podStartSLOduration=1.925639723 podStartE2EDuration="1.925639723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:34:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:31.923481603 +0000 UTC m=+1473.032257517" watchObservedRunningTime="2026-09-17 00:34:31.925639723 +0000 UTC m=+1473.034415638"
Sep 17 00:34:32.134119 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:32.134089    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:32.139238 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:32.139214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:32.912141 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:32.912113    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:32.913111 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:32.913086    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:34:39.073438 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.073403    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"]
Sep 17 00:34:39.078169 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.078152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:39.080883 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.080858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-07f9f2-dockercfg-jf4sl\""
Sep 17 00:34:39.081003 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.080951    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-07f9f2\""
Sep 17 00:34:39.085877 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.085856    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"]
Sep 17 00:34:39.234273 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.234233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4a9862a-44e5-4694-8c90-f90b15f05019-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw\" (UID: \"d4a9862a-44e5-4694-8c90-f90b15f05019\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:39.234463 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.234360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67szr\" (UniqueName: \"kubernetes.io/projected/d4a9862a-44e5-4694-8c90-f90b15f05019-kube-api-access-67szr\") pod \"payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw\" (UID: \"d4a9862a-44e5-4694-8c90-f90b15f05019\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:39.335574 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.335494    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4a9862a-44e5-4694-8c90-f90b15f05019-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw\" (UID: \"d4a9862a-44e5-4694-8c90-f90b15f05019\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:39.335574 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.335566    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67szr\" (UniqueName: \"kubernetes.io/projected/d4a9862a-44e5-4694-8c90-f90b15f05019-kube-api-access-67szr\") pod \"payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw\" (UID: \"d4a9862a-44e5-4694-8c90-f90b15f05019\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:39.336220 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.336186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4a9862a-44e5-4694-8c90-f90b15f05019-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw\" (UID: \"d4a9862a-44e5-4694-8c90-f90b15f05019\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:39.342790 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.342765    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67szr\" (UniqueName: \"kubernetes.io/projected/d4a9862a-44e5-4694-8c90-f90b15f05019-kube-api-access-67szr\") pod \"payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw\" (UID: \"d4a9862a-44e5-4694-8c90-f90b15f05019\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:39.390746 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.390726    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:39.661297 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.661269    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"]
Sep 17 00:34:39.662942 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:34:39.662892    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4a9862a_44e5_4694_8c90_f90b15f05019.slice/crio-fe0a9a31495ad97f13bcfb3f2fd2b505f2463b35441050f5970cc451d3165c08 WatchSource:0}: Error finding container fe0a9a31495ad97f13bcfb3f2fd2b505f2463b35441050f5970cc451d3165c08: Status 404 returned error can't find the container with id fe0a9a31495ad97f13bcfb3f2fd2b505f2463b35441050f5970cc451d3165c08
Sep 17 00:34:39.958178 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.958094    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw" event={"ID":"d4a9862a-44e5-4694-8c90-f90b15f05019","Type":"ContainerStarted","Data":"0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526"}
Sep 17 00:34:39.958178 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.958156    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw" event={"ID":"d4a9862a-44e5-4694-8c90-f90b15f05019","Type":"ContainerStarted","Data":"fe0a9a31495ad97f13bcfb3f2fd2b505f2463b35441050f5970cc451d3165c08"}
Sep 17 00:34:39.958386 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.958298    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:39.985472 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:39.985416    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw" podStartSLOduration=0.98539979 podStartE2EDuration="985.39979ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:34:39.973437368 +0000 UTC m=+1481.082213284" watchObservedRunningTime="2026-09-17 00:34:39.98539979 +0000 UTC m=+1481.094175705"
Sep 17 00:34:50.966548 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:50.966516    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:34:59.441112 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:59.441079    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:34:59.473461 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:59.473434    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:34:59.542621 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:59.542588    2565 scope.go:117] "RemoveContainer" containerID="427e83b42234d604d659434a0bfce5436932d622859dc6cc52efbc98e403c935"
Sep 17 00:34:59.574357 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:34:59.574336    2565 scope.go:117] "RemoveContainer" containerID="fd0fb28a874928493b5616d3155b98d7f17638b85925406b2eec655db9217a66"
Sep 17 00:35:03.689079 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:03.689030    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:46554->10.133.0.76:15021: read: connection reset by peer" start-of-body=
Sep 17 00:35:03.689455 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:03.689140    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": read tcp 10.133.0.2:46554->10.133.0.76:15021: read: connection reset by peer"
Sep 17 00:35:04.116228 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:04.116191    2565 generic.go:356] "Generic (PLEG): container finished" podID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerID="c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98" exitCode=0
Sep 17 00:35:04.116388 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:04.116263    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" event={"ID":"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb","Type":"ContainerDied","Data":"c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98"}
Sep 17 00:35:04.116684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:04.116671    2565 scope.go:117] "RemoveContainer" containerID="c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98"
Sep 17 00:35:04.117826 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:04.117801    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:35:04.117890 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:04.117869    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:35:04.117962 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:04.117944    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:35:05.124527 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:05.124490    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" event={"ID":"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb","Type":"ContainerStarted","Data":"2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4"}
Sep 17 00:35:05.134095 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:05.134069    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:35:05.134284 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:05.134262    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 17 00:35:05.134335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:05.134311    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 17 00:35:06.134259 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:06.134223    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 17 00:35:06.134637 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:06.134280    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 17 00:35:07.134376 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:07.134346    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 17 00:35:07.134732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:07.134401    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 17 00:35:08.135007 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:08.134967    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 17 00:35:08.135376 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:08.135035    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 17 00:35:09.134481 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:09.134439    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 17 00:35:09.134715 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:09.134501    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 17 00:35:10.134613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:10.134577    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 17 00:35:10.135016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:10.134634    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 17 00:35:11.134463 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:11.134424    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 17 00:35:11.134645 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:11.134482    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 17 00:35:12.138798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:12.138770    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:35:12.139266 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:12.139171    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:35:12.139883 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:12.139865    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:35:14.548956 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:14.548879    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"]
Sep 17 00:35:14.553193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:14.553171    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"
Sep 17 00:35:14.555732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:14.555710    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:35:14.558439 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:14.558410    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"]
Sep 17 00:35:14.601963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:14.601935    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/033d1fc7-5863-4c0c-88de-25247b43fa4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm\" (UID: \"033d1fc7-5863-4c0c-88de-25247b43fa4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"
Sep 17 00:35:14.703481 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:14.703445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/033d1fc7-5863-4c0c-88de-25247b43fa4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm\" (UID: \"033d1fc7-5863-4c0c-88de-25247b43fa4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"
Sep 17 00:35:14.704100 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:14.704078    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/033d1fc7-5863-4c0c-88de-25247b43fa4b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm\" (UID: \"033d1fc7-5863-4c0c-88de-25247b43fa4b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"
Sep 17 00:35:14.869831 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:14.869795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"
Sep 17 00:35:15.144055 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:15.144022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"]
Sep 17 00:35:15.145283 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:35:15.145258    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod033d1fc7_5863_4c0c_88de_25247b43fa4b.slice/crio-f74209fd25027f0e7731d89c2dd9cfeab938660fe13ac0704637cbd69f2ad8ee WatchSource:0}: Error finding container f74209fd25027f0e7731d89c2dd9cfeab938660fe13ac0704637cbd69f2ad8ee: Status 404 returned error can't find the container with id f74209fd25027f0e7731d89c2dd9cfeab938660fe13ac0704637cbd69f2ad8ee
Sep 17 00:35:15.197248 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:15.197221    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm" event={"ID":"033d1fc7-5863-4c0c-88de-25247b43fa4b","Type":"ContainerStarted","Data":"f74209fd25027f0e7731d89c2dd9cfeab938660fe13ac0704637cbd69f2ad8ee"}
Sep 17 00:35:16.204538 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:16.204451    2565 generic.go:356] "Generic (PLEG): container finished" podID="033d1fc7-5863-4c0c-88de-25247b43fa4b" containerID="97d43324e01799e8d4b77e682465efee392890bd662fc8ed27579a17c883384f" exitCode=0
Sep 17 00:35:16.204925 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:16.204548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm" event={"ID":"033d1fc7-5863-4c0c-88de-25247b43fa4b","Type":"ContainerDied","Data":"97d43324e01799e8d4b77e682465efee392890bd662fc8ed27579a17c883384f"}
Sep 17 00:35:17.357258 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:17.357236    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"
Sep 17 00:35:17.431556 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:17.431523    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/033d1fc7-5863-4c0c-88de-25247b43fa4b-maas-api-service-ca\") pod \"033d1fc7-5863-4c0c-88de-25247b43fa4b\" (UID: \"033d1fc7-5863-4c0c-88de-25247b43fa4b\") "
Sep 17 00:35:17.431933 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:17.431879    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/033d1fc7-5863-4c0c-88de-25247b43fa4b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "033d1fc7-5863-4c0c-88de-25247b43fa4b" (UID: "033d1fc7-5863-4c0c-88de-25247b43fa4b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:35:17.533686 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:17.533592    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/033d1fc7-5863-4c0c-88de-25247b43fa4b-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:35:18.217991 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:18.217960    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"
Sep 17 00:35:18.218162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:18.218008    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm" event={"ID":"033d1fc7-5863-4c0c-88de-25247b43fa4b","Type":"ContainerDied","Data":"f74209fd25027f0e7731d89c2dd9cfeab938660fe13ac0704637cbd69f2ad8ee"}
Sep 17 00:35:18.218162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:18.218055    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f74209fd25027f0e7731d89c2dd9cfeab938660fe13ac0704637cbd69f2ad8ee"
Sep 17 00:35:30.263461 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:30.263369    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"]
Sep 17 00:35:30.276979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:30.276938    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-c5ae0fdd-c4mjm"]
Sep 17 00:35:31.390018 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:35:31.389984    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="033d1fc7-5863-4c0c-88de-25247b43fa4b" path="/var/lib/kubelet/pods/033d1fc7-5863-4c0c-88de-25247b43fa4b/volumes"
Sep 17 00:36:59.616719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:36:59.616646    2565 scope.go:117] "RemoveContainer" containerID="862cda38b90d5219b183e679e49ed856ec25706546d1ba93395f161a8617b2fb"
Sep 17 00:36:59.625773 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:36:59.625752    2565 scope.go:117] "RemoveContainer" containerID="f22629060c8f2d2382952c1200e2622ac3bae6ddb05982ba86a2bc001da38aa9"
Sep 17 00:36:59.634032 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:36:59.633974    2565 scope.go:117] "RemoveContainer" containerID="e3428c432e50ef7e4fadcf00da7e045038487aa6bafa4a4012ce1677623ee76d"
Sep 17 00:36:59.641860 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:36:59.641844    2565 scope.go:117] "RemoveContainer" containerID="d284789fb631ac714a761dfe14bebbb460d8232d845dce518771cf167a36c7eb"
Sep 17 00:37:39.223932 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.223879    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"]
Sep 17 00:37:39.224410 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.224383    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033d1fc7-5863-4c0c-88de-25247b43fa4b" containerName="revoke-keys"
Sep 17 00:37:39.224410 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.224394    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="033d1fc7-5863-4c0c-88de-25247b43fa4b" containerName="revoke-keys"
Sep 17 00:37:39.224485 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.224473    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="033d1fc7-5863-4c0c-88de-25247b43fa4b" containerName="revoke-keys"
Sep 17 00:37:39.227622 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.227604    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:39.230223 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.230198    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-0f806c\""
Sep 17 00:37:39.230337 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.230225    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-0f806c-dockercfg-d48fv\""
Sep 17 00:37:39.237437 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.237414    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"]
Sep 17 00:37:39.316168 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.316116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwpqp\" (UniqueName: \"kubernetes.io/projected/5829be9f-ed17-4d46-9578-88e06bd30df5-kube-api-access-gwpqp\") pod \"payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm\" (UID: \"5829be9f-ed17-4d46-9578-88e06bd30df5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:39.316365 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.316349    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5829be9f-ed17-4d46-9578-88e06bd30df5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm\" (UID: \"5829be9f-ed17-4d46-9578-88e06bd30df5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:39.417184 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.417146    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5829be9f-ed17-4d46-9578-88e06bd30df5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm\" (UID: \"5829be9f-ed17-4d46-9578-88e06bd30df5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:39.417381 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.417226    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwpqp\" (UniqueName: \"kubernetes.io/projected/5829be9f-ed17-4d46-9578-88e06bd30df5-kube-api-access-gwpqp\") pod \"payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm\" (UID: \"5829be9f-ed17-4d46-9578-88e06bd30df5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:39.417845 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.417819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5829be9f-ed17-4d46-9578-88e06bd30df5-plugins-config-volume\") pod \"payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm\" (UID: \"5829be9f-ed17-4d46-9578-88e06bd30df5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:39.424607 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.424584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwpqp\" (UniqueName: \"kubernetes.io/projected/5829be9f-ed17-4d46-9578-88e06bd30df5-kube-api-access-gwpqp\") pod \"payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm\" (UID: \"5829be9f-ed17-4d46-9578-88e06bd30df5\") " pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:39.538701 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.538620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:39.811015 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:39.810987    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"]
Sep 17 00:37:39.812306 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:37:39.812280    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5829be9f_ed17_4d46_9578_88e06bd30df5.slice/crio-f3cbbab95f2b15bf9cd10ec13a0e2274eb1b68e40f1ebbf61f48730542f9a24d WatchSource:0}: Error finding container f3cbbab95f2b15bf9cd10ec13a0e2274eb1b68e40f1ebbf61f48730542f9a24d: Status 404 returned error can't find the container with id f3cbbab95f2b15bf9cd10ec13a0e2274eb1b68e40f1ebbf61f48730542f9a24d
Sep 17 00:37:40.063381 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:40.063294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm" event={"ID":"5829be9f-ed17-4d46-9578-88e06bd30df5","Type":"ContainerStarted","Data":"d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80"}
Sep 17 00:37:40.063381 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:40.063352    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:40.063381 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:40.063369    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm" event={"ID":"5829be9f-ed17-4d46-9578-88e06bd30df5","Type":"ContainerStarted","Data":"f3cbbab95f2b15bf9cd10ec13a0e2274eb1b68e40f1ebbf61f48730542f9a24d"}
Sep 17 00:37:40.080181 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:40.080136    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm" podStartSLOduration=1.08012122 podStartE2EDuration="1.08012122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:37:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:37:40.077621112 +0000 UTC m=+1661.186397028" watchObservedRunningTime="2026-09-17 00:37:40.08012122 +0000 UTC m=+1661.188897131"
Sep 17 00:37:51.071069 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:51.071037    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:37:59.674992 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:37:59.674962    2565 scope.go:117] "RemoveContainer" containerID="f53b7751e00535d94d0f25afdf74ee0ecf2c38bb59f593a87ed3932ac1634886"
Sep 17 00:38:05.114774 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.114742    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"]
Sep 17 00:38:05.119921 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.119795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.125829 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.125804    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-1b3aae-openshift-default-dockercfg-mf55k\""
Sep 17 00:38:05.130871 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.130846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"]
Sep 17 00:38:05.264597 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.264554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-istio-token\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.264790 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.264637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-certs\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.264790 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.264657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b78826a-e59c-4211-b3b4-010083b20aee-istiod-ca-cert\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.264790 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.264689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-credential-socket\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.264790 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.264762    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-data\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.264790 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.264788    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b78826a-e59c-4211-b3b4-010083b20aee-istio-podinfo\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.265107 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.264866    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-envoy\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.265107 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.264966    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-socket\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.265107 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.265026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6grd\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-kube-api-access-r6grd\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.365921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-istio-token\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366009    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-certs\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366245 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b78826a-e59c-4211-b3b4-010083b20aee-istiod-ca-cert\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366245 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-credential-socket\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366245 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-data\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366245 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b78826a-e59c-4211-b3b4-010083b20aee-istio-podinfo\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366245 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-envoy\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366245 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-socket\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366545 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366391    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6grd\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-kube-api-access-r6grd\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366545 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366463    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-certs\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366655 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366540    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-credential-socket\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366806 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366786    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-data\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b78826a-e59c-4211-b3b4-010083b20aee-istiod-ca-cert\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.366866 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.366851    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-socket\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.368605 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.368582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-envoy\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.368696 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.368608    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b78826a-e59c-4211-b3b4-010083b20aee-istio-podinfo\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.377555 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.377532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-istio-token\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.378042 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.378016    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6grd\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-kube-api-access-r6grd\") pod \"e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") " pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.437735 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.437710    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:05.715248 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.715222    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"]
Sep 17 00:38:05.717705 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:38:05.717674    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b78826a_e59c_4211_b3b4_010083b20aee.slice/crio-c650cb0882f884f90fab8e7dfd287726d9bed67cd0478fbaa5c692da4c73898f WatchSource:0}: Error finding container c650cb0882f884f90fab8e7dfd287726d9bed67cd0478fbaa5c692da4c73898f: Status 404 returned error can't find the container with id c650cb0882f884f90fab8e7dfd287726d9bed67cd0478fbaa5c692da4c73898f
Sep 17 00:38:05.720102 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.720069    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:38:05.720186 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.720153    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:38:05.720186 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:05.720179    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:38:06.221709 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:06.221657    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" event={"ID":"3b78826a-e59c-4211-b3b4-010083b20aee","Type":"ContainerStarted","Data":"8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9"}
Sep 17 00:38:06.222222 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:06.221745    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" event={"ID":"3b78826a-e59c-4211-b3b4-010083b20aee","Type":"ContainerStarted","Data":"c650cb0882f884f90fab8e7dfd287726d9bed67cd0478fbaa5c692da4c73898f"}
Sep 17 00:38:06.242135 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:06.242085    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" podStartSLOduration=1.2420693489999999 podStartE2EDuration="1.242069349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:38:06.240747374 +0000 UTC m=+1687.349523288" watchObservedRunningTime="2026-09-17 00:38:06.242069349 +0000 UTC m=+1687.350845265"
Sep 17 00:38:06.438926 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:06.438885    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:06.444238 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:06.444211    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:07.228714 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:07.228678    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:07.229584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:07.229567    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:41.256432 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:41.256357    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"]
Sep 17 00:38:41.260407 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:41.260387    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"
Sep 17 00:38:41.263022 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:41.262997    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:38:41.267535 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:41.267509    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"]
Sep 17 00:38:41.425782 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:41.425744    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2193406-f358-494a-a481-1c8f7384a4bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv\" (UID: \"a2193406-f358-494a-a481-1c8f7384a4bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"
Sep 17 00:38:41.527209 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:41.527127    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2193406-f358-494a-a481-1c8f7384a4bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv\" (UID: \"a2193406-f358-494a-a481-1c8f7384a4bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"
Sep 17 00:38:41.527754 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:41.527734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2193406-f358-494a-a481-1c8f7384a4bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv\" (UID: \"a2193406-f358-494a-a481-1c8f7384a4bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"
Sep 17 00:38:41.575428 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:41.575401    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"
Sep 17 00:38:41.854206 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:41.854174    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"]
Sep 17 00:38:41.860722 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:38:41.860615    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2193406_f358_494a_a481_1c8f7384a4bb.slice/crio-311e138c68961dafd63e724c51e932f2d033177e90f969d8ea3d9c732d4f6984 WatchSource:0}: Error finding container 311e138c68961dafd63e724c51e932f2d033177e90f969d8ea3d9c732d4f6984: Status 404 returned error can't find the container with id 311e138c68961dafd63e724c51e932f2d033177e90f969d8ea3d9c732d4f6984
Sep 17 00:38:42.439305 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:42.439217    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv" event={"ID":"a2193406-f358-494a-a481-1c8f7384a4bb","Type":"ContainerStarted","Data":"bbbdabaeb94ec516c4d2170c9795d94e159cac2ffe4b4990b405230b66cbab85"}
Sep 17 00:38:42.439305 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:42.439278    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv" event={"ID":"a2193406-f358-494a-a481-1c8f7384a4bb","Type":"ContainerStarted","Data":"311e138c68961dafd63e724c51e932f2d033177e90f969d8ea3d9c732d4f6984"}
Sep 17 00:38:43.447877 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:43.447828    2565 generic.go:356] "Generic (PLEG): container finished" podID="a2193406-f358-494a-a481-1c8f7384a4bb" containerID="bbbdabaeb94ec516c4d2170c9795d94e159cac2ffe4b4990b405230b66cbab85" exitCode=0
Sep 17 00:38:43.448322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:43.447991    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv" event={"ID":"a2193406-f358-494a-a481-1c8f7384a4bb","Type":"ContainerDied","Data":"bbbdabaeb94ec516c4d2170c9795d94e159cac2ffe4b4990b405230b66cbab85"}
Sep 17 00:38:44.630145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:44.630122    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"
Sep 17 00:38:44.773879 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:44.773790    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2193406-f358-494a-a481-1c8f7384a4bb-maas-api-service-ca\") pod \"a2193406-f358-494a-a481-1c8f7384a4bb\" (UID: \"a2193406-f358-494a-a481-1c8f7384a4bb\") "
Sep 17 00:38:44.774133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:44.774109    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2193406-f358-494a-a481-1c8f7384a4bb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a2193406-f358-494a-a481-1c8f7384a4bb" (UID: "a2193406-f358-494a-a481-1c8f7384a4bb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:38:44.774207 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:44.774194    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2193406-f358-494a-a481-1c8f7384a4bb-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:38:45.469653 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:45.469608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv" event={"ID":"a2193406-f358-494a-a481-1c8f7384a4bb","Type":"ContainerDied","Data":"311e138c68961dafd63e724c51e932f2d033177e90f969d8ea3d9c732d4f6984"}
Sep 17 00:38:45.469826 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:45.469672    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="311e138c68961dafd63e724c51e932f2d033177e90f969d8ea3d9c732d4f6984"
Sep 17 00:38:45.469826 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:45.469738    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"
Sep 17 00:38:51.514104 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:51.514073    2565 generic.go:356] "Generic (PLEG): container finished" podID="3b78826a-e59c-4211-b3b4-010083b20aee" containerID="8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9" exitCode=0
Sep 17 00:38:51.514650 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:51.514152    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" event={"ID":"3b78826a-e59c-4211-b3b4-010083b20aee","Type":"ContainerDied","Data":"8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9"}
Sep 17 00:38:51.514752 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:51.514731    2565 scope.go:117] "RemoveContainer" containerID="8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9"
Sep 17 00:38:51.516093 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:51.516060    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:38:51.516191 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:51.516127    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:38:51.516191 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:51.516160    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 17 00:38:52.228698 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:52.228658    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:52.522585 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:52.522502    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" event={"ID":"3b78826a-e59c-4211-b3b4-010083b20aee","Type":"ContainerStarted","Data":"e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d"}
Sep 17 00:38:53.438642 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:53.438612    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:53.439912 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:53.439879    2565 patch_prober.go:28] interesting pod/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 00:38:53.440044 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:53.439945    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 00:38:54.438122 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:54.438086    2565 patch_prober.go:28] interesting pod/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 00:38:54.438502 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:54.438149    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 00:38:55.438623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:55.438586    2565 patch_prober.go:28] interesting pod/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 00:38:55.439040 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:55.438671    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 00:38:56.438761 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:56.438725    2565 patch_prober.go:28] interesting pod/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 00:38:56.439161 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:56.438777    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 00:38:57.068135 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.060032    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"]
Sep 17 00:38:57.068135 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.060332    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm" podUID="5829be9f-ed17-4d46-9578-88e06bd30df5" containerName="payload-processing" containerID="cri-o://d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80" gracePeriod=30
Sep 17 00:38:57.238082 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.238025    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"]
Sep 17 00:38:57.252169 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.252120    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0f806c-4vdgv"]
Sep 17 00:38:57.389642 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.389609    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:38:57.393370 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.393342    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2193406-f358-494a-a481-1c8f7384a4bb" path="/var/lib/kubelet/pods/a2193406-f358-494a-a481-1c8f7384a4bb/volumes"
Sep 17 00:38:57.414529 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.414498    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwpqp\" (UniqueName: \"kubernetes.io/projected/5829be9f-ed17-4d46-9578-88e06bd30df5-kube-api-access-gwpqp\") pod \"5829be9f-ed17-4d46-9578-88e06bd30df5\" (UID: \"5829be9f-ed17-4d46-9578-88e06bd30df5\") "
Sep 17 00:38:57.414676 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.414551    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5829be9f-ed17-4d46-9578-88e06bd30df5-plugins-config-volume\") pod \"5829be9f-ed17-4d46-9578-88e06bd30df5\" (UID: \"5829be9f-ed17-4d46-9578-88e06bd30df5\") "
Sep 17 00:38:57.415024 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.414984    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5829be9f-ed17-4d46-9578-88e06bd30df5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5829be9f-ed17-4d46-9578-88e06bd30df5" (UID: "5829be9f-ed17-4d46-9578-88e06bd30df5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:38:57.416825 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.416793    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5829be9f-ed17-4d46-9578-88e06bd30df5-kube-api-access-gwpqp" (OuterVolumeSpecName: "kube-api-access-gwpqp") pod "5829be9f-ed17-4d46-9578-88e06bd30df5" (UID: "5829be9f-ed17-4d46-9578-88e06bd30df5"). InnerVolumeSpecName "kube-api-access-gwpqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:38:57.438773 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.438747    2565 patch_prober.go:28] interesting pod/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Sep 17 00:38:57.439104 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.438793    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Sep 17 00:38:57.516260 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.516223    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwpqp\" (UniqueName: \"kubernetes.io/projected/5829be9f-ed17-4d46-9578-88e06bd30df5-kube-api-access-gwpqp\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:38:57.516260 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.516262    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5829be9f-ed17-4d46-9578-88e06bd30df5-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:38:57.569922 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.568953    2565 generic.go:356] "Generic (PLEG): container finished" podID="5829be9f-ed17-4d46-9578-88e06bd30df5" containerID="d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80" exitCode=0
Sep 17 00:38:57.569922 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.569075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm" event={"ID":"5829be9f-ed17-4d46-9578-88e06bd30df5","Type":"ContainerDied","Data":"d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80"}
Sep 17 00:38:57.569922 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.569124    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm" event={"ID":"5829be9f-ed17-4d46-9578-88e06bd30df5","Type":"ContainerDied","Data":"f3cbbab95f2b15bf9cd10ec13a0e2274eb1b68e40f1ebbf61f48730542f9a24d"}
Sep 17 00:38:57.569922 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.569157    2565 scope.go:117] "RemoveContainer" containerID="d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80"
Sep 17 00:38:57.569922 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.569331    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"
Sep 17 00:38:57.585714 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.585694    2565 scope.go:117] "RemoveContainer" containerID="d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80"
Sep 17 00:38:57.586038 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:38:57.586008    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80\": container with ID starting with d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80 not found: ID does not exist" containerID="d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80"
Sep 17 00:38:57.586099 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.586052    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80"} err="failed to get container status \"d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80\": rpc error: code = NotFound desc = could not find container \"d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80\": container with ID starting with d74c85ca5a375c39938e7b50ac921e921729d5a813ee8b9aef67231bef7eec80 not found: ID does not exist"
Sep 17 00:38:57.594668 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.594615    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"]
Sep 17 00:38:57.597848 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:57.597828    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-0f806c-699d98ccc-clvrm"]
Sep 17 00:38:58.443512 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:58.443481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:58.444017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:58.443796    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:58.444450 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:58.444429    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:38:59.390543 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:38:59.390505    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5829be9f-ed17-4d46-9578-88e06bd30df5" path="/var/lib/kubelet/pods/5829be9f-ed17-4d46-9578-88e06bd30df5/volumes"
Sep 17 00:39:01.998914 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:01.998867    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"]
Sep 17 00:39:01.999501 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:01.999484    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5829be9f-ed17-4d46-9578-88e06bd30df5" containerName="payload-processing"
Sep 17 00:39:01.999555 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:01.999504    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5829be9f-ed17-4d46-9578-88e06bd30df5" containerName="payload-processing"
Sep 17 00:39:01.999555 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:01.999518    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2193406-f358-494a-a481-1c8f7384a4bb" containerName="revoke-keys"
Sep 17 00:39:01.999555 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:01.999523    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2193406-f358-494a-a481-1c8f7384a4bb" containerName="revoke-keys"
Sep 17 00:39:01.999666 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:01.999608    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2193406-f358-494a-a481-1c8f7384a4bb" containerName="revoke-keys"
Sep 17 00:39:01.999666 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:01.999617    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5829be9f-ed17-4d46-9578-88e06bd30df5" containerName="payload-processing"
Sep 17 00:39:02.001732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:02.001714    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"
Sep 17 00:39:02.004286 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:02.004241    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:39:02.009034 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:02.009010    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"]
Sep 17 00:39:02.064770 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:02.064734    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e0a1c8-1e4e-482f-8874-f11e7d93002f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9\" (UID: \"f2e0a1c8-1e4e-482f-8874-f11e7d93002f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"
Sep 17 00:39:02.166147 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:02.166120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e0a1c8-1e4e-482f-8874-f11e7d93002f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9\" (UID: \"f2e0a1c8-1e4e-482f-8874-f11e7d93002f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"
Sep 17 00:39:02.166741 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:02.166716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e0a1c8-1e4e-482f-8874-f11e7d93002f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9\" (UID: \"f2e0a1c8-1e4e-482f-8874-f11e7d93002f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"
Sep 17 00:39:02.315107 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:02.315020    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"
Sep 17 00:39:02.585642 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:02.585613    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"]
Sep 17 00:39:02.587416 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:39:02.587390    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e0a1c8_1e4e_482f_8874_f11e7d93002f.slice/crio-9713a03651a6b3f0611a3a656bfbb9b034da1e74023ba999d1bbeb3b601885b2 WatchSource:0}: Error finding container 9713a03651a6b3f0611a3a656bfbb9b034da1e74023ba999d1bbeb3b601885b2: Status 404 returned error can't find the container with id 9713a03651a6b3f0611a3a656bfbb9b034da1e74023ba999d1bbeb3b601885b2
Sep 17 00:39:02.609338 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:02.609308    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9" event={"ID":"f2e0a1c8-1e4e-482f-8874-f11e7d93002f","Type":"ContainerStarted","Data":"9713a03651a6b3f0611a3a656bfbb9b034da1e74023ba999d1bbeb3b601885b2"}
Sep 17 00:39:03.618639 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:03.618603    2565 generic.go:356] "Generic (PLEG): container finished" podID="f2e0a1c8-1e4e-482f-8874-f11e7d93002f" containerID="5dda0d868d8c819f53f5da51b7edce98c050981c7d94dd9ffabbfb636799b5f5" exitCode=0
Sep 17 00:39:03.619104 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:03.618650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9" event={"ID":"f2e0a1c8-1e4e-482f-8874-f11e7d93002f","Type":"ContainerDied","Data":"5dda0d868d8c819f53f5da51b7edce98c050981c7d94dd9ffabbfb636799b5f5"}
Sep 17 00:39:04.167867 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.167829    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"]
Sep 17 00:39:04.170582 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.170565    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"
Sep 17 00:39:04.180793 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.178764    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"]
Sep 17 00:39:04.290819 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.290779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b258b1a-f288-481c-97be-9d1b4c7f6e72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf\" (UID: \"2b258b1a-f288-481c-97be-9d1b4c7f6e72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"
Sep 17 00:39:04.392160 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.392128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b258b1a-f288-481c-97be-9d1b4c7f6e72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf\" (UID: \"2b258b1a-f288-481c-97be-9d1b4c7f6e72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"
Sep 17 00:39:04.392723 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.392703    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b258b1a-f288-481c-97be-9d1b4c7f6e72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf\" (UID: \"2b258b1a-f288-481c-97be-9d1b4c7f6e72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"
Sep 17 00:39:04.485362 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.485274    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"
Sep 17 00:39:04.756503 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.756474    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"]
Sep 17 00:39:04.757666 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:39:04.757642    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b258b1a_f288_481c_97be_9d1b4c7f6e72.slice/crio-7c5109762b5111f171ca927df8fa5ba4183291562705cb8ce2c8e04c1356c00f WatchSource:0}: Error finding container 7c5109762b5111f171ca927df8fa5ba4183291562705cb8ce2c8e04c1356c00f: Status 404 returned error can't find the container with id 7c5109762b5111f171ca927df8fa5ba4183291562705cb8ce2c8e04c1356c00f
Sep 17 00:39:04.758016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.757994    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"
Sep 17 00:39:04.897039 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.897015    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e0a1c8-1e4e-482f-8874-f11e7d93002f-maas-api-service-ca\") pod \"f2e0a1c8-1e4e-482f-8874-f11e7d93002f\" (UID: \"f2e0a1c8-1e4e-482f-8874-f11e7d93002f\") "
Sep 17 00:39:04.897343 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.897323    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2e0a1c8-1e4e-482f-8874-f11e7d93002f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f2e0a1c8-1e4e-482f-8874-f11e7d93002f" (UID: "f2e0a1c8-1e4e-482f-8874-f11e7d93002f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:04.998384 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:04.998326    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2e0a1c8-1e4e-482f-8874-f11e7d93002f-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:05.633574 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:05.633547    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"
Sep 17 00:39:05.633751 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:05.633587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9" event={"ID":"f2e0a1c8-1e4e-482f-8874-f11e7d93002f","Type":"ContainerDied","Data":"9713a03651a6b3f0611a3a656bfbb9b034da1e74023ba999d1bbeb3b601885b2"}
Sep 17 00:39:05.633751 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:05.633639    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9713a03651a6b3f0611a3a656bfbb9b034da1e74023ba999d1bbeb3b601885b2"
Sep 17 00:39:05.635366 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:05.635340    2565 generic.go:356] "Generic (PLEG): container finished" podID="2b258b1a-f288-481c-97be-9d1b4c7f6e72" containerID="002ac7b10cad0c904448c045761a61506f6050f302ac2669db22177830a1b902" exitCode=0
Sep 17 00:39:05.635489 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:05.635408    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf" event={"ID":"2b258b1a-f288-481c-97be-9d1b4c7f6e72","Type":"ContainerDied","Data":"002ac7b10cad0c904448c045761a61506f6050f302ac2669db22177830a1b902"}
Sep 17 00:39:05.635489 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:05.635451    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf" event={"ID":"2b258b1a-f288-481c-97be-9d1b4c7f6e72","Type":"ContainerStarted","Data":"7c5109762b5111f171ca927df8fa5ba4183291562705cb8ce2c8e04c1356c00f"}
Sep 17 00:39:06.782014 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:06.781992    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"
Sep 17 00:39:06.917802 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:06.917680    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b258b1a-f288-481c-97be-9d1b4c7f6e72-maas-api-service-ca\") pod \"2b258b1a-f288-481c-97be-9d1b4c7f6e72\" (UID: \"2b258b1a-f288-481c-97be-9d1b4c7f6e72\") "
Sep 17 00:39:06.918093 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:06.918067    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b258b1a-f288-481c-97be-9d1b4c7f6e72-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b258b1a-f288-481c-97be-9d1b4c7f6e72" (UID: "2b258b1a-f288-481c-97be-9d1b4c7f6e72"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:06.918231 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:06.918218    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b258b1a-f288-481c-97be-9d1b4c7f6e72-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:07.650684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:07.650606    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"
Sep 17 00:39:07.650684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:07.650608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf" event={"ID":"2b258b1a-f288-481c-97be-9d1b4c7f6e72","Type":"ContainerDied","Data":"7c5109762b5111f171ca927df8fa5ba4183291562705cb8ce2c8e04c1356c00f"}
Sep 17 00:39:07.650684 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:07.650654    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7c5109762b5111f171ca927df8fa5ba4183291562705cb8ce2c8e04c1356c00f"
Sep 17 00:39:17.824220 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:17.824184    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"]
Sep 17 00:39:17.824803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:17.824477    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz" podUID="a57f8665-f960-4dc2-a74c-7157ca76ab04" containerName="payload-processing" containerID="cri-o://2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0" gracePeriod=30
Sep 17 00:39:17.831541 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:17.831513    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"]
Sep 17 00:39:17.831773 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:17.831730    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7" podUID="d2832458-5253-4ee7-be7d-7f5002605763" containerName="payload-pre-processing" containerID="cri-o://e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803" gracePeriod=30
Sep 17 00:39:17.985865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:17.985818    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"]
Sep 17 00:39:17.988510 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:17.988483    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-cfe049-58ms9"]
Sep 17 00:39:18.114707 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.113583    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:39:18.169885 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.169860    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:39:18.236838 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.236804    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tlxth\" (UniqueName: \"kubernetes.io/projected/a57f8665-f960-4dc2-a74c-7157ca76ab04-kube-api-access-tlxth\") pod \"a57f8665-f960-4dc2-a74c-7157ca76ab04\" (UID: \"a57f8665-f960-4dc2-a74c-7157ca76ab04\") "
Sep 17 00:39:18.237051 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.236924    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a57f8665-f960-4dc2-a74c-7157ca76ab04-plugins-config-volume\") pod \"a57f8665-f960-4dc2-a74c-7157ca76ab04\" (UID: \"a57f8665-f960-4dc2-a74c-7157ca76ab04\") "
Sep 17 00:39:18.237306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.237276    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a57f8665-f960-4dc2-a74c-7157ca76ab04-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a57f8665-f960-4dc2-a74c-7157ca76ab04" (UID: "a57f8665-f960-4dc2-a74c-7157ca76ab04"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:18.237424 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.237407    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a57f8665-f960-4dc2-a74c-7157ca76ab04-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.238936 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.238915    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a57f8665-f960-4dc2-a74c-7157ca76ab04-kube-api-access-tlxth" (OuterVolumeSpecName: "kube-api-access-tlxth") pod "a57f8665-f960-4dc2-a74c-7157ca76ab04" (UID: "a57f8665-f960-4dc2-a74c-7157ca76ab04"). InnerVolumeSpecName "kube-api-access-tlxth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:18.338525 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.338449    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74qt9\" (UniqueName: \"kubernetes.io/projected/d2832458-5253-4ee7-be7d-7f5002605763-kube-api-access-74qt9\") pod \"d2832458-5253-4ee7-be7d-7f5002605763\" (UID: \"d2832458-5253-4ee7-be7d-7f5002605763\") "
Sep 17 00:39:18.338525 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.338498    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2832458-5253-4ee7-be7d-7f5002605763-plugins-config-volume\") pod \"d2832458-5253-4ee7-be7d-7f5002605763\" (UID: \"d2832458-5253-4ee7-be7d-7f5002605763\") "
Sep 17 00:39:18.338800 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.338786    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tlxth\" (UniqueName: \"kubernetes.io/projected/a57f8665-f960-4dc2-a74c-7157ca76ab04-kube-api-access-tlxth\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.338881 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.338860    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2832458-5253-4ee7-be7d-7f5002605763-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2832458-5253-4ee7-be7d-7f5002605763" (UID: "d2832458-5253-4ee7-be7d-7f5002605763"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:18.340495 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.340472    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2832458-5253-4ee7-be7d-7f5002605763-kube-api-access-74qt9" (OuterVolumeSpecName: "kube-api-access-74qt9") pod "d2832458-5253-4ee7-be7d-7f5002605763" (UID: "d2832458-5253-4ee7-be7d-7f5002605763"). InnerVolumeSpecName "kube-api-access-74qt9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:18.439509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.439478    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74qt9\" (UniqueName: \"kubernetes.io/projected/d2832458-5253-4ee7-be7d-7f5002605763-kube-api-access-74qt9\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.439509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.439502    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2832458-5253-4ee7-be7d-7f5002605763-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:18.473938 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.473905    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"]
Sep 17 00:39:18.476613 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.476584    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1b3aae-srmqf"]
Sep 17 00:39:18.731711 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.731620    2565 generic.go:356] "Generic (PLEG): container finished" podID="a57f8665-f960-4dc2-a74c-7157ca76ab04" containerID="2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0" exitCode=0
Sep 17 00:39:18.731711 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.731671    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"
Sep 17 00:39:18.731959 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.731708    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz" event={"ID":"a57f8665-f960-4dc2-a74c-7157ca76ab04","Type":"ContainerDied","Data":"2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0"}
Sep 17 00:39:18.731959 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.731760    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz" event={"ID":"a57f8665-f960-4dc2-a74c-7157ca76ab04","Type":"ContainerDied","Data":"716870b3a69bcb4a3901637bd3b875595d39ffbd46e47cf48232ccff0b805c82"}
Sep 17 00:39:18.731959 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.731784    2565 scope.go:117] "RemoveContainer" containerID="2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0"
Sep 17 00:39:18.733200 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.733176    2565 generic.go:356] "Generic (PLEG): container finished" podID="d2832458-5253-4ee7-be7d-7f5002605763" containerID="e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803" exitCode=0
Sep 17 00:39:18.733319 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.733213    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7" event={"ID":"d2832458-5253-4ee7-be7d-7f5002605763","Type":"ContainerDied","Data":"e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803"}
Sep 17 00:39:18.733319 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.733229    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"
Sep 17 00:39:18.733319 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.733254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7" event={"ID":"d2832458-5253-4ee7-be7d-7f5002605763","Type":"ContainerDied","Data":"a954c3bd564af24d8d372812b19df4872f9097a60fecb911f86a2954cabc899d"}
Sep 17 00:39:18.741342 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.741323    2565 scope.go:117] "RemoveContainer" containerID="2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0"
Sep 17 00:39:18.741646 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:39:18.741622    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0\": container with ID starting with 2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0 not found: ID does not exist" containerID="2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0"
Sep 17 00:39:18.741728 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.741661    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0"} err="failed to get container status \"2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0\": rpc error: code = NotFound desc = could not find container \"2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0\": container with ID starting with 2820da977f41590277e124af97efff806f6cd64fdbc8073c454d1546dec307c0 not found: ID does not exist"
Sep 17 00:39:18.741728 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.741687    2565 scope.go:117] "RemoveContainer" containerID="e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803"
Sep 17 00:39:18.750517 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.750503    2565 scope.go:117] "RemoveContainer" containerID="e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803"
Sep 17 00:39:18.750760 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:39:18.750744    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803\": container with ID starting with e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803 not found: ID does not exist" containerID="e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803"
Sep 17 00:39:18.750801 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.750767    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803"} err="failed to get container status \"e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803\": rpc error: code = NotFound desc = could not find container \"e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803\": container with ID starting with e354406810d94b8a001635d8511314fdf89e365e4da40366d2d0f710fa910803 not found: ID does not exist"
Sep 17 00:39:18.758548 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.758527    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"]
Sep 17 00:39:18.761022 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.761002    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-cfe049-5987b94558-q5mv7"]
Sep 17 00:39:18.771479 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.771460    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"]
Sep 17 00:39:18.773584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:18.773566    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-cfe049-d899c755c-z5cbz"]
Sep 17 00:39:19.393979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:19.393943    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b258b1a-f288-481c-97be-9d1b4c7f6e72" path="/var/lib/kubelet/pods/2b258b1a-f288-481c-97be-9d1b4c7f6e72/volumes"
Sep 17 00:39:19.394565 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:19.394538    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a57f8665-f960-4dc2-a74c-7157ca76ab04" path="/var/lib/kubelet/pods/a57f8665-f960-4dc2-a74c-7157ca76ab04/volumes"
Sep 17 00:39:19.395284 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:19.395262    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2832458-5253-4ee7-be7d-7f5002605763" path="/var/lib/kubelet/pods/d2832458-5253-4ee7-be7d-7f5002605763/volumes"
Sep 17 00:39:19.395802 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:19.395763    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2e0a1c8-1e4e-482f-8874-f11e7d93002f" path="/var/lib/kubelet/pods/f2e0a1c8-1e4e-482f-8874-f11e7d93002f/volumes"
Sep 17 00:39:24.894003 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:24.893965    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"]
Sep 17 00:39:24.894391 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:24.894197    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy" containerID="cri-o://2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40" gracePeriod=30
Sep 17 00:39:26.205383 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.205350    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"]
Sep 17 00:39:26.205805 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.205579    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy" containerID="cri-o://e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d" gracePeriod=30
Sep 17 00:39:26.559029 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.558938    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"]
Sep 17 00:39:26.559513 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559494    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57f8665-f960-4dc2-a74c-7157ca76ab04" containerName="payload-processing"
Sep 17 00:39:26.559584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559514    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57f8665-f960-4dc2-a74c-7157ca76ab04" containerName="payload-processing"
Sep 17 00:39:26.559584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559525    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b258b1a-f288-481c-97be-9d1b4c7f6e72" containerName="revoke-keys"
Sep 17 00:39:26.559584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559531    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b258b1a-f288-481c-97be-9d1b4c7f6e72" containerName="revoke-keys"
Sep 17 00:39:26.559584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559546    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2e0a1c8-1e4e-482f-8874-f11e7d93002f" containerName="revoke-keys"
Sep 17 00:39:26.559584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559553    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2e0a1c8-1e4e-482f-8874-f11e7d93002f" containerName="revoke-keys"
Sep 17 00:39:26.559584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559565    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2832458-5253-4ee7-be7d-7f5002605763" containerName="payload-pre-processing"
Sep 17 00:39:26.559584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559570    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2832458-5253-4ee7-be7d-7f5002605763" containerName="payload-pre-processing"
Sep 17 00:39:26.559815 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559645    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2e0a1c8-1e4e-482f-8874-f11e7d93002f" containerName="revoke-keys"
Sep 17 00:39:26.559815 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559654    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57f8665-f960-4dc2-a74c-7157ca76ab04" containerName="payload-processing"
Sep 17 00:39:26.559815 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559660    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b258b1a-f288-481c-97be-9d1b4c7f6e72" containerName="revoke-keys"
Sep 17 00:39:26.559815 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.559666    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2832458-5253-4ee7-be7d-7f5002605763" containerName="payload-pre-processing"
Sep 17 00:39:26.568816 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.568782    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"
Sep 17 00:39:26.571828 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.571804    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:39:26.573384 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.573358    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"]
Sep 17 00:39:26.622579 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.622547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s\" (UID: \"bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"
Sep 17 00:39:26.723638 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.723604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s\" (UID: \"bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"
Sep 17 00:39:26.724247 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.724226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s\" (UID: \"bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"
Sep 17 00:39:26.884158 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:26.884117    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"
Sep 17 00:39:27.172706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:27.172625    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"]
Sep 17 00:39:27.177376 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:39:27.177347    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcadf4fb_2fb7_4fe0_a960_4f5e0ea8d7cc.slice/crio-c389959ae492a7784965fa74e6bb5d4c6e7e7cd76183cfcf79d69aa187bca62a WatchSource:0}: Error finding container c389959ae492a7784965fa74e6bb5d4c6e7e7cd76183cfcf79d69aa187bca62a: Status 404 returned error can't find the container with id c389959ae492a7784965fa74e6bb5d4c6e7e7cd76183cfcf79d69aa187bca62a
Sep 17 00:39:27.791971 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:27.791870    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s" event={"ID":"bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc","Type":"ContainerStarted","Data":"bbd442b92b30f93c765cb1840d6c4dd9b8988bee0f1666210c325e738126ed87"}
Sep 17 00:39:27.791971 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:27.791938    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s" event={"ID":"bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc","Type":"ContainerStarted","Data":"c389959ae492a7784965fa74e6bb5d4c6e7e7cd76183cfcf79d69aa187bca62a"}
Sep 17 00:39:27.809689 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:27.809640    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s" podStartSLOduration=1.809624974 podStartE2EDuration="1.809624974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:39:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:39:27.808811259 +0000 UTC m=+1768.917587177" watchObservedRunningTime="2026-09-17 00:39:27.809624974 +0000 UTC m=+1768.918400888"
Sep 17 00:39:28.419454 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:28.419417    2565 patch_prober.go:28] interesting pod/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:39:28.419645 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:28.419478    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:39:28.446354 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:28.446321    2565 patch_prober.go:28] interesting pod/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 17 00:39:28.446518 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:28.446371    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:39:28.800057 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:28.799969    2565 generic.go:356] "Generic (PLEG): container finished" podID="bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc" containerID="bbd442b92b30f93c765cb1840d6c4dd9b8988bee0f1666210c325e738126ed87" exitCode=0
Sep 17 00:39:28.800057 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:28.800041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s" event={"ID":"bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc","Type":"ContainerDied","Data":"bbd442b92b30f93c765cb1840d6c4dd9b8988bee0f1666210c325e738126ed87"}
Sep 17 00:39:30.023040 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.023018    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"
Sep 17 00:39:30.055307 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.055273    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc-maas-api-service-ca\") pod \"bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc\" (UID: \"bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc\") "
Sep 17 00:39:30.055689 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.055661    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc" (UID: "bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:30.055845 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.055825    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.154331 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.154309    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:39:30.256992 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.256951    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-podinfo\") pod \"52f37cd6-9067-4f28-96bd-19c0def3480b\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") "
Sep 17 00:39:30.257161 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257057    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-data\") pod \"52f37cd6-9067-4f28-96bd-19c0def3480b\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") "
Sep 17 00:39:30.257161 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257087    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52f37cd6-9067-4f28-96bd-19c0def3480b-istiod-ca-cert\") pod \"52f37cd6-9067-4f28-96bd-19c0def3480b\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") "
Sep 17 00:39:30.257278 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257169    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drmmv\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-kube-api-access-drmmv\") pod \"52f37cd6-9067-4f28-96bd-19c0def3480b\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") "
Sep 17 00:39:30.257278 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257210    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-token\") pod \"52f37cd6-9067-4f28-96bd-19c0def3480b\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") "
Sep 17 00:39:30.257381 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257338    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-envoy\") pod \"52f37cd6-9067-4f28-96bd-19c0def3480b\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") "
Sep 17 00:39:30.257439 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257386    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-certs\") pod \"52f37cd6-9067-4f28-96bd-19c0def3480b\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") "
Sep 17 00:39:30.257439 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257337    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-data" (OuterVolumeSpecName: "istio-data") pod "52f37cd6-9067-4f28-96bd-19c0def3480b" (UID: "52f37cd6-9067-4f28-96bd-19c0def3480b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:30.257549 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257466    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-credential-socket\") pod \"52f37cd6-9067-4f28-96bd-19c0def3480b\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") "
Sep 17 00:39:30.257549 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257493    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-socket\") pod \"52f37cd6-9067-4f28-96bd-19c0def3480b\" (UID: \"52f37cd6-9067-4f28-96bd-19c0def3480b\") "
Sep 17 00:39:30.257987 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257705    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52f37cd6-9067-4f28-96bd-19c0def3480b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "52f37cd6-9067-4f28-96bd-19c0def3480b" (UID: "52f37cd6-9067-4f28-96bd-19c0def3480b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:30.257987 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257725    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "52f37cd6-9067-4f28-96bd-19c0def3480b" (UID: "52f37cd6-9067-4f28-96bd-19c0def3480b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:30.257987 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257947    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "52f37cd6-9067-4f28-96bd-19c0def3480b" (UID: "52f37cd6-9067-4f28-96bd-19c0def3480b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:30.257987 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.257965    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "52f37cd6-9067-4f28-96bd-19c0def3480b" (UID: "52f37cd6-9067-4f28-96bd-19c0def3480b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:30.258304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.258230    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.258304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.258255    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/52f37cd6-9067-4f28-96bd-19c0def3480b-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.258304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.258269    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.258304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.258284    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.258304 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.258302    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.259501 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.259479    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-kube-api-access-drmmv" (OuterVolumeSpecName: "kube-api-access-drmmv") pod "52f37cd6-9067-4f28-96bd-19c0def3480b" (UID: "52f37cd6-9067-4f28-96bd-19c0def3480b"). InnerVolumeSpecName "kube-api-access-drmmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:30.259649 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.259632    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "52f37cd6-9067-4f28-96bd-19c0def3480b" (UID: "52f37cd6-9067-4f28-96bd-19c0def3480b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:39:30.259886 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.259862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "52f37cd6-9067-4f28-96bd-19c0def3480b" (UID: "52f37cd6-9067-4f28-96bd-19c0def3480b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:30.260187 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.260166    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-token" (OuterVolumeSpecName: "istio-token") pod "52f37cd6-9067-4f28-96bd-19c0def3480b" (UID: "52f37cd6-9067-4f28-96bd-19c0def3480b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:30.358978 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.358947    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drmmv\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-kube-api-access-drmmv\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.358978 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.358976    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.358978 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.358985    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.359209 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.358995    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/52f37cd6-9067-4f28-96bd-19c0def3480b-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:30.816271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.816175    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"
Sep 17 00:39:30.816271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.816206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s" event={"ID":"bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc","Type":"ContainerDied","Data":"c389959ae492a7784965fa74e6bb5d4c6e7e7cd76183cfcf79d69aa187bca62a"}
Sep 17 00:39:30.816271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.816265    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c389959ae492a7784965fa74e6bb5d4c6e7e7cd76183cfcf79d69aa187bca62a"
Sep 17 00:39:30.818359 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.818329    2565 generic.go:356] "Generic (PLEG): container finished" podID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerID="2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40" exitCode=0
Sep 17 00:39:30.818501 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.818403    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"
Sep 17 00:39:30.818501 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.818411    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" event={"ID":"52f37cd6-9067-4f28-96bd-19c0def3480b","Type":"ContainerDied","Data":"2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40"}
Sep 17 00:39:30.818501 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.818475    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6" event={"ID":"52f37cd6-9067-4f28-96bd-19c0def3480b","Type":"ContainerDied","Data":"96d34ae0b13ab315ba95c0658e574001eb53baeb701d3aa0670575239c6151aa"}
Sep 17 00:39:30.818501 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.818500    2565 scope.go:117] "RemoveContainer" containerID="2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40"
Sep 17 00:39:30.830348 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.830331    2565 scope.go:117] "RemoveContainer" containerID="87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7"
Sep 17 00:39:30.839700 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.839671    2565 scope.go:117] "RemoveContainer" containerID="2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40"
Sep 17 00:39:30.840128 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:39:30.840096    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40\": container with ID starting with 2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40 not found: ID does not exist" containerID="2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40"
Sep 17 00:39:30.840223 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.840151    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40"} err="failed to get container status \"2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40\": rpc error: code = NotFound desc = could not find container \"2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40\": container with ID starting with 2bbf00c8233ca47e577ba76da5c68932790f930fad9c8c09d8a6d96358acac40 not found: ID does not exist"
Sep 17 00:39:30.840223 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.840179    2565 scope.go:117] "RemoveContainer" containerID="87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7"
Sep 17 00:39:30.840516 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:39:30.840497    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7\": container with ID starting with 87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7 not found: ID does not exist" containerID="87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7"
Sep 17 00:39:30.840581 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.840521    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7"} err="failed to get container status \"87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7\": rpc error: code = NotFound desc = could not find container \"87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7\": container with ID starting with 87c824cc66a6b56982bf594c03339a2287eb44e242d856ed90f0f8769d1d05d7 not found: ID does not exist"
Sep 17 00:39:30.853821 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.853800    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"]
Sep 17 00:39:30.858651 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:30.858632    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-cfe049-openshift-default-789ff4c9cd-cxbs6"]
Sep 17 00:39:31.392040 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.392011    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" path="/var/lib/kubelet/pods/52f37cd6-9067-4f28-96bd-19c0def3480b/volumes"
Sep 17 00:39:31.468284 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.468227    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:39:31.571189 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571159    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6grd\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-kube-api-access-r6grd\") pod \"3b78826a-e59c-4211-b3b4-010083b20aee\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") "
Sep 17 00:39:31.571360 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571215    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-credential-socket\") pod \"3b78826a-e59c-4211-b3b4-010083b20aee\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") "
Sep 17 00:39:31.571360 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571288    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-istio-token\") pod \"3b78826a-e59c-4211-b3b4-010083b20aee\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") "
Sep 17 00:39:31.571360 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571354    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-envoy\") pod \"3b78826a-e59c-4211-b3b4-010083b20aee\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") "
Sep 17 00:39:31.571544 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-data\") pod \"3b78826a-e59c-4211-b3b4-010083b20aee\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") "
Sep 17 00:39:31.571544 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571476    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-socket\") pod \"3b78826a-e59c-4211-b3b4-010083b20aee\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") "
Sep 17 00:39:31.571544 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571533    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b78826a-e59c-4211-b3b4-010083b20aee-istio-podinfo\") pod \"3b78826a-e59c-4211-b3b4-010083b20aee\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") "
Sep 17 00:39:31.571699 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571540    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b78826a-e59c-4211-b3b4-010083b20aee" (UID: "3b78826a-e59c-4211-b3b4-010083b20aee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:31.571699 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571566    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-certs\") pod \"3b78826a-e59c-4211-b3b4-010083b20aee\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") "
Sep 17 00:39:31.571699 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571595    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b78826a-e59c-4211-b3b4-010083b20aee-istiod-ca-cert\") pod \"3b78826a-e59c-4211-b3b4-010083b20aee\" (UID: \"3b78826a-e59c-4211-b3b4-010083b20aee\") "
Sep 17 00:39:31.571865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571700    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b78826a-e59c-4211-b3b4-010083b20aee" (UID: "3b78826a-e59c-4211-b3b4-010083b20aee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:31.571865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.571813    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b78826a-e59c-4211-b3b4-010083b20aee" (UID: "3b78826a-e59c-4211-b3b4-010083b20aee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:31.572056 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.572035    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b78826a-e59c-4211-b3b4-010083b20aee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b78826a-e59c-4211-b3b4-010083b20aee" (UID: "3b78826a-e59c-4211-b3b4-010083b20aee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:31.572132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.572062    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:31.572132 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.572115    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:31.572444 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.572131    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:31.572444 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.572258    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b78826a-e59c-4211-b3b4-010083b20aee" (UID: "3b78826a-e59c-4211-b3b4-010083b20aee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:31.573568 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.573545    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b78826a-e59c-4211-b3b4-010083b20aee" (UID: "3b78826a-e59c-4211-b3b4-010083b20aee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:31.573686 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.573669    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b78826a-e59c-4211-b3b4-010083b20aee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b78826a-e59c-4211-b3b4-010083b20aee" (UID: "3b78826a-e59c-4211-b3b4-010083b20aee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:39:31.573838 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.573820    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-kube-api-access-r6grd" (OuterVolumeSpecName: "kube-api-access-r6grd") pod "3b78826a-e59c-4211-b3b4-010083b20aee" (UID: "3b78826a-e59c-4211-b3b4-010083b20aee"). InnerVolumeSpecName "kube-api-access-r6grd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:31.573926 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.573831    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b78826a-e59c-4211-b3b4-010083b20aee" (UID: "3b78826a-e59c-4211-b3b4-010083b20aee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:31.672637 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.672610    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:31.672637 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.672634    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:31.672798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.672644    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b78826a-e59c-4211-b3b4-010083b20aee-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:31.672798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.672653    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b78826a-e59c-4211-b3b4-010083b20aee-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:31.672798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.672661    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b78826a-e59c-4211-b3b4-010083b20aee-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:31.672798 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.672669    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6grd\" (UniqueName: \"kubernetes.io/projected/3b78826a-e59c-4211-b3b4-010083b20aee-kube-api-access-r6grd\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:31.828154 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.828119    2565 generic.go:356] "Generic (PLEG): container finished" podID="3b78826a-e59c-4211-b3b4-010083b20aee" containerID="e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d" exitCode=0
Sep 17 00:39:31.828341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.828159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" event={"ID":"3b78826a-e59c-4211-b3b4-010083b20aee","Type":"ContainerDied","Data":"e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d"}
Sep 17 00:39:31.828341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.828178    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"
Sep 17 00:39:31.828341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.828203    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc" event={"ID":"3b78826a-e59c-4211-b3b4-010083b20aee","Type":"ContainerDied","Data":"c650cb0882f884f90fab8e7dfd287726d9bed67cd0478fbaa5c692da4c73898f"}
Sep 17 00:39:31.828341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.828226    2565 scope.go:117] "RemoveContainer" containerID="e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d"
Sep 17 00:39:31.839539 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.839511    2565 scope.go:117] "RemoveContainer" containerID="8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9"
Sep 17 00:39:31.850250 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.850231    2565 scope.go:117] "RemoveContainer" containerID="e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d"
Sep 17 00:39:31.850554 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:39:31.850512    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d\": container with ID starting with e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d not found: ID does not exist" containerID="e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d"
Sep 17 00:39:31.850659 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.850558    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d"} err="failed to get container status \"e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d\": rpc error: code = NotFound desc = could not find container \"e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d\": container with ID starting with e66801d68711cd9276ec30119ae71f02faf7f166792043c1b279f51bb2f33e9d not found: ID does not exist"
Sep 17 00:39:31.850659 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.850577    2565 scope.go:117] "RemoveContainer" containerID="8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9"
Sep 17 00:39:31.850841 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:39:31.850824    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9\": container with ID starting with 8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9 not found: ID does not exist" containerID="8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9"
Sep 17 00:39:31.850882 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.850847    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9"} err="failed to get container status \"8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9\": rpc error: code = NotFound desc = could not find container \"8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9\": container with ID starting with 8111c9cdbd2eca42a35652cd14f90acab39e962f6e96cd4468c5b80509342aa9 not found: ID does not exist"
Sep 17 00:39:31.851257 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.851238    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"]
Sep 17 00:39:31.855063 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:31.855037    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-1b3aae-openshift-default-6c87ff896-m2zrc"]
Sep 17 00:39:33.389645 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:33.389611    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" path="/var/lib/kubelet/pods/3b78826a-e59c-4211-b3b4-010083b20aee/volumes"
Sep 17 00:39:37.411737 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:37.411705    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"]
Sep 17 00:39:37.413882 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:37.413862    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-48e479-vlz7s"]
Sep 17 00:39:39.390163 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:39.390131    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc" path="/var/lib/kubelet/pods/bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc/volumes"
Sep 17 00:39:43.798656 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:43.798614    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"]
Sep 17 00:39:43.799086 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:43.798834    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy" containerID="cri-o://c22b8e92a3ba9d216abe00457d7c45b7d692c8b8b2ee2f2ab69b4a7f57331dc7" gracePeriod=30
Sep 17 00:39:44.137787 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.137752    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"]
Sep 17 00:39:44.138225 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138212    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy"
Sep 17 00:39:44.138225 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138226    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy"
Sep 17 00:39:44.138306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138234    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy"
Sep 17 00:39:44.138306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138240    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy"
Sep 17 00:39:44.138306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138247    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy"
Sep 17 00:39:44.138306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138253    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy"
Sep 17 00:39:44.138306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138276    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc" containerName="revoke-keys"
Sep 17 00:39:44.138306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138282    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc" containerName="revoke-keys"
Sep 17 00:39:44.138488 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138347    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy"
Sep 17 00:39:44.138488 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138353    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy"
Sep 17 00:39:44.138488 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138361    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy"
Sep 17 00:39:44.138488 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138368    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b78826a-e59c-4211-b3b4-010083b20aee" containerName="istio-proxy"
Sep 17 00:39:44.138488 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.138374    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcadf4fb-2fb7-4fe0-a960-4f5e0ea8d7cc" containerName="revoke-keys"
Sep 17 00:39:44.142511 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.142493    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"
Sep 17 00:39:44.145213 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.145185    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:39:44.147446 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.147420    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"]
Sep 17 00:39:44.300690 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.300653    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d5496c-0a4d-4b86-8756-acde1d485540-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv\" (UID: \"f4d5496c-0a4d-4b86-8756-acde1d485540\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"
Sep 17 00:39:44.402029 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.401946    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d5496c-0a4d-4b86-8756-acde1d485540-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv\" (UID: \"f4d5496c-0a4d-4b86-8756-acde1d485540\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"
Sep 17 00:39:44.402585 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.402564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d5496c-0a4d-4b86-8756-acde1d485540-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv\" (UID: \"f4d5496c-0a4d-4b86-8756-acde1d485540\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"
Sep 17 00:39:44.458864 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.458831    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"
Sep 17 00:39:44.734057 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.734026    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"]
Sep 17 00:39:44.735976 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:39:44.735948    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d5496c_0a4d_4b86_8756_acde1d485540.slice/crio-3d91e447d4c26ea94b42bcba345a6e5a8d06534f591138461fa9a2291a356dd5 WatchSource:0}: Error finding container 3d91e447d4c26ea94b42bcba345a6e5a8d06534f591138461fa9a2291a356dd5: Status 404 returned error can't find the container with id 3d91e447d4c26ea94b42bcba345a6e5a8d06534f591138461fa9a2291a356dd5
Sep 17 00:39:44.912150 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:44.912116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv" event={"ID":"f4d5496c-0a4d-4b86-8756-acde1d485540","Type":"ContainerStarted","Data":"3d91e447d4c26ea94b42bcba345a6e5a8d06534f591138461fa9a2291a356dd5"}
Sep 17 00:39:45.920405 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:45.920371    2565 generic.go:356] "Generic (PLEG): container finished" podID="f4d5496c-0a4d-4b86-8756-acde1d485540" containerID="62dce9827b208730255d2a2901c835822e29972083d9dc2dd0d754e36a7bc8c8" exitCode=0
Sep 17 00:39:45.920821 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:45.920457    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv" event={"ID":"f4d5496c-0a4d-4b86-8756-acde1d485540","Type":"ContainerDied","Data":"62dce9827b208730255d2a2901c835822e29972083d9dc2dd0d754e36a7bc8c8"}
Sep 17 00:39:47.073072 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:47.073041    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"
Sep 17 00:39:47.231867 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:47.231766    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d5496c-0a4d-4b86-8756-acde1d485540-maas-api-service-ca\") pod \"f4d5496c-0a4d-4b86-8756-acde1d485540\" (UID: \"f4d5496c-0a4d-4b86-8756-acde1d485540\") "
Sep 17 00:39:47.232121 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:47.232098    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4d5496c-0a4d-4b86-8756-acde1d485540-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4d5496c-0a4d-4b86-8756-acde1d485540" (UID: "f4d5496c-0a4d-4b86-8756-acde1d485540"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:47.332904 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:47.332857    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4d5496c-0a4d-4b86-8756-acde1d485540-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:47.933886 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:47.933854    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"
Sep 17 00:39:47.934082 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:47.933893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv" event={"ID":"f4d5496c-0a4d-4b86-8756-acde1d485540","Type":"ContainerDied","Data":"3d91e447d4c26ea94b42bcba345a6e5a8d06534f591138461fa9a2291a356dd5"}
Sep 17 00:39:47.934082 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:47.933950    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d91e447d4c26ea94b42bcba345a6e5a8d06534f591138461fa9a2291a356dd5"
Sep 17 00:39:48.944906 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:48.944873    2565 generic.go:356] "Generic (PLEG): container finished" podID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerID="c22b8e92a3ba9d216abe00457d7c45b7d692c8b8b2ee2f2ab69b4a7f57331dc7" exitCode=0
Sep 17 00:39:48.945240 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:48.944946    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" event={"ID":"d9d827ba-5b11-4ee3-af08-1613f64c08de","Type":"ContainerDied","Data":"c22b8e92a3ba9d216abe00457d7c45b7d692c8b8b2ee2f2ab69b4a7f57331dc7"}
Sep 17 00:39:48.945240 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:48.945024    2565 scope.go:117] "RemoveContainer" containerID="e990c747e6f692b096fdbcb819a5a630c1a82fcb7d0085bcbfe2e46aac3ce206"
Sep 17 00:39:49.069589 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.069531    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:39:49.250476 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-envoy\") pod \"d9d827ba-5b11-4ee3-af08-1613f64c08de\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") "
Sep 17 00:39:49.250476 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250481    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9d827ba-5b11-4ee3-af08-1613f64c08de-istiod-ca-cert\") pod \"d9d827ba-5b11-4ee3-af08-1613f64c08de\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") "
Sep 17 00:39:49.250681 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250553    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmsbh\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-kube-api-access-gmsbh\") pod \"d9d827ba-5b11-4ee3-af08-1613f64c08de\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") "
Sep 17 00:39:49.250681 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250582    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-data\") pod \"d9d827ba-5b11-4ee3-af08-1613f64c08de\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") "
Sep 17 00:39:49.250681 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250615    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-certs\") pod \"d9d827ba-5b11-4ee3-af08-1613f64c08de\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") "
Sep 17 00:39:49.250818 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250690    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-podinfo\") pod \"d9d827ba-5b11-4ee3-af08-1613f64c08de\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") "
Sep 17 00:39:49.250818 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-credential-socket\") pod \"d9d827ba-5b11-4ee3-af08-1613f64c08de\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") "
Sep 17 00:39:49.250818 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250746    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-socket\") pod \"d9d827ba-5b11-4ee3-af08-1613f64c08de\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") "
Sep 17 00:39:49.250818 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250778    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-token\") pod \"d9d827ba-5b11-4ee3-af08-1613f64c08de\" (UID: \"d9d827ba-5b11-4ee3-af08-1613f64c08de\") "
Sep 17 00:39:49.251071 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250841    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-data" (OuterVolumeSpecName: "istio-data") pod "d9d827ba-5b11-4ee3-af08-1613f64c08de" (UID: "d9d827ba-5b11-4ee3-af08-1613f64c08de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:49.251071 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.250967    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d9d827ba-5b11-4ee3-af08-1613f64c08de" (UID: "d9d827ba-5b11-4ee3-af08-1613f64c08de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:49.251071 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.251005    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9d827ba-5b11-4ee3-af08-1613f64c08de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d9d827ba-5b11-4ee3-af08-1613f64c08de" (UID: "d9d827ba-5b11-4ee3-af08-1613f64c08de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:49.251227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.251070    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d9d827ba-5b11-4ee3-af08-1613f64c08de" (UID: "d9d827ba-5b11-4ee3-af08-1613f64c08de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:49.251227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.251167    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d9d827ba-5b11-4ee3-af08-1613f64c08de" (UID: "d9d827ba-5b11-4ee3-af08-1613f64c08de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:49.251227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.251218    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.251377 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.251233    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.251377 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.251241    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.251377 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.251249    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9d827ba-5b11-4ee3-af08-1613f64c08de-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.252732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.252699    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-kube-api-access-gmsbh" (OuterVolumeSpecName: "kube-api-access-gmsbh") pod "d9d827ba-5b11-4ee3-af08-1613f64c08de" (UID: "d9d827ba-5b11-4ee3-af08-1613f64c08de"). InnerVolumeSpecName "kube-api-access-gmsbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:49.252846 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.252742    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d9d827ba-5b11-4ee3-af08-1613f64c08de" (UID: "d9d827ba-5b11-4ee3-af08-1613f64c08de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:39:49.253294 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.253250    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d9d827ba-5b11-4ee3-af08-1613f64c08de" (UID: "d9d827ba-5b11-4ee3-af08-1613f64c08de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:39:49.253384 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.253285    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-token" (OuterVolumeSpecName: "istio-token") pod "d9d827ba-5b11-4ee3-af08-1613f64c08de" (UID: "d9d827ba-5b11-4ee3-af08-1613f64c08de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:49.352013 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.351988    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.352013 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.352008    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.352162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.352019    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.352162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.352027    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9d827ba-5b11-4ee3-af08-1613f64c08de-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.352162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.352036    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmsbh\" (UniqueName: \"kubernetes.io/projected/d9d827ba-5b11-4ee3-af08-1613f64c08de-kube-api-access-gmsbh\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:49.953009 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.952975    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42" event={"ID":"d9d827ba-5b11-4ee3-af08-1613f64c08de","Type":"ContainerDied","Data":"e70abceaeddd74bd8f2be417d904ae59f00cae67d6df3b0a336071947b5f9741"}
Sep 17 00:39:49.953451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.953029    2565 scope.go:117] "RemoveContainer" containerID="c22b8e92a3ba9d216abe00457d7c45b7d692c8b8b2ee2f2ab69b4a7f57331dc7"
Sep 17 00:39:49.953451 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.952990    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"
Sep 17 00:39:49.970283 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.970249    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"]
Sep 17 00:39:49.975860 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:49.975837    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-48e479-openshift-default-67cf754568-f2z42"]
Sep 17 00:39:51.397369 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.397334    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" path="/var/lib/kubelet/pods/d9d827ba-5b11-4ee3-af08-1613f64c08de/volumes"
Sep 17 00:39:51.502328 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502294    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"]
Sep 17 00:39:51.502771 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502758    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4d5496c-0a4d-4b86-8756-acde1d485540" containerName="revoke-keys"
Sep 17 00:39:51.502822 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502773    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4d5496c-0a4d-4b86-8756-acde1d485540" containerName="revoke-keys"
Sep 17 00:39:51.502822 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502780    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy"
Sep 17 00:39:51.502822 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502785    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy"
Sep 17 00:39:51.502822 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502794    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy"
Sep 17 00:39:51.502822 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502800    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy"
Sep 17 00:39:51.502822 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502808    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy"
Sep 17 00:39:51.502822 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502813    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="52f37cd6-9067-4f28-96bd-19c0def3480b" containerName="istio-proxy"
Sep 17 00:39:51.503051 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502882    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy"
Sep 17 00:39:51.503051 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.502892    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4d5496c-0a4d-4b86-8756-acde1d485540" containerName="revoke-keys"
Sep 17 00:39:51.507472 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.507455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"
Sep 17 00:39:51.510098 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.510076    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:39:51.512395 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.512368    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"]
Sep 17 00:39:51.672488 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.672405    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec28f4-1cd7-4f39-86dd-312c3dd9a406-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s\" (UID: \"7aec28f4-1cd7-4f39-86dd-312c3dd9a406\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"
Sep 17 00:39:51.773303 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.773268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec28f4-1cd7-4f39-86dd-312c3dd9a406-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s\" (UID: \"7aec28f4-1cd7-4f39-86dd-312c3dd9a406\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"
Sep 17 00:39:51.773879 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.773857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec28f4-1cd7-4f39-86dd-312c3dd9a406-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s\" (UID: \"7aec28f4-1cd7-4f39-86dd-312c3dd9a406\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"
Sep 17 00:39:51.820720 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:51.820694    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"
Sep 17 00:39:52.091153 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:52.091122    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"]
Sep 17 00:39:52.092745 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:39:52.092713    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aec28f4_1cd7_4f39_86dd_312c3dd9a406.slice/crio-8ffc820f6452b45221a22415d61ca777c273afd0db8eee68e1c9d5e3f7d1219a WatchSource:0}: Error finding container 8ffc820f6452b45221a22415d61ca777c273afd0db8eee68e1c9d5e3f7d1219a: Status 404 returned error can't find the container with id 8ffc820f6452b45221a22415d61ca777c273afd0db8eee68e1c9d5e3f7d1219a
Sep 17 00:39:52.974226 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:52.974143    2565 generic.go:356] "Generic (PLEG): container finished" podID="7aec28f4-1cd7-4f39-86dd-312c3dd9a406" containerID="cb8bddff913d46430e878d7f173ba26ddb6b8199dd020aadca52ad437a147c33" exitCode=0
Sep 17 00:39:52.974685 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:52.974249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s" event={"ID":"7aec28f4-1cd7-4f39-86dd-312c3dd9a406","Type":"ContainerDied","Data":"cb8bddff913d46430e878d7f173ba26ddb6b8199dd020aadca52ad437a147c33"}
Sep 17 00:39:52.974685 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:52.974293    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s" event={"ID":"7aec28f4-1cd7-4f39-86dd-312c3dd9a406","Type":"ContainerStarted","Data":"8ffc820f6452b45221a22415d61ca777c273afd0db8eee68e1c9d5e3f7d1219a"}
Sep 17 00:39:54.139415 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:54.139387    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"
Sep 17 00:39:54.297244 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:54.297164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec28f4-1cd7-4f39-86dd-312c3dd9a406-maas-api-service-ca\") pod \"7aec28f4-1cd7-4f39-86dd-312c3dd9a406\" (UID: \"7aec28f4-1cd7-4f39-86dd-312c3dd9a406\") "
Sep 17 00:39:54.297554 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:54.297534    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aec28f4-1cd7-4f39-86dd-312c3dd9a406-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7aec28f4-1cd7-4f39-86dd-312c3dd9a406" (UID: "7aec28f4-1cd7-4f39-86dd-312c3dd9a406"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:54.398859 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:54.398827    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aec28f4-1cd7-4f39-86dd-312c3dd9a406-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:54.989887 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:54.989856    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"
Sep 17 00:39:54.990075 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:54.989889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s" event={"ID":"7aec28f4-1cd7-4f39-86dd-312c3dd9a406","Type":"ContainerDied","Data":"8ffc820f6452b45221a22415d61ca777c273afd0db8eee68e1c9d5e3f7d1219a"}
Sep 17 00:39:54.990075 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:54.989949    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ffc820f6452b45221a22415d61ca777c273afd0db8eee68e1c9d5e3f7d1219a"
Sep 17 00:39:56.111590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.111554    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"]
Sep 17 00:39:56.112089 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.111818    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26" podUID="1fdb9b63-efe6-4acc-b519-469b0f8fff2a" containerName="payload-processing" containerID="cri-o://2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e" gracePeriod=30
Sep 17 00:39:56.119578 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.119554    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"]
Sep 17 00:39:56.119795 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.119761    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth" podUID="1ce9622e-2369-4a1f-8839-b4bfabacd0d3" containerName="payload-pre-processing" containerID="cri-o://80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b" gracePeriod=30
Sep 17 00:39:56.263679 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.263638    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"]
Sep 17 00:39:56.271639 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.271606    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-edbd82-hz9sv"]
Sep 17 00:39:56.408192 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.408173    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:39:56.411506 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.411488    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:39:56.414477 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.414453    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zxpj\" (UniqueName: \"kubernetes.io/projected/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-kube-api-access-4zxpj\") pod \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\" (UID: \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\") "
Sep 17 00:39:56.414575 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.414520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26548\" (UniqueName: \"kubernetes.io/projected/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-kube-api-access-26548\") pod \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\" (UID: \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\") "
Sep 17 00:39:56.414624 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.414589    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-plugins-config-volume\") pod \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\" (UID: \"1fdb9b63-efe6-4acc-b519-469b0f8fff2a\") "
Sep 17 00:39:56.414681 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.414641    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-plugins-config-volume\") pod \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\" (UID: \"1ce9622e-2369-4a1f-8839-b4bfabacd0d3\") "
Sep 17 00:39:56.415019 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.414980    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1fdb9b63-efe6-4acc-b519-469b0f8fff2a" (UID: "1fdb9b63-efe6-4acc-b519-469b0f8fff2a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:56.415259 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.415234    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1ce9622e-2369-4a1f-8839-b4bfabacd0d3" (UID: "1ce9622e-2369-4a1f-8839-b4bfabacd0d3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:39:56.416853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.416832    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-kube-api-access-26548" (OuterVolumeSpecName: "kube-api-access-26548") pod "1fdb9b63-efe6-4acc-b519-469b0f8fff2a" (UID: "1fdb9b63-efe6-4acc-b519-469b0f8fff2a"). InnerVolumeSpecName "kube-api-access-26548". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:56.416993 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.416949    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-kube-api-access-4zxpj" (OuterVolumeSpecName: "kube-api-access-4zxpj") pod "1ce9622e-2369-4a1f-8839-b4bfabacd0d3" (UID: "1ce9622e-2369-4a1f-8839-b4bfabacd0d3"). InnerVolumeSpecName "kube-api-access-4zxpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:39:56.452010 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.451909    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"]
Sep 17 00:39:56.515545 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.515516    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zxpj\" (UniqueName: \"kubernetes.io/projected/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-kube-api-access-4zxpj\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:56.515545 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.515541    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26548\" (UniqueName: \"kubernetes.io/projected/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-kube-api-access-26548\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:56.515545 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.515550    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1fdb9b63-efe6-4acc-b519-469b0f8fff2a-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:56.515760 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:56.515559    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ce9622e-2369-4a1f-8839-b4bfabacd0d3-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:39:57.003993 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.003953    2565 generic.go:356] "Generic (PLEG): container finished" podID="1fdb9b63-efe6-4acc-b519-469b0f8fff2a" containerID="2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e" exitCode=0
Sep 17 00:39:57.004162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.004004    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"
Sep 17 00:39:57.004162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.004040    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26" event={"ID":"1fdb9b63-efe6-4acc-b519-469b0f8fff2a","Type":"ContainerDied","Data":"2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e"}
Sep 17 00:39:57.004162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.004097    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26" event={"ID":"1fdb9b63-efe6-4acc-b519-469b0f8fff2a","Type":"ContainerDied","Data":"aa76a4fdd7a842d2cfbb03986600b4bc63ddf9438539c2eb0bdc0f0e60c66938"}
Sep 17 00:39:57.004162 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.004120    2565 scope.go:117] "RemoveContainer" containerID="2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e"
Sep 17 00:39:57.005536 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.005509    2565 generic.go:356] "Generic (PLEG): container finished" podID="1ce9622e-2369-4a1f-8839-b4bfabacd0d3" containerID="80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b" exitCode=0
Sep 17 00:39:57.005661 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.005541    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"
Sep 17 00:39:57.005661 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.005582    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth" event={"ID":"1ce9622e-2369-4a1f-8839-b4bfabacd0d3","Type":"ContainerDied","Data":"80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b"}
Sep 17 00:39:57.005661 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.005633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth" event={"ID":"1ce9622e-2369-4a1f-8839-b4bfabacd0d3","Type":"ContainerDied","Data":"f3a66e17836ad0a373c2e024c5f541343a2d8697cb1f7956924235e239826ade"}
Sep 17 00:39:57.014498 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.014369    2565 scope.go:117] "RemoveContainer" containerID="2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e"
Sep 17 00:39:57.014987 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:39:57.014888    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e\": container with ID starting with 2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e not found: ID does not exist" containerID="2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e"
Sep 17 00:39:57.014987 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.014952    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e"} err="failed to get container status \"2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e\": rpc error: code = NotFound desc = could not find container \"2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e\": container with ID starting with 2256376cb8e21b5c13fb6280941afe34b9aaf6cc503d25989f0e8b408ab9ee8e not found: ID does not exist"
Sep 17 00:39:57.014987 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.014978    2565 scope.go:117] "RemoveContainer" containerID="80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b"
Sep 17 00:39:57.030520 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.030495    2565 scope.go:117] "RemoveContainer" containerID="80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b"
Sep 17 00:39:57.030930 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:39:57.030865    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b\": container with ID starting with 80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b not found: ID does not exist" containerID="80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b"
Sep 17 00:39:57.031053 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.030921    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b"} err="failed to get container status \"80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b\": rpc error: code = NotFound desc = could not find container \"80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b\": container with ID starting with 80acc785a9009b68437a459702ff71535f3d68cec509c646fe640d492e42375b not found: ID does not exist"
Sep 17 00:39:57.034232 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.034207    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"]
Sep 17 00:39:57.037197 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.037176    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-edbd82-6dfb9fcb69-szr26"]
Sep 17 00:39:57.049259 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.049239    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"]
Sep 17 00:39:57.054609 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.054589    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-edbd82-55d57cbfc4-k6gth"]
Sep 17 00:39:57.389774 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.389743    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ce9622e-2369-4a1f-8839-b4bfabacd0d3" path="/var/lib/kubelet/pods/1ce9622e-2369-4a1f-8839-b4bfabacd0d3/volumes"
Sep 17 00:39:57.390152 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.390097    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fdb9b63-efe6-4acc-b519-469b0f8fff2a" path="/var/lib/kubelet/pods/1fdb9b63-efe6-4acc-b519-469b0f8fff2a/volumes"
Sep 17 00:39:57.390383 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:57.390371    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4d5496c-0a4d-4b86-8756-acde1d485540" path="/var/lib/kubelet/pods/f4d5496c-0a4d-4b86-8756-acde1d485540/volumes"
Sep 17 00:39:59.480655 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:59.480630    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:39:59.521942 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:59.521889    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:39:59.709809 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:59.709780    2565 scope.go:117] "RemoveContainer" containerID="feb197c54e8af8277585b65e661fbe021f9727811ab1ba7a1e3fd3569e59037c"
Sep 17 00:39:59.718087 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:39:59.718066    2565 scope.go:117] "RemoveContainer" containerID="060b74f9c02d4438373622e51a6f9685488f8869b88fec72eb9b9163cb16aa75"
Sep 17 00:40:07.445031 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.444999    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh"]
Sep 17 00:40:07.449953 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.449924    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-2faea3-29826750-fqxqh"]
Sep 17 00:40:07.469326 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.469289    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"]
Sep 17 00:40:07.469573 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.469525    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb" podUID="99a9568f-1e43-46ed-8143-7872572f1617" containerName="payload-processing" containerID="cri-o://60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592" gracePeriod=30
Sep 17 00:40:07.476633 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.476607    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"]
Sep 17 00:40:07.477299 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.477002    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b" podUID="d8d251dd-857c-4c32-9437-461f13dd2c96" containerName="payload-pre-processing" containerID="cri-o://d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1" gracePeriod=30
Sep 17 00:40:07.629593 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.629518    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"]
Sep 17 00:40:07.633064 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.632997    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-2faea3-hh58s"]
Sep 17 00:40:07.741492 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.741468    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:40:07.770917 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.770873    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:40:07.829193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.829164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d251dd-857c-4c32-9437-461f13dd2c96-plugins-config-volume\") pod \"d8d251dd-857c-4c32-9437-461f13dd2c96\" (UID: \"d8d251dd-857c-4c32-9437-461f13dd2c96\") "
Sep 17 00:40:07.829339 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.829244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pdvcn\" (UniqueName: \"kubernetes.io/projected/99a9568f-1e43-46ed-8143-7872572f1617-kube-api-access-pdvcn\") pod \"99a9568f-1e43-46ed-8143-7872572f1617\" (UID: \"99a9568f-1e43-46ed-8143-7872572f1617\") "
Sep 17 00:40:07.829339 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.829312    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgn79\" (UniqueName: \"kubernetes.io/projected/d8d251dd-857c-4c32-9437-461f13dd2c96-kube-api-access-hgn79\") pod \"d8d251dd-857c-4c32-9437-461f13dd2c96\" (UID: \"d8d251dd-857c-4c32-9437-461f13dd2c96\") "
Sep 17 00:40:07.829475 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.829412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a9568f-1e43-46ed-8143-7872572f1617-plugins-config-volume\") pod \"99a9568f-1e43-46ed-8143-7872572f1617\" (UID: \"99a9568f-1e43-46ed-8143-7872572f1617\") "
Sep 17 00:40:07.829627 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.829580    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8d251dd-857c-4c32-9437-461f13dd2c96-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d8d251dd-857c-4c32-9437-461f13dd2c96" (UID: "d8d251dd-857c-4c32-9437-461f13dd2c96"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:40:07.829806 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.829789    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99a9568f-1e43-46ed-8143-7872572f1617-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "99a9568f-1e43-46ed-8143-7872572f1617" (UID: "99a9568f-1e43-46ed-8143-7872572f1617"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:40:07.831363 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.831343    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8d251dd-857c-4c32-9437-461f13dd2c96-kube-api-access-hgn79" (OuterVolumeSpecName: "kube-api-access-hgn79") pod "d8d251dd-857c-4c32-9437-461f13dd2c96" (UID: "d8d251dd-857c-4c32-9437-461f13dd2c96"). InnerVolumeSpecName "kube-api-access-hgn79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:07.831422 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.831364    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99a9568f-1e43-46ed-8143-7872572f1617-kube-api-access-pdvcn" (OuterVolumeSpecName: "kube-api-access-pdvcn") pod "99a9568f-1e43-46ed-8143-7872572f1617" (UID: "99a9568f-1e43-46ed-8143-7872572f1617"). InnerVolumeSpecName "kube-api-access-pdvcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:07.931159 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.931122    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d8d251dd-857c-4c32-9437-461f13dd2c96-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:07.931159 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.931152    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pdvcn\" (UniqueName: \"kubernetes.io/projected/99a9568f-1e43-46ed-8143-7872572f1617-kube-api-access-pdvcn\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:07.931159 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.931162    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgn79\" (UniqueName: \"kubernetes.io/projected/d8d251dd-857c-4c32-9437-461f13dd2c96-kube-api-access-hgn79\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:07.931375 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:07.931172    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/99a9568f-1e43-46ed-8143-7872572f1617-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:08.072405 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.072316    2565 generic.go:356] "Generic (PLEG): container finished" podID="99a9568f-1e43-46ed-8143-7872572f1617" containerID="60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592" exitCode=0
Sep 17 00:40:08.072405 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.072358    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"
Sep 17 00:40:08.072630 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.072405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb" event={"ID":"99a9568f-1e43-46ed-8143-7872572f1617","Type":"ContainerDied","Data":"60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592"}
Sep 17 00:40:08.072630 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.072460    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb" event={"ID":"99a9568f-1e43-46ed-8143-7872572f1617","Type":"ContainerDied","Data":"85ae383c6fd0e247a5631bf365ef56e816283946800e347c556713c6500e63b8"}
Sep 17 00:40:08.072630 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.072494    2565 scope.go:117] "RemoveContainer" containerID="60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592"
Sep 17 00:40:08.074020 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.073991    2565 generic.go:356] "Generic (PLEG): container finished" podID="d8d251dd-857c-4c32-9437-461f13dd2c96" containerID="d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1" exitCode=0
Sep 17 00:40:08.074137 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.074036    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"
Sep 17 00:40:08.074137 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.074039    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b" event={"ID":"d8d251dd-857c-4c32-9437-461f13dd2c96","Type":"ContainerDied","Data":"d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1"}
Sep 17 00:40:08.074230 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.074168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b" event={"ID":"d8d251dd-857c-4c32-9437-461f13dd2c96","Type":"ContainerDied","Data":"cc311ae9ca1448e49814035cda51060e426485770a8f57317f6929a8f5d6ff64"}
Sep 17 00:40:08.083712 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.083694    2565 scope.go:117] "RemoveContainer" containerID="60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592"
Sep 17 00:40:08.084048 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:40:08.084023    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592\": container with ID starting with 60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592 not found: ID does not exist" containerID="60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592"
Sep 17 00:40:08.084235 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.084057    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592"} err="failed to get container status \"60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592\": rpc error: code = NotFound desc = could not find container \"60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592\": container with ID starting with 60c21bbf08cc8c5f8b1fdf3f0bc20f4f38ee2a85948fb715ab1bbeb0eb586592 not found: ID does not exist"
Sep 17 00:40:08.084235 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.084080    2565 scope.go:117] "RemoveContainer" containerID="d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1"
Sep 17 00:40:08.093228 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.093204    2565 scope.go:117] "RemoveContainer" containerID="d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1"
Sep 17 00:40:08.093556 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:40:08.093532    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1\": container with ID starting with d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1 not found: ID does not exist" containerID="d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1"
Sep 17 00:40:08.093635 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.093565    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1"} err="failed to get container status \"d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1\": rpc error: code = NotFound desc = could not find container \"d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1\": container with ID starting with d375bcad614fcc7afb1c8dee4fe76e6c3b6a997fd861664c8b737d21a102afa1 not found: ID does not exist"
Sep 17 00:40:08.101452 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.101424    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"]
Sep 17 00:40:08.103475 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.103457    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w4-2faea3-8967d5cc5-ztrlb"]
Sep 17 00:40:08.114038 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.114001    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"]
Sep 17 00:40:08.120835 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:08.120811    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-2faea3-745854d5c8-5sr6b"]
Sep 17 00:40:09.389856 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:09.389814    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aec28f4-1cd7-4f39-86dd-312c3dd9a406" path="/var/lib/kubelet/pods/7aec28f4-1cd7-4f39-86dd-312c3dd9a406/volumes"
Sep 17 00:40:09.390377 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:09.390333    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99a9568f-1e43-46ed-8143-7872572f1617" path="/var/lib/kubelet/pods/99a9568f-1e43-46ed-8143-7872572f1617/volumes"
Sep 17 00:40:09.390643 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:09.390623    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0f88aaf-4def-445d-a031-02fcf66b550a" path="/var/lib/kubelet/pods/c0f88aaf-4def-445d-a031-02fcf66b550a/volumes"
Sep 17 00:40:09.391008 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:09.390989    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8d251dd-857c-4c32-9437-461f13dd2c96" path="/var/lib/kubelet/pods/d8d251dd-857c-4c32-9437-461f13dd2c96/volumes"
Sep 17 00:40:11.473078 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.473032    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2" podUID="9fa0a282-e20b-4b70-b82b-61e232f9896b" containerName="main" containerID="cri-o://7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244" gracePeriod=45
Sep 17 00:40:11.718756 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.718733    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:40:11.764080 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764008    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fa0a282-e20b-4b70-b82b-61e232f9896b-tls-certs\") pod \"9fa0a282-e20b-4b70-b82b-61e232f9896b\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") "
Sep 17 00:40:11.764080 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764049    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-model-cache\") pod \"9fa0a282-e20b-4b70-b82b-61e232f9896b\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") "
Sep 17 00:40:11.764282 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764189    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-tmp-dir\") pod \"9fa0a282-e20b-4b70-b82b-61e232f9896b\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") "
Sep 17 00:40:11.764350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764282    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-dshm\") pod \"9fa0a282-e20b-4b70-b82b-61e232f9896b\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") "
Sep 17 00:40:11.764350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764314    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-home\") pod \"9fa0a282-e20b-4b70-b82b-61e232f9896b\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") "
Sep 17 00:40:11.764350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764338    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-model-cache" (OuterVolumeSpecName: "model-cache") pod "9fa0a282-e20b-4b70-b82b-61e232f9896b" (UID: "9fa0a282-e20b-4b70-b82b-61e232f9896b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:11.764779 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764412    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw8l4\" (UniqueName: \"kubernetes.io/projected/9fa0a282-e20b-4b70-b82b-61e232f9896b-kube-api-access-xw8l4\") pod \"9fa0a282-e20b-4b70-b82b-61e232f9896b\" (UID: \"9fa0a282-e20b-4b70-b82b-61e232f9896b\") "
Sep 17 00:40:11.764779 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764427    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9fa0a282-e20b-4b70-b82b-61e232f9896b" (UID: "9fa0a282-e20b-4b70-b82b-61e232f9896b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:11.764779 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764625    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-home" (OuterVolumeSpecName: "home") pod "9fa0a282-e20b-4b70-b82b-61e232f9896b" (UID: "9fa0a282-e20b-4b70-b82b-61e232f9896b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:11.764996 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764804    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-model-cache\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:11.764996 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764825    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-tmp-dir\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:11.764996 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.764840    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-home\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:11.766546 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.766519    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-dshm" (OuterVolumeSpecName: "dshm") pod "9fa0a282-e20b-4b70-b82b-61e232f9896b" (UID: "9fa0a282-e20b-4b70-b82b-61e232f9896b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:40:11.766651 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.766572    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa0a282-e20b-4b70-b82b-61e232f9896b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9fa0a282-e20b-4b70-b82b-61e232f9896b" (UID: "9fa0a282-e20b-4b70-b82b-61e232f9896b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:40:11.766713 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.766680    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa0a282-e20b-4b70-b82b-61e232f9896b-kube-api-access-xw8l4" (OuterVolumeSpecName: "kube-api-access-xw8l4") pod "9fa0a282-e20b-4b70-b82b-61e232f9896b" (UID: "9fa0a282-e20b-4b70-b82b-61e232f9896b"). InnerVolumeSpecName "kube-api-access-xw8l4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:40:11.865406 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.865373    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9fa0a282-e20b-4b70-b82b-61e232f9896b-dshm\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:11.865406 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.865400    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw8l4\" (UniqueName: \"kubernetes.io/projected/9fa0a282-e20b-4b70-b82b-61e232f9896b-kube-api-access-xw8l4\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:11.865406 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:11.865411    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fa0a282-e20b-4b70-b82b-61e232f9896b-tls-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:40:12.098981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:12.098946    2565 generic.go:356] "Generic (PLEG): container finished" podID="9fa0a282-e20b-4b70-b82b-61e232f9896b" containerID="7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244" exitCode=0
Sep 17 00:40:12.099159 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:12.098994    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"
Sep 17 00:40:12.099159 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:12.098992    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2" event={"ID":"9fa0a282-e20b-4b70-b82b-61e232f9896b","Type":"ContainerDied","Data":"7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244"}
Sep 17 00:40:12.099159 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:12.099123    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2" event={"ID":"9fa0a282-e20b-4b70-b82b-61e232f9896b","Type":"ContainerDied","Data":"9bcc2cb3095467e940bca79c30890c1576d77ca3edc6360c604adc52d1649949"}
Sep 17 00:40:12.099159 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:12.099154    2565 scope.go:117] "RemoveContainer" containerID="7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244"
Sep 17 00:40:12.108383 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:12.108364    2565 scope.go:117] "RemoveContainer" containerID="7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244"
Sep 17 00:40:12.108646 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:40:12.108625    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244\": container with ID starting with 7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244 not found: ID does not exist" containerID="7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244"
Sep 17 00:40:12.108734 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:12.108653    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244"} err="failed to get container status \"7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244\": rpc error: code = NotFound desc = could not find container \"7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244\": container with ID starting with 7353a761be349c047ae53c084b6da0a61b1fc603d8ac186363a54e8cf1054244 not found: ID does not exist"
Sep 17 00:40:12.121069 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:12.121044    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"]
Sep 17 00:40:12.124795 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:12.124773    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-2faea3/premium-w4-2faea3-kserve-6f9cc868c4-92jl2"]
Sep 17 00:40:13.390167 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:13.390131    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa0a282-e20b-4b70-b82b-61e232f9896b" path="/var/lib/kubelet/pods/9fa0a282-e20b-4b70-b82b-61e232f9896b/volumes"
Sep 17 00:40:59.773105 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:40:59.773068    2565 scope.go:117] "RemoveContainer" containerID="7ecf0c572ba439b65060b1dcc021dd6654f49789266e6699df1c0074b2da6716"
Sep 17 00:41:59.810063 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:41:59.810031    2565 scope.go:117] "RemoveContainer" containerID="97d43324e01799e8d4b77e682465efee392890bd662fc8ed27579a17c883384f"
Sep 17 00:43:29.194153 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194117    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"]
Sep 17 00:43:29.194590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194537    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ce9622e-2369-4a1f-8839-b4bfabacd0d3" containerName="payload-pre-processing"
Sep 17 00:43:29.194590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194548    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ce9622e-2369-4a1f-8839-b4bfabacd0d3" containerName="payload-pre-processing"
Sep 17 00:43:29.194590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194560    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fdb9b63-efe6-4acc-b519-469b0f8fff2a" containerName="payload-processing"
Sep 17 00:43:29.194590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194566    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fdb9b63-efe6-4acc-b519-469b0f8fff2a" containerName="payload-processing"
Sep 17 00:43:29.194590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194574    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99a9568f-1e43-46ed-8143-7872572f1617" containerName="payload-processing"
Sep 17 00:43:29.194590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194579    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="99a9568f-1e43-46ed-8143-7872572f1617" containerName="payload-processing"
Sep 17 00:43:29.194590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194585    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aec28f4-1cd7-4f39-86dd-312c3dd9a406" containerName="revoke-keys"
Sep 17 00:43:29.194590 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194592    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aec28f4-1cd7-4f39-86dd-312c3dd9a406" containerName="revoke-keys"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194605    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa0a282-e20b-4b70-b82b-61e232f9896b" containerName="main"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194610    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa0a282-e20b-4b70-b82b-61e232f9896b" containerName="main"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194626    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8d251dd-857c-4c32-9437-461f13dd2c96" containerName="payload-pre-processing"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194632    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8d251dd-857c-4c32-9437-461f13dd2c96" containerName="payload-pre-processing"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194684    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ce9622e-2369-4a1f-8839-b4bfabacd0d3" containerName="payload-pre-processing"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194696    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa0a282-e20b-4b70-b82b-61e232f9896b" containerName="main"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194702    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fdb9b63-efe6-4acc-b519-469b0f8fff2a" containerName="payload-processing"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194712    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="99a9568f-1e43-46ed-8143-7872572f1617" containerName="payload-processing"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194718    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9d827ba-5b11-4ee3-af08-1613f64c08de" containerName="istio-proxy"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194723    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8d251dd-857c-4c32-9437-461f13dd2c96" containerName="payload-pre-processing"
Sep 17 00:43:29.194849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.194728    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aec28f4-1cd7-4f39-86dd-312c3dd9a406" containerName="revoke-keys"
Sep 17 00:43:29.197950 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.197930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:29.200413 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.200385    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-eaba37-dockercfg-m6fmc\""
Sep 17 00:43:29.200413 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.200385    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-eaba37\""
Sep 17 00:43:29.206718 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.206696    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"]
Sep 17 00:43:29.226632 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.226603    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"]
Sep 17 00:43:29.230141 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.230122    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:43:29.238786 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.238764    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"]
Sep 17 00:43:29.345780 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.345740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcfmc\" (UniqueName: \"kubernetes.io/projected/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-kube-api-access-fcfmc\") pod \"payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp\" (UID: \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:29.345963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.345792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp\" (UID: \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:29.345963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.345851    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g448\" (UniqueName: \"kubernetes.io/projected/540706fb-c959-43bc-a93f-6ee7b2f7c616-kube-api-access-9g448\") pod \"payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd\" (UID: \"540706fb-c959-43bc-a93f-6ee7b2f7c616\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:43:29.345963 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.345893    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/540706fb-c959-43bc-a93f-6ee7b2f7c616-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd\" (UID: \"540706fb-c959-43bc-a93f-6ee7b2f7c616\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:43:29.447494 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.447413    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcfmc\" (UniqueName: \"kubernetes.io/projected/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-kube-api-access-fcfmc\") pod \"payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp\" (UID: \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:29.447494 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.447464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp\" (UID: \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:29.447751 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.447501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g448\" (UniqueName: \"kubernetes.io/projected/540706fb-c959-43bc-a93f-6ee7b2f7c616-kube-api-access-9g448\") pod \"payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd\" (UID: \"540706fb-c959-43bc-a93f-6ee7b2f7c616\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:43:29.447751 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.447529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/540706fb-c959-43bc-a93f-6ee7b2f7c616-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd\" (UID: \"540706fb-c959-43bc-a93f-6ee7b2f7c616\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:43:29.448218 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.448200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/540706fb-c959-43bc-a93f-6ee7b2f7c616-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd\" (UID: \"540706fb-c959-43bc-a93f-6ee7b2f7c616\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:43:29.448263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.448241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp\" (UID: \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:29.455124 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.455097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcfmc\" (UniqueName: \"kubernetes.io/projected/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-kube-api-access-fcfmc\") pod \"payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp\" (UID: \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:29.455285 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.455269    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g448\" (UniqueName: \"kubernetes.io/projected/540706fb-c959-43bc-a93f-6ee7b2f7c616-kube-api-access-9g448\") pod \"payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd\" (UID: \"540706fb-c959-43bc-a93f-6ee7b2f7c616\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:43:29.510266 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.510243    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:29.541456 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.541432    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:43:29.785088 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.785061    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"]
Sep 17 00:43:29.786813 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:43:29.786781    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode37a3bb5_bc2e_48f1_a86d_3c20877c85cf.slice/crio-d9498d801735a3580a98ea560494337edae5b09502b3ade3b73576c571b1d16c WatchSource:0}: Error finding container d9498d801735a3580a98ea560494337edae5b09502b3ade3b73576c571b1d16c: Status 404 returned error can't find the container with id d9498d801735a3580a98ea560494337edae5b09502b3ade3b73576c571b1d16c
Sep 17 00:43:29.825288 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:29.825264    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"]
Sep 17 00:43:29.827288 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:43:29.827264    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540706fb_c959_43bc_a93f_6ee7b2f7c616.slice/crio-6eb0cebeb4f9d0de7b70a9847a283736e93e467f1433df4c9d653fb19acb0782 WatchSource:0}: Error finding container 6eb0cebeb4f9d0de7b70a9847a283736e93e467f1433df4c9d653fb19acb0782: Status 404 returned error can't find the container with id 6eb0cebeb4f9d0de7b70a9847a283736e93e467f1433df4c9d653fb19acb0782
Sep 17 00:43:30.191817 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:30.191772    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp" event={"ID":"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf","Type":"ContainerStarted","Data":"a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62"}
Sep 17 00:43:30.192053 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:30.191875    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp" event={"ID":"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf","Type":"ContainerStarted","Data":"d9498d801735a3580a98ea560494337edae5b09502b3ade3b73576c571b1d16c"}
Sep 17 00:43:30.192053 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:30.191932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:30.193846 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:30.193812    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd" event={"ID":"540706fb-c959-43bc-a93f-6ee7b2f7c616","Type":"ContainerStarted","Data":"48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85"}
Sep 17 00:43:30.193989 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:30.193862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd" event={"ID":"540706fb-c959-43bc-a93f-6ee7b2f7c616","Type":"ContainerStarted","Data":"6eb0cebeb4f9d0de7b70a9847a283736e93e467f1433df4c9d653fb19acb0782"}
Sep 17 00:43:30.193989 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:30.193883    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:43:30.209198 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:30.209146    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp" podStartSLOduration=1.209126244 podStartE2EDuration="1.209126244s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:43:30.205882351 +0000 UTC m=+2011.314658277" watchObservedRunningTime="2026-09-17 00:43:30.209126244 +0000 UTC m=+2011.317902159"
Sep 17 00:43:30.222316 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:30.222268    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd" podStartSLOduration=1.222252302 podStartE2EDuration="1.222252302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:43:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:43:30.220316416 +0000 UTC m=+2011.329092334" watchObservedRunningTime="2026-09-17 00:43:30.222252302 +0000 UTC m=+2011.331028267"
Sep 17 00:43:41.202879 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:41.202838    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:43:41.203478 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:43:41.202932    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:44:59.517719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:44:59.517694    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:44:59.559075 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:44:59.559051    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:44:59.851397 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:44:59.851367    2565 scope.go:117] "RemoveContainer" containerID="bbbdabaeb94ec516c4d2170c9795d94e159cac2ffe4b4990b405230b66cbab85"
Sep 17 00:45:00.138282 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.138204    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx"]
Sep 17 00:45:00.143403 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.143379    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2"]
Sep 17 00:45:00.143558 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.143484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx"
Sep 17 00:45:00.147023 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.147005    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck"]
Sep 17 00:45:00.147133 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.147103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2"
Sep 17 00:45:00.149597 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.149573    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:45:00.151034 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.151014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck"
Sep 17 00:45:00.152196 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.152177    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx"]
Sep 17 00:45:00.158351 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.157626    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2"]
Sep 17 00:45:00.159200 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.159048    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx"
Sep 17 00:45:00.159607 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.159587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck"]
Sep 17 00:45:00.172074 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.172055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2"
Sep 17 00:45:00.208572 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.208546    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck"
Sep 17 00:45:00.443683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.443657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx"]
Sep 17 00:45:00.445329 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:45:00.445305    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c938a21_28c2_43bf_b340_9544a60f99c3.slice/crio-a52b5aa7a48787da966a67a1c35961ae330bf7d48b4626a4c1516bc3d2e07cbf WatchSource:0}: Error finding container a52b5aa7a48787da966a67a1c35961ae330bf7d48b4626a4c1516bc3d2e07cbf: Status 404 returned error can't find the container with id a52b5aa7a48787da966a67a1c35961ae330bf7d48b4626a4c1516bc3d2e07cbf
Sep 17 00:45:00.454223 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.454200    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2"]
Sep 17 00:45:00.454954 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:45:00.454931    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ef06717_7425_458e_93d0_896b038ef637.slice/crio-30c3aa3c1bac763d33a8b7e59383ccf5d766b66328fc19b23647d4be6fc3117b WatchSource:0}: Error finding container 30c3aa3c1bac763d33a8b7e59383ccf5d766b66328fc19b23647d4be6fc3117b: Status 404 returned error can't find the container with id 30c3aa3c1bac763d33a8b7e59383ccf5d766b66328fc19b23647d4be6fc3117b
Sep 17 00:45:00.492353 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.492332    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck"]
Sep 17 00:45:00.493411 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:45:00.493382    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaea4c9a6_5c78_4abd_8c9b_48c27e68e298.slice/crio-d5358e13d548827336faf9b0c295d43564017aedd939e9a5b781ce5a8a5ae638 WatchSource:0}: Error finding container d5358e13d548827336faf9b0c295d43564017aedd939e9a5b781ce5a8a5ae638: Status 404 returned error can't find the container with id d5358e13d548827336faf9b0c295d43564017aedd939e9a5b781ce5a8a5ae638
Sep 17 00:45:00.708193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.708109    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2" event={"ID":"7ef06717-7425-458e-93d0-896b038ef637","Type":"ContainerStarted","Data":"30c3aa3c1bac763d33a8b7e59383ccf5d766b66328fc19b23647d4be6fc3117b"}
Sep 17 00:45:00.709487 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.709464    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx" event={"ID":"0c938a21-28c2-43bf-b340-9544a60f99c3","Type":"ContainerStarted","Data":"a52b5aa7a48787da966a67a1c35961ae330bf7d48b4626a4c1516bc3d2e07cbf"}
Sep 17 00:45:00.710697 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:00.710675    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck" event={"ID":"aea4c9a6-5c78-4abd-8c9b-48c27e68e298","Type":"ContainerStarted","Data":"d5358e13d548827336faf9b0c295d43564017aedd939e9a5b781ce5a8a5ae638"}
Sep 17 00:45:01.719045 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:01.718961    2565 generic.go:356] "Generic (PLEG): container finished" podID="aea4c9a6-5c78-4abd-8c9b-48c27e68e298" containerID="8ed472a8a8dd524afc7e7a2d49cfedd502d4a4c03630c9524fe286b9027e9c1d" exitCode=0
Sep 17 00:45:01.719045 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:01.719017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck" event={"ID":"aea4c9a6-5c78-4abd-8c9b-48c27e68e298","Type":"ContainerDied","Data":"8ed472a8a8dd524afc7e7a2d49cfedd502d4a4c03630c9524fe286b9027e9c1d"}
Sep 17 00:45:01.720762 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:01.720741    2565 generic.go:356] "Generic (PLEG): container finished" podID="7ef06717-7425-458e-93d0-896b038ef637" containerID="8d8db6797efe304b3a955fbac157094fad6db9e54bf5f14413c47a9690c872d7" exitCode=0
Sep 17 00:45:01.720912 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:01.720808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2" event={"ID":"7ef06717-7425-458e-93d0-896b038ef637","Type":"ContainerDied","Data":"8d8db6797efe304b3a955fbac157094fad6db9e54bf5f14413c47a9690c872d7"}
Sep 17 00:45:01.722504 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:01.722481    2565 generic.go:356] "Generic (PLEG): container finished" podID="0c938a21-28c2-43bf-b340-9544a60f99c3" containerID="06d4e1d3570e709e98215e4c483f3c6ec5187713c3fd0ad2124a1f334a49eec1" exitCode=0
Sep 17 00:45:01.722616 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:01.722523    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx" event={"ID":"0c938a21-28c2-43bf-b340-9544a60f99c3","Type":"ContainerDied","Data":"06d4e1d3570e709e98215e4c483f3c6ec5187713c3fd0ad2124a1f334a49eec1"}
Sep 17 00:45:02.916030 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:02.916007    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2"
Sep 17 00:45:02.918786 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:02.918765    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx"
Sep 17 00:45:02.922311 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:02.922294    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck"
Sep 17 00:45:03.735193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:03.735107    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2"
Sep 17 00:45:03.735193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:03.735112    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29826765-knnj2" event={"ID":"7ef06717-7425-458e-93d0-896b038ef637","Type":"ContainerDied","Data":"30c3aa3c1bac763d33a8b7e59383ccf5d766b66328fc19b23647d4be6fc3117b"}
Sep 17 00:45:03.735193 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:03.735156    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30c3aa3c1bac763d33a8b7e59383ccf5d766b66328fc19b23647d4be6fc3117b"
Sep 17 00:45:03.736464 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:03.736442    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx"
Sep 17 00:45:03.736604 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:03.736467    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx" event={"ID":"0c938a21-28c2-43bf-b340-9544a60f99c3","Type":"ContainerDied","Data":"a52b5aa7a48787da966a67a1c35961ae330bf7d48b4626a4c1516bc3d2e07cbf"}
Sep 17 00:45:03.736604 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:03.736507    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a52b5aa7a48787da966a67a1c35961ae330bf7d48b4626a4c1516bc3d2e07cbf"
Sep 17 00:45:03.737985 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:03.737966    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck"
Sep 17 00:45:03.738109 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:03.738015    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck" event={"ID":"aea4c9a6-5c78-4abd-8c9b-48c27e68e298","Type":"ContainerDied","Data":"d5358e13d548827336faf9b0c295d43564017aedd939e9a5b781ce5a8a5ae638"}
Sep 17 00:45:03.738109 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:03.738063    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5358e13d548827336faf9b0c295d43564017aedd939e9a5b781ce5a8a5ae638"
Sep 17 00:45:13.704272 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:13.704241    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd_540706fb-c959-43bc-a93f-6ee7b2f7c616/payload-processing/0.log"
Sep 17 00:45:21.390760 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.390726    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"]
Sep 17 00:45:21.391199 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.391184    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c938a21-28c2-43bf-b340-9544a60f99c3" containerName="cleanup"
Sep 17 00:45:21.391199 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.391200    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c938a21-28c2-43bf-b340-9544a60f99c3" containerName="cleanup"
Sep 17 00:45:21.391322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.391223    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aea4c9a6-5c78-4abd-8c9b-48c27e68e298" containerName="cleanup"
Sep 17 00:45:21.391322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.391229    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aea4c9a6-5c78-4abd-8c9b-48c27e68e298" containerName="cleanup"
Sep 17 00:45:21.391322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.391236    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ef06717-7425-458e-93d0-896b038ef637" containerName="cleanup"
Sep 17 00:45:21.391322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.391241    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ef06717-7425-458e-93d0-896b038ef637" containerName="cleanup"
Sep 17 00:45:21.391322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.391300    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c938a21-28c2-43bf-b340-9544a60f99c3" containerName="cleanup"
Sep 17 00:45:21.391322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.391308    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aea4c9a6-5c78-4abd-8c9b-48c27e68e298" containerName="cleanup"
Sep 17 00:45:21.391322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.391315    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ef06717-7425-458e-93d0-896b038ef637" containerName="cleanup"
Sep 17 00:45:21.394488 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.394473    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:21.396946 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.396921    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-cfebd7\""
Sep 17 00:45:21.397060 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.396921    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-cfebd7-dockercfg-mjpj5\""
Sep 17 00:45:21.401505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.401480    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"]
Sep 17 00:45:21.478271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.478233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvwjn\" (UniqueName: \"kubernetes.io/projected/0dcdc051-0f8a-4298-8575-033e07133037-kube-api-access-mvwjn\") pod \"payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs\" (UID: \"0dcdc051-0f8a-4298-8575-033e07133037\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:21.478421 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.478281    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcdc051-0f8a-4298-8575-033e07133037-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs\" (UID: \"0dcdc051-0f8a-4298-8575-033e07133037\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:21.493347 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.493318    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"]
Sep 17 00:45:21.497492 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.497471    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:21.507471 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.507433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"]
Sep 17 00:45:21.579440 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.579398    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6qhr\" (UniqueName: \"kubernetes.io/projected/48f0c836-4541-4070-8561-e5db1577d677-kube-api-access-h6qhr\") pod \"payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb\" (UID: \"48f0c836-4541-4070-8561-e5db1577d677\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:21.579626 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.579460    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvwjn\" (UniqueName: \"kubernetes.io/projected/0dcdc051-0f8a-4298-8575-033e07133037-kube-api-access-mvwjn\") pod \"payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs\" (UID: \"0dcdc051-0f8a-4298-8575-033e07133037\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:21.579626 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.579520    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcdc051-0f8a-4298-8575-033e07133037-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs\" (UID: \"0dcdc051-0f8a-4298-8575-033e07133037\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:21.579626 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.579553    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48f0c836-4541-4070-8561-e5db1577d677-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb\" (UID: \"48f0c836-4541-4070-8561-e5db1577d677\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:21.580206 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.580189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcdc051-0f8a-4298-8575-033e07133037-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs\" (UID: \"0dcdc051-0f8a-4298-8575-033e07133037\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:21.587262 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.587238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvwjn\" (UniqueName: \"kubernetes.io/projected/0dcdc051-0f8a-4298-8575-033e07133037-kube-api-access-mvwjn\") pod \"payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs\" (UID: \"0dcdc051-0f8a-4298-8575-033e07133037\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:21.680802 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.680735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6qhr\" (UniqueName: \"kubernetes.io/projected/48f0c836-4541-4070-8561-e5db1577d677-kube-api-access-h6qhr\") pod \"payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb\" (UID: \"48f0c836-4541-4070-8561-e5db1577d677\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:21.680802 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.680792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48f0c836-4541-4070-8561-e5db1577d677-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb\" (UID: \"48f0c836-4541-4070-8561-e5db1577d677\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:21.681474 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.681451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48f0c836-4541-4070-8561-e5db1577d677-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb\" (UID: \"48f0c836-4541-4070-8561-e5db1577d677\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:21.695964 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.695936    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6qhr\" (UniqueName: \"kubernetes.io/projected/48f0c836-4541-4070-8561-e5db1577d677-kube-api-access-h6qhr\") pod \"payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb\" (UID: \"48f0c836-4541-4070-8561-e5db1577d677\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:21.705461 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.705438    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:21.810670 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.810640    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:21.978026 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:21.978001    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"]
Sep 17 00:45:21.978611 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:45:21.978586    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dcdc051_0f8a_4298_8575_033e07133037.slice/crio-0ad4abfc415ea6663efb66a454f920bdb3b5755baf66cd59d072b39a5b57280f WatchSource:0}: Error finding container 0ad4abfc415ea6663efb66a454f920bdb3b5755baf66cd59d072b39a5b57280f: Status 404 returned error can't find the container with id 0ad4abfc415ea6663efb66a454f920bdb3b5755baf66cd59d072b39a5b57280f
Sep 17 00:45:22.083442 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:22.083404    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"]
Sep 17 00:45:22.084763 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:45:22.084737    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f0c836_4541_4070_8561_e5db1577d677.slice/crio-b40036ea1a9d498eddc985f13c27d9fcc2ff59ccb5eaf182d5c2844f521c6419 WatchSource:0}: Error finding container b40036ea1a9d498eddc985f13c27d9fcc2ff59ccb5eaf182d5c2844f521c6419: Status 404 returned error can't find the container with id b40036ea1a9d498eddc985f13c27d9fcc2ff59ccb5eaf182d5c2844f521c6419
Sep 17 00:45:22.846851 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:22.846803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb" event={"ID":"48f0c836-4541-4070-8561-e5db1577d677","Type":"ContainerStarted","Data":"e73132ba46884c175898cdd18bf6ba9b97b3442c84fac15a751154eef34ed535"}
Sep 17 00:45:22.847329 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:22.846961    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb" event={"ID":"48f0c836-4541-4070-8561-e5db1577d677","Type":"ContainerStarted","Data":"b40036ea1a9d498eddc985f13c27d9fcc2ff59ccb5eaf182d5c2844f521c6419"}
Sep 17 00:45:22.847329 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:22.846996    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:22.849226 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:22.849182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs" event={"ID":"0dcdc051-0f8a-4298-8575-033e07133037","Type":"ContainerStarted","Data":"1d1376bdb1cbebcc463eac7eef45e53973c4acda89f9b5c61e022784ab03f75e"}
Sep 17 00:45:22.849350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:22.849240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs" event={"ID":"0dcdc051-0f8a-4298-8575-033e07133037","Type":"ContainerStarted","Data":"0ad4abfc415ea6663efb66a454f920bdb3b5755baf66cd59d072b39a5b57280f"}
Sep 17 00:45:22.849350 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:22.849268    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:22.863853 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:22.863809    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb" podStartSLOduration=1.863796889 podStartE2EDuration="1.863796889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:45:22.861479461 +0000 UTC m=+2123.970255376" watchObservedRunningTime="2026-09-17 00:45:22.863796889 +0000 UTC m=+2123.972572799"
Sep 17 00:45:22.880352 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:22.880311    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs" podStartSLOduration=1.8802989430000001 podStartE2EDuration="1.880298943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:45:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:45:22.878189599 +0000 UTC m=+2123.986965515" watchObservedRunningTime="2026-09-17 00:45:22.880298943 +0000 UTC m=+2123.989074992"
Sep 17 00:45:33.859592 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:33.859558    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:33.860108 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:33.859723    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:43.634829 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:43.634784    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"]
Sep 17 00:45:43.638650 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:43.638630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"
Sep 17 00:45:43.641058 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:43.641035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:45:43.645737 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:43.645704    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"]
Sep 17 00:45:43.687719 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:43.687683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3b6f5c-1355-4b18-83ea-65e560d7212c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c\" (UID: \"dc3b6f5c-1355-4b18-83ea-65e560d7212c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"
Sep 17 00:45:43.788486 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:43.788446    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3b6f5c-1355-4b18-83ea-65e560d7212c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c\" (UID: \"dc3b6f5c-1355-4b18-83ea-65e560d7212c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"
Sep 17 00:45:43.789095 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:43.789075    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3b6f5c-1355-4b18-83ea-65e560d7212c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c\" (UID: \"dc3b6f5c-1355-4b18-83ea-65e560d7212c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"
Sep 17 00:45:43.952923 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:43.952815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"
Sep 17 00:45:44.223584 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:44.223551    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"]
Sep 17 00:45:44.984630 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:44.984600    2565 generic.go:356] "Generic (PLEG): container finished" podID="dc3b6f5c-1355-4b18-83ea-65e560d7212c" containerID="59b614f60525376034b28665e3f9a981ca591c6b99889df0030661bc69d98b3f" exitCode=0
Sep 17 00:45:44.985035 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:44.984697    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c" event={"ID":"dc3b6f5c-1355-4b18-83ea-65e560d7212c","Type":"ContainerDied","Data":"59b614f60525376034b28665e3f9a981ca591c6b99889df0030661bc69d98b3f"}
Sep 17 00:45:44.985035 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:44.984758    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c" event={"ID":"dc3b6f5c-1355-4b18-83ea-65e560d7212c","Type":"ContainerStarted","Data":"1b1f136da18f4c5d84b47e9767420858c8c2ec5d6bea85096144b816b14e9c72"}
Sep 17 00:45:46.130702 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:46.130675    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"
Sep 17 00:45:46.209463 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:46.209432    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3b6f5c-1355-4b18-83ea-65e560d7212c-maas-api-service-ca\") pod \"dc3b6f5c-1355-4b18-83ea-65e560d7212c\" (UID: \"dc3b6f5c-1355-4b18-83ea-65e560d7212c\") "
Sep 17 00:45:46.209816 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:46.209790    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dc3b6f5c-1355-4b18-83ea-65e560d7212c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dc3b6f5c-1355-4b18-83ea-65e560d7212c" (UID: "dc3b6f5c-1355-4b18-83ea-65e560d7212c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:45:46.311163 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:46.311083    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dc3b6f5c-1355-4b18-83ea-65e560d7212c-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:45:46.997907 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:46.997855    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"
Sep 17 00:45:46.998076 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:46.997889    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c" event={"ID":"dc3b6f5c-1355-4b18-83ea-65e560d7212c","Type":"ContainerDied","Data":"1b1f136da18f4c5d84b47e9767420858c8c2ec5d6bea85096144b816b14e9c72"}
Sep 17 00:45:46.998076 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:46.997948    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b1f136da18f4c5d84b47e9767420858c8c2ec5d6bea85096144b816b14e9c72"
Sep 17 00:45:49.797123 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:49.797083    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"]
Sep 17 00:45:49.797573 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:49.797479    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb" podUID="48f0c836-4541-4070-8561-e5db1577d677" containerName="payload-processing" containerID="cri-o://e73132ba46884c175898cdd18bf6ba9b97b3442c84fac15a751154eef34ed535" gracePeriod=30
Sep 17 00:45:49.805565 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:49.805536    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"]
Sep 17 00:45:49.808486 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:49.805805    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs" podUID="0dcdc051-0f8a-4298-8575-033e07133037" containerName="payload-pre-processing" containerID="cri-o://1d1376bdb1cbebcc463eac7eef45e53973c4acda89f9b5c61e022784ab03f75e" gracePeriod=30
Sep 17 00:45:49.950993 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:49.950926    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"]
Sep 17 00:45:49.956100 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:49.956058    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-cfebd7-nvc9c"]
Sep 17 00:45:50.021341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.021308    2565 generic.go:356] "Generic (PLEG): container finished" podID="48f0c836-4541-4070-8561-e5db1577d677" containerID="e73132ba46884c175898cdd18bf6ba9b97b3442c84fac15a751154eef34ed535" exitCode=0
Sep 17 00:45:50.021513 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.021392    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb" event={"ID":"48f0c836-4541-4070-8561-e5db1577d677","Type":"ContainerDied","Data":"e73132ba46884c175898cdd18bf6ba9b97b3442c84fac15a751154eef34ed535"}
Sep 17 00:45:50.023747 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.023719    2565 generic.go:356] "Generic (PLEG): container finished" podID="0dcdc051-0f8a-4298-8575-033e07133037" containerID="1d1376bdb1cbebcc463eac7eef45e53973c4acda89f9b5c61e022784ab03f75e" exitCode=0
Sep 17 00:45:50.023879 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.023830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs" event={"ID":"0dcdc051-0f8a-4298-8575-033e07133037","Type":"ContainerDied","Data":"1d1376bdb1cbebcc463eac7eef45e53973c4acda89f9b5c61e022784ab03f75e"}
Sep 17 00:45:50.066289 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.066220    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:50.102553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.102527    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:50.150708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.148252    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvwjn\" (UniqueName: \"kubernetes.io/projected/0dcdc051-0f8a-4298-8575-033e07133037-kube-api-access-mvwjn\") pod \"0dcdc051-0f8a-4298-8575-033e07133037\" (UID: \"0dcdc051-0f8a-4298-8575-033e07133037\") "
Sep 17 00:45:50.150708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.148315    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48f0c836-4541-4070-8561-e5db1577d677-plugins-config-volume\") pod \"48f0c836-4541-4070-8561-e5db1577d677\" (UID: \"48f0c836-4541-4070-8561-e5db1577d677\") "
Sep 17 00:45:50.150708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.148492    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6qhr\" (UniqueName: \"kubernetes.io/projected/48f0c836-4541-4070-8561-e5db1577d677-kube-api-access-h6qhr\") pod \"48f0c836-4541-4070-8561-e5db1577d677\" (UID: \"48f0c836-4541-4070-8561-e5db1577d677\") "
Sep 17 00:45:50.150708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.148528    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcdc051-0f8a-4298-8575-033e07133037-plugins-config-volume\") pod \"0dcdc051-0f8a-4298-8575-033e07133037\" (UID: \"0dcdc051-0f8a-4298-8575-033e07133037\") "
Sep 17 00:45:50.150708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.148766    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48f0c836-4541-4070-8561-e5db1577d677-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "48f0c836-4541-4070-8561-e5db1577d677" (UID: "48f0c836-4541-4070-8561-e5db1577d677"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:45:50.150708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.149091    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/48f0c836-4541-4070-8561-e5db1577d677-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:45:50.150708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.149157    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dcdc051-0f8a-4298-8575-033e07133037-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0dcdc051-0f8a-4298-8575-033e07133037" (UID: "0dcdc051-0f8a-4298-8575-033e07133037"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:45:50.151522 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.151497    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dcdc051-0f8a-4298-8575-033e07133037-kube-api-access-mvwjn" (OuterVolumeSpecName: "kube-api-access-mvwjn") pod "0dcdc051-0f8a-4298-8575-033e07133037" (UID: "0dcdc051-0f8a-4298-8575-033e07133037"). InnerVolumeSpecName "kube-api-access-mvwjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:45:50.151587 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.151498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48f0c836-4541-4070-8561-e5db1577d677-kube-api-access-h6qhr" (OuterVolumeSpecName: "kube-api-access-h6qhr") pod "48f0c836-4541-4070-8561-e5db1577d677" (UID: "48f0c836-4541-4070-8561-e5db1577d677"). InnerVolumeSpecName "kube-api-access-h6qhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:45:50.249958 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.249923    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvwjn\" (UniqueName: \"kubernetes.io/projected/0dcdc051-0f8a-4298-8575-033e07133037-kube-api-access-mvwjn\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:45:50.249958 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.249952    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6qhr\" (UniqueName: \"kubernetes.io/projected/48f0c836-4541-4070-8561-e5db1577d677-kube-api-access-h6qhr\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:45:50.249958 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:50.249962    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dcdc051-0f8a-4298-8575-033e07133037-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:45:51.031233 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.031203    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"
Sep 17 00:45:51.031674 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.031242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs" event={"ID":"0dcdc051-0f8a-4298-8575-033e07133037","Type":"ContainerDied","Data":"0ad4abfc415ea6663efb66a454f920bdb3b5755baf66cd59d072b39a5b57280f"}
Sep 17 00:45:51.031674 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.031300    2565 scope.go:117] "RemoveContainer" containerID="1d1376bdb1cbebcc463eac7eef45e53973c4acda89f9b5c61e022784ab03f75e"
Sep 17 00:45:51.032796 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.032777    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"
Sep 17 00:45:51.032879 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.032775    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb" event={"ID":"48f0c836-4541-4070-8561-e5db1577d677","Type":"ContainerDied","Data":"b40036ea1a9d498eddc985f13c27d9fcc2ff59ccb5eaf182d5c2844f521c6419"}
Sep 17 00:45:51.043163 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.043005    2565 scope.go:117] "RemoveContainer" containerID="e73132ba46884c175898cdd18bf6ba9b97b3442c84fac15a751154eef34ed535"
Sep 17 00:45:51.056836 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.056813    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"]
Sep 17 00:45:51.065187 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.065168    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cfebd7-588db7ffc4-wtmfs"]
Sep 17 00:45:51.074673 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.074643    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"]
Sep 17 00:45:51.076849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.076828    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-cfebd7-65cdb49c45-gmnsb"]
Sep 17 00:45:51.390732 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.390643    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dcdc051-0f8a-4298-8575-033e07133037" path="/var/lib/kubelet/pods/0dcdc051-0f8a-4298-8575-033e07133037/volumes"
Sep 17 00:45:51.391048 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.391035    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48f0c836-4541-4070-8561-e5db1577d677" path="/var/lib/kubelet/pods/48f0c836-4541-4070-8561-e5db1577d677/volumes"
Sep 17 00:45:51.391341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:51.391329    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc3b6f5c-1355-4b18-83ea-65e560d7212c" path="/var/lib/kubelet/pods/dc3b6f5c-1355-4b18-83ea-65e560d7212c/volumes"
Sep 17 00:45:59.873111 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.873023    2565 scope.go:117] "RemoveContainer" containerID="002ac7b10cad0c904448c045761a61506f6050f302ac2669db22177830a1b902"
Sep 17 00:45:59.881790 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.881769    2565 scope.go:117] "RemoveContainer" containerID="cb8bddff913d46430e878d7f173ba26ddb6b8199dd020aadca52ad437a147c33"
Sep 17 00:45:59.890111 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.890091    2565 scope.go:117] "RemoveContainer" containerID="62dce9827b208730255d2a2901c835822e29972083d9dc2dd0d754e36a7bc8c8"
Sep 17 00:45:59.897641 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.897618    2565 scope.go:117] "RemoveContainer" containerID="5dda0d868d8c819f53f5da51b7edce98c050981c7d94dd9ffabbfb636799b5f5"
Sep 17 00:45:59.905143 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.905122    2565 scope.go:117] "RemoveContainer" containerID="bbd442b92b30f93c765cb1840d6c4dd9b8988bee0f1666210c325e738126ed87"
Sep 17 00:45:59.970731 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.970703    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"]
Sep 17 00:45:59.971348 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.971328    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dcdc051-0f8a-4298-8575-033e07133037" containerName="payload-pre-processing"
Sep 17 00:45:59.971348 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.971351    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dcdc051-0f8a-4298-8575-033e07133037" containerName="payload-pre-processing"
Sep 17 00:45:59.971505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.971369    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3b6f5c-1355-4b18-83ea-65e560d7212c" containerName="revoke-keys"
Sep 17 00:45:59.971505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.971378    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3b6f5c-1355-4b18-83ea-65e560d7212c" containerName="revoke-keys"
Sep 17 00:45:59.971505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.971408    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48f0c836-4541-4070-8561-e5db1577d677" containerName="payload-processing"
Sep 17 00:45:59.971505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.971414    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="48f0c836-4541-4070-8561-e5db1577d677" containerName="payload-processing"
Sep 17 00:45:59.971505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.971488    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3b6f5c-1355-4b18-83ea-65e560d7212c" containerName="revoke-keys"
Sep 17 00:45:59.971505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.971499    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="48f0c836-4541-4070-8561-e5db1577d677" containerName="payload-processing"
Sep 17 00:45:59.971505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.971510    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dcdc051-0f8a-4298-8575-033e07133037" containerName="payload-pre-processing"
Sep 17 00:45:59.976849 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.976825    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"
Sep 17 00:45:59.979498 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.979476    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:45:59.981594 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:45:59.981567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"]
Sep 17 00:46:00.047241 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:00.047210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/002b429c-6301-47e7-a0da-ffa538deeefc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg\" (UID: \"002b429c-6301-47e7-a0da-ffa538deeefc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"
Sep 17 00:46:00.148375 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:00.148287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/002b429c-6301-47e7-a0da-ffa538deeefc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg\" (UID: \"002b429c-6301-47e7-a0da-ffa538deeefc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"
Sep 17 00:46:00.149124 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:00.149101    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/002b429c-6301-47e7-a0da-ffa538deeefc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg\" (UID: \"002b429c-6301-47e7-a0da-ffa538deeefc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"
Sep 17 00:46:00.291707 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:00.291674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"
Sep 17 00:46:00.566218 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:00.566194    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"]
Sep 17 00:46:00.568479 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:46:00.568449    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002b429c_6301_47e7_a0da_ffa538deeefc.slice/crio-6aa790c6e6ff8806cfaeeb04284446203935d0d56cc3204226db5c36934f38a3 WatchSource:0}: Error finding container 6aa790c6e6ff8806cfaeeb04284446203935d0d56cc3204226db5c36934f38a3: Status 404 returned error can't find the container with id 6aa790c6e6ff8806cfaeeb04284446203935d0d56cc3204226db5c36934f38a3
Sep 17 00:46:01.101562 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:01.101474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg" event={"ID":"002b429c-6301-47e7-a0da-ffa538deeefc","Type":"ContainerStarted","Data":"5d612d3f7bf78d53fef19cd1927c91c3a3a9ca3dd4670ccbba38633c9a56b9a1"}
Sep 17 00:46:01.101562 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:01.101543    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg" event={"ID":"002b429c-6301-47e7-a0da-ffa538deeefc","Type":"ContainerStarted","Data":"6aa790c6e6ff8806cfaeeb04284446203935d0d56cc3204226db5c36934f38a3"}
Sep 17 00:46:01.117408 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:01.117362    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg" podStartSLOduration=2.117346457 podStartE2EDuration="2.117346457s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:45:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:46:01.114925305 +0000 UTC m=+2162.223701221" watchObservedRunningTime="2026-09-17 00:46:01.117346457 +0000 UTC m=+2162.226122372"
Sep 17 00:46:02.108977 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:02.108939    2565 generic.go:356] "Generic (PLEG): container finished" podID="002b429c-6301-47e7-a0da-ffa538deeefc" containerID="5d612d3f7bf78d53fef19cd1927c91c3a3a9ca3dd4670ccbba38633c9a56b9a1" exitCode=0
Sep 17 00:46:02.109463 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:02.109019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg" event={"ID":"002b429c-6301-47e7-a0da-ffa538deeefc","Type":"ContainerDied","Data":"5d612d3f7bf78d53fef19cd1927c91c3a3a9ca3dd4670ccbba38633c9a56b9a1"}
Sep 17 00:46:03.245766 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:03.245740    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"
Sep 17 00:46:03.380731 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:03.380653    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/002b429c-6301-47e7-a0da-ffa538deeefc-maas-api-service-ca\") pod \"002b429c-6301-47e7-a0da-ffa538deeefc\" (UID: \"002b429c-6301-47e7-a0da-ffa538deeefc\") "
Sep 17 00:46:03.381052 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:03.381032    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/002b429c-6301-47e7-a0da-ffa538deeefc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "002b429c-6301-47e7-a0da-ffa538deeefc" (UID: "002b429c-6301-47e7-a0da-ffa538deeefc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:46:03.482032 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:03.481995    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/002b429c-6301-47e7-a0da-ffa538deeefc-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:46:04.121922 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:04.121863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg" event={"ID":"002b429c-6301-47e7-a0da-ffa538deeefc","Type":"ContainerDied","Data":"6aa790c6e6ff8806cfaeeb04284446203935d0d56cc3204226db5c36934f38a3"}
Sep 17 00:46:04.122144 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:04.121943    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6aa790c6e6ff8806cfaeeb04284446203935d0d56cc3204226db5c36934f38a3"
Sep 17 00:46:04.122144 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:04.121876    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"
Sep 17 00:46:15.449187 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.449150    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx"]
Sep 17 00:46:15.451317 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.451290    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-a-eaba37-29826765-lrpvx"]
Sep 17 00:46:15.474086 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.474056    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"]
Sep 17 00:46:15.474511 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.474481    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd" podUID="540706fb-c959-43bc-a93f-6ee7b2f7c616" containerName="payload-processing" containerID="cri-o://48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85" gracePeriod=30
Sep 17 00:46:15.482587 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.482565    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"]
Sep 17 00:46:15.483532 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.483504    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp" podUID="e37a3bb5-bc2e-48f1-a86d-3c20877c85cf" containerName="payload-pre-processing" containerID="cri-o://a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62" gracePeriod=30
Sep 17 00:46:15.627072 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.627030    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"]
Sep 17 00:46:15.629123 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.629095    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-eaba37-m24zg"]
Sep 17 00:46:15.771761 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.771736    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:46:15.775357 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.775336    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:46:15.793076 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.793055    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/540706fb-c959-43bc-a93f-6ee7b2f7c616-plugins-config-volume\") pod \"540706fb-c959-43bc-a93f-6ee7b2f7c616\" (UID: \"540706fb-c959-43bc-a93f-6ee7b2f7c616\") "
Sep 17 00:46:15.793209 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.793090    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g448\" (UniqueName: \"kubernetes.io/projected/540706fb-c959-43bc-a93f-6ee7b2f7c616-kube-api-access-9g448\") pod \"540706fb-c959-43bc-a93f-6ee7b2f7c616\" (UID: \"540706fb-c959-43bc-a93f-6ee7b2f7c616\") "
Sep 17 00:46:15.793209 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.793136    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-plugins-config-volume\") pod \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\" (UID: \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\") "
Sep 17 00:46:15.793331 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.793238    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcfmc\" (UniqueName: \"kubernetes.io/projected/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-kube-api-access-fcfmc\") pod \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\" (UID: \"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf\") "
Sep 17 00:46:15.793501 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.793477    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/540706fb-c959-43bc-a93f-6ee7b2f7c616-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "540706fb-c959-43bc-a93f-6ee7b2f7c616" (UID: "540706fb-c959-43bc-a93f-6ee7b2f7c616"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:46:15.793600 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.793496    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e37a3bb5-bc2e-48f1-a86d-3c20877c85cf" (UID: "e37a3bb5-bc2e-48f1-a86d-3c20877c85cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:46:15.793673 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.793656    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/540706fb-c959-43bc-a93f-6ee7b2f7c616-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:46:15.793723 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.793679    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:46:15.795311 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.795291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/540706fb-c959-43bc-a93f-6ee7b2f7c616-kube-api-access-9g448" (OuterVolumeSpecName: "kube-api-access-9g448") pod "540706fb-c959-43bc-a93f-6ee7b2f7c616" (UID: "540706fb-c959-43bc-a93f-6ee7b2f7c616"). InnerVolumeSpecName "kube-api-access-9g448". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:46:15.795384 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.795311    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-kube-api-access-fcfmc" (OuterVolumeSpecName: "kube-api-access-fcfmc") pod "e37a3bb5-bc2e-48f1-a86d-3c20877c85cf" (UID: "e37a3bb5-bc2e-48f1-a86d-3c20877c85cf"). InnerVolumeSpecName "kube-api-access-fcfmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:46:15.894372 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.894339    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g448\" (UniqueName: \"kubernetes.io/projected/540706fb-c959-43bc-a93f-6ee7b2f7c616-kube-api-access-9g448\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:46:15.894372 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:15.894371    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcfmc\" (UniqueName: \"kubernetes.io/projected/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf-kube-api-access-fcfmc\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:46:16.185640 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.185602    2565 generic.go:356] "Generic (PLEG): container finished" podID="e37a3bb5-bc2e-48f1-a86d-3c20877c85cf" containerID="a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62" exitCode=0
Sep 17 00:46:16.185832 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.185658    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"
Sep 17 00:46:16.185832 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.185703    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp" event={"ID":"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf","Type":"ContainerDied","Data":"a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62"}
Sep 17 00:46:16.185832 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.185756    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp" event={"ID":"e37a3bb5-bc2e-48f1-a86d-3c20877c85cf","Type":"ContainerDied","Data":"d9498d801735a3580a98ea560494337edae5b09502b3ade3b73576c571b1d16c"}
Sep 17 00:46:16.185832 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.185789    2565 scope.go:117] "RemoveContainer" containerID="a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62"
Sep 17 00:46:16.187301 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.187272    2565 generic.go:356] "Generic (PLEG): container finished" podID="540706fb-c959-43bc-a93f-6ee7b2f7c616" containerID="48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85" exitCode=0
Sep 17 00:46:16.187419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.187322    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"
Sep 17 00:46:16.187489 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.187405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd" event={"ID":"540706fb-c959-43bc-a93f-6ee7b2f7c616","Type":"ContainerDied","Data":"48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85"}
Sep 17 00:46:16.187489 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.187458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd" event={"ID":"540706fb-c959-43bc-a93f-6ee7b2f7c616","Type":"ContainerDied","Data":"6eb0cebeb4f9d0de7b70a9847a283736e93e467f1433df4c9d653fb19acb0782"}
Sep 17 00:46:16.195583 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.195565    2565 scope.go:117] "RemoveContainer" containerID="a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62"
Sep 17 00:46:16.195878 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:46:16.195858    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62\": container with ID starting with a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62 not found: ID does not exist" containerID="a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62"
Sep 17 00:46:16.195970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.195887    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62"} err="failed to get container status \"a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62\": rpc error: code = NotFound desc = could not find container \"a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62\": container with ID starting with a757cfed70403d6cd26f3eb3977ee0aa592f9281330afd628a39b056aa394c62 not found: ID does not exist"
Sep 17 00:46:16.195970 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.195937    2565 scope.go:117] "RemoveContainer" containerID="48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85"
Sep 17 00:46:16.204246 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.204230    2565 scope.go:117] "RemoveContainer" containerID="48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85"
Sep 17 00:46:16.204511 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:46:16.204492    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85\": container with ID starting with 48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85 not found: ID does not exist" containerID="48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85"
Sep 17 00:46:16.204555 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.204517    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85"} err="failed to get container status \"48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85\": rpc error: code = NotFound desc = could not find container \"48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85\": container with ID starting with 48f6b97c207ae936028c047dbecba03cd6679d783cee861eaec7e27381edbf85 not found: ID does not exist"
Sep 17 00:46:16.210497 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.210472    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"]
Sep 17 00:46:16.214709 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.214682    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-eaba37-7b6f79ff4b-x4zdp"]
Sep 17 00:46:16.227084 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.227057    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"]
Sep 17 00:46:16.232705 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:16.232683    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-eaba37-9594bdff-9x6rd"]
Sep 17 00:46:17.391396 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:17.391364    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="002b429c-6301-47e7-a0da-ffa538deeefc" path="/var/lib/kubelet/pods/002b429c-6301-47e7-a0da-ffa538deeefc/volumes"
Sep 17 00:46:17.391884 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:17.391655    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c938a21-28c2-43bf-b340-9544a60f99c3" path="/var/lib/kubelet/pods/0c938a21-28c2-43bf-b340-9544a60f99c3/volumes"
Sep 17 00:46:17.391972 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:17.391959    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="540706fb-c959-43bc-a93f-6ee7b2f7c616" path="/var/lib/kubelet/pods/540706fb-c959-43bc-a93f-6ee7b2f7c616/volumes"
Sep 17 00:46:17.392306 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:46:17.392290    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e37a3bb5-bc2e-48f1-a86d-3c20877c85cf" path="/var/lib/kubelet/pods/e37a3bb5-bc2e-48f1-a86d-3c20877c85cf/volumes"
Sep 17 00:47:04.117332 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117298    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"]
Sep 17 00:47:04.117757 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117740    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e37a3bb5-bc2e-48f1-a86d-3c20877c85cf" containerName="payload-pre-processing"
Sep 17 00:47:04.117803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117759    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e37a3bb5-bc2e-48f1-a86d-3c20877c85cf" containerName="payload-pre-processing"
Sep 17 00:47:04.117803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117771    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="002b429c-6301-47e7-a0da-ffa538deeefc" containerName="revoke-keys"
Sep 17 00:47:04.117803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117776    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="002b429c-6301-47e7-a0da-ffa538deeefc" containerName="revoke-keys"
Sep 17 00:47:04.117803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117793    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540706fb-c959-43bc-a93f-6ee7b2f7c616" containerName="payload-processing"
Sep 17 00:47:04.117803 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117798    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="540706fb-c959-43bc-a93f-6ee7b2f7c616" containerName="payload-processing"
Sep 17 00:47:04.117992 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117892    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="002b429c-6301-47e7-a0da-ffa538deeefc" containerName="revoke-keys"
Sep 17 00:47:04.117992 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117930    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e37a3bb5-bc2e-48f1-a86d-3c20877c85cf" containerName="payload-pre-processing"
Sep 17 00:47:04.117992 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.117936    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="540706fb-c959-43bc-a93f-6ee7b2f7c616" containerName="payload-processing"
Sep 17 00:47:04.128111 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.128080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"
Sep 17 00:47:04.130223 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.130193    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"]
Sep 17 00:47:04.130679 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.130657    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:47:04.221608 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.221574    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz\" (UID: \"2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"
Sep 17 00:47:04.322646 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.322611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz\" (UID: \"2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"
Sep 17 00:47:04.323261 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.323241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz\" (UID: \"2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"
Sep 17 00:47:04.442603 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.442518    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"
Sep 17 00:47:04.712797 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:04.712773    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"]
Sep 17 00:47:04.714506 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:47:04.714477    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad6c362_f6d3_4c47_b1a3_2c6d0f37f14e.slice/crio-85748376579b15528d314905af950ca707f572cb93c12727169754eed2e64dc8 WatchSource:0}: Error finding container 85748376579b15528d314905af950ca707f572cb93c12727169754eed2e64dc8: Status 404 returned error can't find the container with id 85748376579b15528d314905af950ca707f572cb93c12727169754eed2e64dc8
Sep 17 00:47:05.450534 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:05.450494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz" event={"ID":"2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e","Type":"ContainerStarted","Data":"946e6027cba2f838c1f86489235d5964137bfca00e5303d6788c505529546524"}
Sep 17 00:47:05.450981 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:05.450545    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz" event={"ID":"2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e","Type":"ContainerStarted","Data":"85748376579b15528d314905af950ca707f572cb93c12727169754eed2e64dc8"}
Sep 17 00:47:05.464869 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:05.464824    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz" podStartSLOduration=1.464811302 podStartE2EDuration="1.464811302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:47:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:47:05.464527692 +0000 UTC m=+2226.573303608" watchObservedRunningTime="2026-09-17 00:47:05.464811302 +0000 UTC m=+2226.573587217"
Sep 17 00:47:06.456880 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:06.456844    2565 generic.go:356] "Generic (PLEG): container finished" podID="2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e" containerID="946e6027cba2f838c1f86489235d5964137bfca00e5303d6788c505529546524" exitCode=0
Sep 17 00:47:06.457323 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:06.456890    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz" event={"ID":"2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e","Type":"ContainerDied","Data":"946e6027cba2f838c1f86489235d5964137bfca00e5303d6788c505529546524"}
Sep 17 00:47:07.593067 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:07.593046    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"
Sep 17 00:47:07.755531 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:07.755443    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e-maas-api-service-ca\") pod \"2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e\" (UID: \"2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e\") "
Sep 17 00:47:07.755834 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:07.755812    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e" (UID: "2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:07.856950 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:07.856925    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:08.467750 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:08.467726    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"
Sep 17 00:47:08.467975 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:08.467719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz" event={"ID":"2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e","Type":"ContainerDied","Data":"85748376579b15528d314905af950ca707f572cb93c12727169754eed2e64dc8"}
Sep 17 00:47:08.467975 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:08.467851    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="85748376579b15528d314905af950ca707f572cb93c12727169754eed2e64dc8"
Sep 17 00:47:14.810234 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:14.810193    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"]
Sep 17 00:47:14.812118 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:14.812089    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-a8402d-vdrkz"]
Sep 17 00:47:15.390445 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:15.390415    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e" path="/var/lib/kubelet/pods/2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e/volumes"
Sep 17 00:47:21.477118 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.477080    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"]
Sep 17 00:47:21.477539 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.477526    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e" containerName="revoke-keys"
Sep 17 00:47:21.477585 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.477541    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e" containerName="revoke-keys"
Sep 17 00:47:21.477645 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.477637    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ad6c362-f6d3-4c47-b1a3-2c6d0f37f14e" containerName="revoke-keys"
Sep 17 00:47:21.480737 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.480718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"
Sep 17 00:47:21.483317 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.483290    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jmwpp\""
Sep 17 00:47:21.489149 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.489121    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"]
Sep 17 00:47:21.568573 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.568543    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b83e48-72bc-4be5-ad13-1ccc0d87dda0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v\" (UID: \"83b83e48-72bc-4be5-ad13-1ccc0d87dda0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"
Sep 17 00:47:21.669572 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.669532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b83e48-72bc-4be5-ad13-1ccc0d87dda0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v\" (UID: \"83b83e48-72bc-4be5-ad13-1ccc0d87dda0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"
Sep 17 00:47:21.670219 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.670192    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b83e48-72bc-4be5-ad13-1ccc0d87dda0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v\" (UID: \"83b83e48-72bc-4be5-ad13-1ccc0d87dda0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"
Sep 17 00:47:21.792689 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:21.792613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"
Sep 17 00:47:22.065119 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:22.065084    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"]
Sep 17 00:47:22.067131 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:47:22.067106    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83b83e48_72bc_4be5_ad13_1ccc0d87dda0.slice/crio-060f4f8eaf4d1f3fd58df867af1937f5d201abb05dc765da75cebf65e3fb5c84 WatchSource:0}: Error finding container 060f4f8eaf4d1f3fd58df867af1937f5d201abb05dc765da75cebf65e3fb5c84: Status 404 returned error can't find the container with id 060f4f8eaf4d1f3fd58df867af1937f5d201abb05dc765da75cebf65e3fb5c84
Sep 17 00:47:22.556772 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:22.556733    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v" event={"ID":"83b83e48-72bc-4be5-ad13-1ccc0d87dda0","Type":"ContainerStarted","Data":"5625a4205478eabe7bf6317dea008d007efd26c70311d7d34d4a1206cc5885f7"}
Sep 17 00:47:22.557252 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:22.556790    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v" event={"ID":"83b83e48-72bc-4be5-ad13-1ccc0d87dda0","Type":"ContainerStarted","Data":"060f4f8eaf4d1f3fd58df867af1937f5d201abb05dc765da75cebf65e3fb5c84"}
Sep 17 00:47:22.572549 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:22.572505    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v" podStartSLOduration=1.572491616 podStartE2EDuration="1.572491616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:47:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:47:22.570608716 +0000 UTC m=+2243.679384635" watchObservedRunningTime="2026-09-17 00:47:22.572491616 +0000 UTC m=+2243.681267531"
Sep 17 00:47:23.564037 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:23.564000    2565 generic.go:356] "Generic (PLEG): container finished" podID="83b83e48-72bc-4be5-ad13-1ccc0d87dda0" containerID="5625a4205478eabe7bf6317dea008d007efd26c70311d7d34d4a1206cc5885f7" exitCode=0
Sep 17 00:47:23.564419 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:23.564060    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v" event={"ID":"83b83e48-72bc-4be5-ad13-1ccc0d87dda0","Type":"ContainerDied","Data":"5625a4205478eabe7bf6317dea008d007efd26c70311d7d34d4a1206cc5885f7"}
Sep 17 00:47:24.717442 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:24.717415    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"
Sep 17 00:47:24.803430 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:24.803402    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b83e48-72bc-4be5-ad13-1ccc0d87dda0-maas-api-service-ca\") pod \"83b83e48-72bc-4be5-ad13-1ccc0d87dda0\" (UID: \"83b83e48-72bc-4be5-ad13-1ccc0d87dda0\") "
Sep 17 00:47:24.803722 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:24.803699    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83b83e48-72bc-4be5-ad13-1ccc0d87dda0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "83b83e48-72bc-4be5-ad13-1ccc0d87dda0" (UID: "83b83e48-72bc-4be5-ad13-1ccc0d87dda0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:24.904553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:24.904526    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/83b83e48-72bc-4be5-ad13-1ccc0d87dda0-maas-api-service-ca\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:25.576680 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:25.576651    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"
Sep 17 00:47:25.576833 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:25.576690    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v" event={"ID":"83b83e48-72bc-4be5-ad13-1ccc0d87dda0","Type":"ContainerDied","Data":"060f4f8eaf4d1f3fd58df867af1937f5d201abb05dc765da75cebf65e3fb5c84"}
Sep 17 00:47:25.576833 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:25.576742    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="060f4f8eaf4d1f3fd58df867af1937f5d201abb05dc765da75cebf65e3fb5c84"
Sep 17 00:47:32.054836 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.054791    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"]
Sep 17 00:47:32.055443 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.055033    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h" podUID="b54166db-c714-478a-8282-e409d4645d91" containerName="payload-processing" containerID="cri-o://f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17" gracePeriod=30
Sep 17 00:47:32.061706 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.061668    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"]
Sep 17 00:47:32.062057 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.062005    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg" podUID="98423974-09c0-47ea-bef9-a0a3c76ecf4f" containerName="payload-pre-processing" containerID="cri-o://ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63" gracePeriod=30
Sep 17 00:47:32.205152 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.205077    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"]
Sep 17 00:47:32.207188 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.207158    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-47a2db-4zh8v"]
Sep 17 00:47:32.323805 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.323765    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:47:32.357586 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.357552    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:47:32.377137 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.377112    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54166db-c714-478a-8282-e409d4645d91-plugins-config-volume\") pod \"b54166db-c714-478a-8282-e409d4645d91\" (UID: \"b54166db-c714-478a-8282-e409d4645d91\") "
Sep 17 00:47:32.377265 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.377164    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxwrk\" (UniqueName: \"kubernetes.io/projected/b54166db-c714-478a-8282-e409d4645d91-kube-api-access-dxwrk\") pod \"b54166db-c714-478a-8282-e409d4645d91\" (UID: \"b54166db-c714-478a-8282-e409d4645d91\") "
Sep 17 00:47:32.377601 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.377565    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b54166db-c714-478a-8282-e409d4645d91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b54166db-c714-478a-8282-e409d4645d91" (UID: "b54166db-c714-478a-8282-e409d4645d91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:32.379727 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.379693    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b54166db-c714-478a-8282-e409d4645d91-kube-api-access-dxwrk" (OuterVolumeSpecName: "kube-api-access-dxwrk") pod "b54166db-c714-478a-8282-e409d4645d91" (UID: "b54166db-c714-478a-8282-e409d4645d91"). InnerVolumeSpecName "kube-api-access-dxwrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:32.477812 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.477779    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98423974-09c0-47ea-bef9-a0a3c76ecf4f-plugins-config-volume\") pod \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\" (UID: \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\") "
Sep 17 00:47:32.478019 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.477868    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjnkg\" (UniqueName: \"kubernetes.io/projected/98423974-09c0-47ea-bef9-a0a3c76ecf4f-kube-api-access-rjnkg\") pod \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\" (UID: \"98423974-09c0-47ea-bef9-a0a3c76ecf4f\") "
Sep 17 00:47:32.478194 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.478171    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b54166db-c714-478a-8282-e409d4645d91-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:32.478194 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.478191    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxwrk\" (UniqueName: \"kubernetes.io/projected/b54166db-c714-478a-8282-e409d4645d91-kube-api-access-dxwrk\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:32.478287 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.478255    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98423974-09c0-47ea-bef9-a0a3c76ecf4f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "98423974-09c0-47ea-bef9-a0a3c76ecf4f" (UID: "98423974-09c0-47ea-bef9-a0a3c76ecf4f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:32.480128 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.480109    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98423974-09c0-47ea-bef9-a0a3c76ecf4f-kube-api-access-rjnkg" (OuterVolumeSpecName: "kube-api-access-rjnkg") pod "98423974-09c0-47ea-bef9-a0a3c76ecf4f" (UID: "98423974-09c0-47ea-bef9-a0a3c76ecf4f"). InnerVolumeSpecName "kube-api-access-rjnkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:32.578808 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.578783    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/98423974-09c0-47ea-bef9-a0a3c76ecf4f-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:32.578808 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.578812    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjnkg\" (UniqueName: \"kubernetes.io/projected/98423974-09c0-47ea-bef9-a0a3c76ecf4f-kube-api-access-rjnkg\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:32.617064 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.617035    2565 generic.go:356] "Generic (PLEG): container finished" podID="b54166db-c714-478a-8282-e409d4645d91" containerID="f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17" exitCode=0
Sep 17 00:47:32.617176 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.617087    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"
Sep 17 00:47:32.617176 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.617116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h" event={"ID":"b54166db-c714-478a-8282-e409d4645d91","Type":"ContainerDied","Data":"f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17"}
Sep 17 00:47:32.617292 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.617179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h" event={"ID":"b54166db-c714-478a-8282-e409d4645d91","Type":"ContainerDied","Data":"a595d606dd34095de3a8e37d907ad810f113e734cd88485b131ab02dfeb0b7ee"}
Sep 17 00:47:32.617292 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.617214    2565 scope.go:117] "RemoveContainer" containerID="f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17"
Sep 17 00:47:32.618571 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.618544    2565 generic.go:356] "Generic (PLEG): container finished" podID="98423974-09c0-47ea-bef9-a0a3c76ecf4f" containerID="ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63" exitCode=0
Sep 17 00:47:32.618673 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.618596    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"
Sep 17 00:47:32.618673 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.618621    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg" event={"ID":"98423974-09c0-47ea-bef9-a0a3c76ecf4f","Type":"ContainerDied","Data":"ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63"}
Sep 17 00:47:32.618673 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.618665    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg" event={"ID":"98423974-09c0-47ea-bef9-a0a3c76ecf4f","Type":"ContainerDied","Data":"1b40956af8b319b22f2cd4d18f79fe639ea9c6957f84b1aa928b507a844839a2"}
Sep 17 00:47:32.626979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.626958    2565 scope.go:117] "RemoveContainer" containerID="f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17"
Sep 17 00:47:32.627431 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:47:32.627409    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17\": container with ID starting with f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17 not found: ID does not exist" containerID="f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17"
Sep 17 00:47:32.627535 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.627439    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17"} err="failed to get container status \"f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17\": rpc error: code = NotFound desc = could not find container \"f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17\": container with ID starting with f45428cb75fdd241a0bc6d915afdb8d5911caa9d1263b1e8cf3f9f09bd90fc17 not found: ID does not exist"
Sep 17 00:47:32.627535 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.627462    2565 scope.go:117] "RemoveContainer" containerID="ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63"
Sep 17 00:47:32.635948 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.635931    2565 scope.go:117] "RemoveContainer" containerID="ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63"
Sep 17 00:47:32.636253 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:47:32.636231    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63\": container with ID starting with ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63 not found: ID does not exist" containerID="ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63"
Sep 17 00:47:32.636343 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.636260    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63"} err="failed to get container status \"ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63\": rpc error: code = NotFound desc = could not find container \"ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63\": container with ID starting with ac864c56422e27f4510f4be88b8ec98f2d0ca206adc50bcf57f539460ad37e63 not found: ID does not exist"
Sep 17 00:47:32.643909 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.643879    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"]
Sep 17 00:47:32.647474 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.647454    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-47a2db-6c6c99548b-2rcjg"]
Sep 17 00:47:32.658272 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.658251    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"]
Sep 17 00:47:32.661551 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:32.661531    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-47a2db-57fbfcc5c9-w897h"]
Sep 17 00:47:33.389656 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:33.389626    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83b83e48-72bc-4be5-ad13-1ccc0d87dda0" path="/var/lib/kubelet/pods/83b83e48-72bc-4be5-ad13-1ccc0d87dda0/volumes"
Sep 17 00:47:33.390048 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:33.390026    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98423974-09c0-47ea-bef9-a0a3c76ecf4f" path="/var/lib/kubelet/pods/98423974-09c0-47ea-bef9-a0a3c76ecf4f/volumes"
Sep 17 00:47:33.390362 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:33.390349    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b54166db-c714-478a-8282-e409d4645d91" path="/var/lib/kubelet/pods/b54166db-c714-478a-8282-e409d4645d91/volumes"
Sep 17 00:47:49.422224 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.422189    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck"]
Sep 17 00:47:49.425024 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.424998    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-07f9f2-29826765-g69ck"]
Sep 17 00:47:49.446933 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.446887    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"]
Sep 17 00:47:49.447214 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.447186    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw" podUID="d4a9862a-44e5-4694-8c90-f90b15f05019" containerName="payload-processing" containerID="cri-o://0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526" gracePeriod=30
Sep 17 00:47:49.706509 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.706485    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:47:49.709769 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.709742    2565 generic.go:356] "Generic (PLEG): container finished" podID="d4a9862a-44e5-4694-8c90-f90b15f05019" containerID="0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526" exitCode=0
Sep 17 00:47:49.709926 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.709779    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"
Sep 17 00:47:49.709926 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.709836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw" event={"ID":"d4a9862a-44e5-4694-8c90-f90b15f05019","Type":"ContainerDied","Data":"0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526"}
Sep 17 00:47:49.710052 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.709938    2565 scope.go:117] "RemoveContainer" containerID="0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526"
Sep 17 00:47:49.710052 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.709941    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw" event={"ID":"d4a9862a-44e5-4694-8c90-f90b15f05019","Type":"ContainerDied","Data":"fe0a9a31495ad97f13bcfb3f2fd2b505f2463b35441050f5970cc451d3165c08"}
Sep 17 00:47:49.719183 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.719165    2565 scope.go:117] "RemoveContainer" containerID="0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526"
Sep 17 00:47:49.719483 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:47:49.719452    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526\": container with ID starting with 0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526 not found: ID does not exist" containerID="0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526"
Sep 17 00:47:49.719551 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.719484    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526"} err="failed to get container status \"0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526\": rpc error: code = NotFound desc = could not find container \"0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526\": container with ID starting with 0fbee86e7be59cb1083c68c9622bf916db466b921f290f93f9b712b5eb7ce526 not found: ID does not exist"
Sep 17 00:47:49.829400 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.829372    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67szr\" (UniqueName: \"kubernetes.io/projected/d4a9862a-44e5-4694-8c90-f90b15f05019-kube-api-access-67szr\") pod \"d4a9862a-44e5-4694-8c90-f90b15f05019\" (UID: \"d4a9862a-44e5-4694-8c90-f90b15f05019\") "
Sep 17 00:47:49.829543 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.829434    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4a9862a-44e5-4694-8c90-f90b15f05019-plugins-config-volume\") pod \"d4a9862a-44e5-4694-8c90-f90b15f05019\" (UID: \"d4a9862a-44e5-4694-8c90-f90b15f05019\") "
Sep 17 00:47:49.829779 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.829741    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4a9862a-44e5-4694-8c90-f90b15f05019-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d4a9862a-44e5-4694-8c90-f90b15f05019" (UID: "d4a9862a-44e5-4694-8c90-f90b15f05019"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:47:49.831428 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.831404    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4a9862a-44e5-4694-8c90-f90b15f05019-kube-api-access-67szr" (OuterVolumeSpecName: "kube-api-access-67szr") pod "d4a9862a-44e5-4694-8c90-f90b15f05019" (UID: "d4a9862a-44e5-4694-8c90-f90b15f05019"). InnerVolumeSpecName "kube-api-access-67szr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:49.930824 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.930792    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67szr\" (UniqueName: \"kubernetes.io/projected/d4a9862a-44e5-4694-8c90-f90b15f05019-kube-api-access-67szr\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:49.930824 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:49.930817    2565 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d4a9862a-44e5-4694-8c90-f90b15f05019-plugins-config-volume\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:50.032873 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:50.032841    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"]
Sep 17 00:47:50.038297 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:50.038271    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-07f9f2-fc78b9f57-gjbmw"]
Sep 17 00:47:51.389776 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:51.389740    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aea4c9a6-5c78-4abd-8c9b-48c27e68e298" path="/var/lib/kubelet/pods/aea4c9a6-5c78-4abd-8c9b-48c27e68e298/volumes"
Sep 17 00:47:51.390295 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:51.390272    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4a9862a-44e5-4694-8c90-f90b15f05019" path="/var/lib/kubelet/pods/d4a9862a-44e5-4694-8c90-f90b15f05019/volumes"
Sep 17 00:47:56.097912 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:56.097871    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"]
Sep 17 00:47:56.098382 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:56.098131    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" containerID="cri-o://2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4" gracePeriod=30
Sep 17 00:47:57.141505 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:57.141467    2565 patch_prober.go:28] interesting pod/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 17 00:47:57.141860 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:57.141533    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 17 00:47:58.951967 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:58.951934    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-lsmrz"]
Sep 17 00:47:58.952355 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:58.952141    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz" podUID="3748d0c5-6c5f-4e49-8103-1cb1a8523d4c" containerName="manager" containerID="cri-o://f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5" gracePeriod=30
Sep 17 00:47:59.198258 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.198234    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:47:59.214695 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.214637    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xz4qr\" (UniqueName: \"kubernetes.io/projected/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-kube-api-access-xz4qr\") pod \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") "
Sep 17 00:47:59.214695 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.214687    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-webhook-cert\") pod \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") "
Sep 17 00:47:59.214852 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.214718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-metrics-certs\") pod \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\" (UID: \"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c\") "
Sep 17 00:47:59.217199 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.217159    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3748d0c5-6c5f-4e49-8103-1cb1a8523d4c" (UID: "3748d0c5-6c5f-4e49-8103-1cb1a8523d4c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:47:59.217538 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.217495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3748d0c5-6c5f-4e49-8103-1cb1a8523d4c" (UID: "3748d0c5-6c5f-4e49-8103-1cb1a8523d4c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:47:59.217756 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.217731    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-kube-api-access-xz4qr" (OuterVolumeSpecName: "kube-api-access-xz4qr") pod "3748d0c5-6c5f-4e49-8103-1cb1a8523d4c" (UID: "3748d0c5-6c5f-4e49-8103-1cb1a8523d4c"). InnerVolumeSpecName "kube-api-access-xz4qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:47:59.315783 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.315748    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xz4qr\" (UniqueName: \"kubernetes.io/projected/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-kube-api-access-xz4qr\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:59.315783 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.315779    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-webhook-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:59.315783 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.315790    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c-metrics-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:47:59.768102 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.768060    2565 generic.go:356] "Generic (PLEG): container finished" podID="3748d0c5-6c5f-4e49-8103-1cb1a8523d4c" containerID="f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5" exitCode=0
Sep 17 00:47:59.768291 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.768119    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz"
Sep 17 00:47:59.768291 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.768134    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz" event={"ID":"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c","Type":"ContainerDied","Data":"f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5"}
Sep 17 00:47:59.768291 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.768183    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-lsmrz" event={"ID":"3748d0c5-6c5f-4e49-8103-1cb1a8523d4c","Type":"ContainerDied","Data":"82bda84179940959a06db8bcb4c138bc81ec9863881357fe3e2e67402c86812f"}
Sep 17 00:47:59.768291 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.768208    2565 scope.go:117] "RemoveContainer" containerID="f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5"
Sep 17 00:47:59.777815 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.777796    2565 scope.go:117] "RemoveContainer" containerID="f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5"
Sep 17 00:47:59.778092 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:47:59.778071    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5\": container with ID starting with f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5 not found: ID does not exist" containerID="f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5"
Sep 17 00:47:59.778165 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.778099    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5"} err="failed to get container status \"f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5\": rpc error: code = NotFound desc = could not find container \"f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5\": container with ID starting with f72d31beb0954d203a582dc85b655e7038a97f49b976d8c7389e3afd3f2c40d5 not found: ID does not exist"
Sep 17 00:47:59.786109 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.786088    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-lsmrz"]
Sep 17 00:47:59.789100 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:47:59.789078    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-lsmrz"]
Sep 17 00:48:01.359428 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.359406    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:48:01.390842 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.390775    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3748d0c5-6c5f-4e49-8103-1cb1a8523d4c" path="/var/lib/kubelet/pods/3748d0c5-6c5f-4e49-8103-1cb1a8523d4c/volumes"
Sep 17 00:48:01.432918 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.432873    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-socket\") pod \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") "
Sep 17 00:48:01.433078 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.432926    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-podinfo\") pod \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") "
Sep 17 00:48:01.433078 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.432985    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-credential-socket\") pod \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") "
Sep 17 00:48:01.433078 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433008    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-token\") pod \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") "
Sep 17 00:48:01.433263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433118    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-certs\") pod \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") "
Sep 17 00:48:01.433263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433175    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" (UID: "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:48:01.433263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433217    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istiod-ca-cert\") pod \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") "
Sep 17 00:48:01.433263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433249    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-envoy\") pod \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") "
Sep 17 00:48:01.433473 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433275    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" (UID: "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:48:01.433473 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433278    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49wjf\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-kube-api-access-49wjf\") pod \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") "
Sep 17 00:48:01.433473 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433368    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-data\") pod \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\" (UID: \"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb\") "
Sep 17 00:48:01.433473 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433433    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" (UID: "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:48:01.433692 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" (UID: "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 17 00:48:01.433753 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433704    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" (UID: "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:48:01.433848 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433814    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-data\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:48:01.433848 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433836    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:48:01.433997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433852    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-credential-socket\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:48:01.433997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433868    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-workload-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:48:01.433997 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.433881    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istiod-ca-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:48:01.435489 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.435459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-kube-api-access-49wjf" (OuterVolumeSpecName: "kube-api-access-49wjf") pod "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" (UID: "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb"). InnerVolumeSpecName "kube-api-access-49wjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:48:01.435585 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.435505    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" (UID: "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 17 00:48:01.435638 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.435589    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" (UID: "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 17 00:48:01.435683 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.435660    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" (UID: "0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:48:01.535236 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.535192    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-podinfo\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:48:01.535373 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.535250    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-token\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:48:01.535373 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.535267    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-istio-envoy\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:48:01.535373 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.535282    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49wjf\" (UniqueName: \"kubernetes.io/projected/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb-kube-api-access-49wjf\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:48:01.782129 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.782035    2565 generic.go:356] "Generic (PLEG): container finished" podID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerID="2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4" exitCode=0
Sep 17 00:48:01.782129 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.782085    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"
Sep 17 00:48:01.782341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.782125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" event={"ID":"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb","Type":"ContainerDied","Data":"2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4"}
Sep 17 00:48:01.782341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.782191    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq" event={"ID":"0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb","Type":"ContainerDied","Data":"976b8224edfc9ad4aa8a723bcb8fa96795c3a75f49f8f53461cdba4816423a00"}
Sep 17 00:48:01.782341 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.782224    2565 scope.go:117] "RemoveContainer" containerID="2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4"
Sep 17 00:48:01.795511 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.795495    2565 scope.go:117] "RemoveContainer" containerID="c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98"
Sep 17 00:48:01.806017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.805989    2565 scope.go:117] "RemoveContainer" containerID="2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4"
Sep 17 00:48:01.806443 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:48:01.806406    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4\": container with ID starting with 2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4 not found: ID does not exist" containerID="2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4"
Sep 17 00:48:01.806540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.806450    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4"} err="failed to get container status \"2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4\": rpc error: code = NotFound desc = could not find container \"2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4\": container with ID starting with 2068b14eeaf2a0508cf43f9d4978410685cf11fc4553ce81ce7679fb704ff9b4 not found: ID does not exist"
Sep 17 00:48:01.806540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.806475    2565 scope.go:117] "RemoveContainer" containerID="c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98"
Sep 17 00:48:01.806540 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.806511    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"]
Sep 17 00:48:01.807043 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:48:01.807016    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98\": container with ID starting with c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98 not found: ID does not exist" containerID="c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98"
Sep 17 00:48:01.807145 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.807053    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98"} err="failed to get container status \"c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98\": rpc error: code = NotFound desc = could not find container \"c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98\": container with ID starting with c11a09eed2a29f3a4e136d78b405171e339be13c0d5b50e442cf390aefc55c98 not found: ID does not exist"
Sep 17 00:48:01.810634 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:01.810609    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-07f9f2-openshift-default-7dc568c646-wf9rq"]
Sep 17 00:48:03.391436 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:48:03.391397    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" path="/var/lib/kubelet/pods/0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb/volumes"
Sep 17 00:49:00.626944 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.626886    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-p4d96"]
Sep 17 00:49:00.627493 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627471    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy"
Sep 17 00:49:00.627588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627496    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy"
Sep 17 00:49:00.627588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627513    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83b83e48-72bc-4be5-ad13-1ccc0d87dda0" containerName="revoke-keys"
Sep 17 00:49:00.627588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627521    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="83b83e48-72bc-4be5-ad13-1ccc0d87dda0" containerName="revoke-keys"
Sep 17 00:49:00.627588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627540    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy"
Sep 17 00:49:00.627588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627548    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy"
Sep 17 00:49:00.627588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627558    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b54166db-c714-478a-8282-e409d4645d91" containerName="payload-processing"
Sep 17 00:49:00.627588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627567    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b54166db-c714-478a-8282-e409d4645d91" containerName="payload-processing"
Sep 17 00:49:00.627588 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627584    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4a9862a-44e5-4694-8c90-f90b15f05019" containerName="payload-processing"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627592    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4a9862a-44e5-4694-8c90-f90b15f05019" containerName="payload-processing"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627616    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98423974-09c0-47ea-bef9-a0a3c76ecf4f" containerName="payload-pre-processing"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627625    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="98423974-09c0-47ea-bef9-a0a3c76ecf4f" containerName="payload-pre-processing"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627636    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3748d0c5-6c5f-4e49-8103-1cb1a8523d4c" containerName="manager"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627644    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3748d0c5-6c5f-4e49-8103-1cb1a8523d4c" containerName="manager"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627759    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="98423974-09c0-47ea-bef9-a0a3c76ecf4f" containerName="payload-pre-processing"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627775    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627786    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4a9862a-44e5-4694-8c90-f90b15f05019" containerName="payload-processing"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627795    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa43e42-85b4-4f37-a4cd-3a5569b1f4bb" containerName="istio-proxy"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627803    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3748d0c5-6c5f-4e49-8103-1cb1a8523d4c" containerName="manager"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627812    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="83b83e48-72bc-4be5-ad13-1ccc0d87dda0" containerName="revoke-keys"
Sep 17 00:49:00.628017 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.627822    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b54166db-c714-478a-8282-e409d4645d91" containerName="payload-processing"
Sep 17 00:49:00.630726 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.630705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.634430 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.634408    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 00:49:00.634553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.634419    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 00:49:00.634553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.634408    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 00:49:00.634553 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.634459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qbf9b\""
Sep 17 00:49:00.640078 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.640054    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-p4d96"]
Sep 17 00:49:00.653824 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.653803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8gh4\" (UniqueName: \"kubernetes.io/projected/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-kube-api-access-b8gh4\") pod \"maas-controller-6f5bf55f6d-p4d96\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") " pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.653958 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.653883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-metrics-certs\") pod \"maas-controller-6f5bf55f6d-p4d96\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") " pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.654016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.653953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-webhook-cert\") pod \"maas-controller-6f5bf55f6d-p4d96\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") " pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.754655 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.754620    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-webhook-cert\") pod \"maas-controller-6f5bf55f6d-p4d96\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") " pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.754805 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.754717    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8gh4\" (UniqueName: \"kubernetes.io/projected/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-kube-api-access-b8gh4\") pod \"maas-controller-6f5bf55f6d-p4d96\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") " pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.754875 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.754823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-metrics-certs\") pod \"maas-controller-6f5bf55f6d-p4d96\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") " pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.757129 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.757109    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-webhook-cert\") pod \"maas-controller-6f5bf55f6d-p4d96\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") " pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.757227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.757151    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-metrics-certs\") pod \"maas-controller-6f5bf55f6d-p4d96\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") " pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.762555 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.762536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8gh4\" (UniqueName: \"kubernetes.io/projected/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-kube-api-access-b8gh4\") pod \"maas-controller-6f5bf55f6d-p4d96\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") " pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:00.941892 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:00.941800    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:01.211865 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:01.211839    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-p4d96"]
Sep 17 00:49:01.214037 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:49:01.214009    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ab54468_3a8a_4bf3_b424_63a2e7e5247f.slice/crio-fa4bae520656887286de041255fc993367f789fca673d1336b9990393e7cb29b WatchSource:0}: Error finding container fa4bae520656887286de041255fc993367f789fca673d1336b9990393e7cb29b: Status 404 returned error can't find the container with id fa4bae520656887286de041255fc993367f789fca673d1336b9990393e7cb29b
Sep 17 00:49:01.215441 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:01.215423    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:49:02.097708 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:02.097663    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96" event={"ID":"4ab54468-3a8a-4bf3-b424-63a2e7e5247f","Type":"ContainerStarted","Data":"b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90"}
Sep 17 00:49:02.099099 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:02.097731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96" event={"ID":"4ab54468-3a8a-4bf3-b424-63a2e7e5247f","Type":"ContainerStarted","Data":"fa4bae520656887286de041255fc993367f789fca673d1336b9990393e7cb29b"}
Sep 17 00:49:02.099099 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:02.097860    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:02.115392 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:02.115330    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96" podStartSLOduration=1.6356709249999999 podStartE2EDuration="2.115315486s" totalImagesPullingTime="479.644561ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:49:02.113101308 +0000 UTC m=+2343.221877225" watchObservedRunningTime="2026-09-17 00:49:02.115315486 +0000 UTC m=+2343.224091402"
Sep 17 00:49:13.105321 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:13.105289    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:20.307695 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.307647    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-p4d96"]
Sep 17 00:49:20.308296 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.307881    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96" podUID="4ab54468-3a8a-4bf3-b424-63a2e7e5247f" containerName="manager" containerID="cri-o://b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90" gracePeriod=30
Sep 17 00:49:20.551546 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.551521    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:20.631472 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.631443    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-webhook-cert\") pod \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") "
Sep 17 00:49:20.631643 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.631533    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8gh4\" (UniqueName: \"kubernetes.io/projected/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-kube-api-access-b8gh4\") pod \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") "
Sep 17 00:49:20.631643 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.631573    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-metrics-certs\") pod \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\" (UID: \"4ab54468-3a8a-4bf3-b424-63a2e7e5247f\") "
Sep 17 00:49:20.633524 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.633489    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4ab54468-3a8a-4bf3-b424-63a2e7e5247f" (UID: "4ab54468-3a8a-4bf3-b424-63a2e7e5247f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:49:20.633524 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.633503    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4ab54468-3a8a-4bf3-b424-63a2e7e5247f" (UID: "4ab54468-3a8a-4bf3-b424-63a2e7e5247f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 17 00:49:20.633718 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.633551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-kube-api-access-b8gh4" (OuterVolumeSpecName: "kube-api-access-b8gh4") pod "4ab54468-3a8a-4bf3-b424-63a2e7e5247f" (UID: "4ab54468-3a8a-4bf3-b424-63a2e7e5247f"). InnerVolumeSpecName "kube-api-access-b8gh4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 17 00:49:20.732374 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.732340    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-webhook-cert\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:49:20.732374 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.732369    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8gh4\" (UniqueName: \"kubernetes.io/projected/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-kube-api-access-b8gh4\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:49:20.732562 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:20.732382    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ab54468-3a8a-4bf3-b424-63a2e7e5247f-metrics-certs\") on node \"ip-10-0-135-192.ec2.internal\" DevicePath \"\""
Sep 17 00:49:21.198476 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.198440    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ab54468-3a8a-4bf3-b424-63a2e7e5247f" containerID="b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90" exitCode=0
Sep 17 00:49:21.198675 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.198481    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96"
Sep 17 00:49:21.198675 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.198534    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96" event={"ID":"4ab54468-3a8a-4bf3-b424-63a2e7e5247f","Type":"ContainerDied","Data":"b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90"}
Sep 17 00:49:21.198675 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.198591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-p4d96" event={"ID":"4ab54468-3a8a-4bf3-b424-63a2e7e5247f","Type":"ContainerDied","Data":"fa4bae520656887286de041255fc993367f789fca673d1336b9990393e7cb29b"}
Sep 17 00:49:21.198675 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.198622    2565 scope.go:117] "RemoveContainer" containerID="b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90"
Sep 17 00:49:21.208383 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.208368    2565 scope.go:117] "RemoveContainer" containerID="b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90"
Sep 17 00:49:21.208656 ip-10-0-135-192 kubenswrapper[2565]: E0917 00:49:21.208637    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90\": container with ID starting with b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90 not found: ID does not exist" containerID="b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90"
Sep 17 00:49:21.208714 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.208665    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90"} err="failed to get container status \"b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90\": rpc error: code = NotFound desc = could not find container \"b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90\": container with ID starting with b18f7a95bdf179f77b2ff841e432b2ea9ce550734dd5c6d311b3e34257619c90 not found: ID does not exist"
Sep 17 00:49:21.218932 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.218909    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-p4d96"]
Sep 17 00:49:21.222365 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.222343    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-p4d96"]
Sep 17 00:49:21.389367 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:21.389335    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ab54468-3a8a-4bf3-b424-63a2e7e5247f" path="/var/lib/kubelet/pods/4ab54468-3a8a-4bf3-b424-63a2e7e5247f/volumes"
Sep 17 00:49:22.132569 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.132533    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-vngrx"]
Sep 17 00:49:22.133010 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.132991    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ab54468-3a8a-4bf3-b424-63a2e7e5247f" containerName="manager"
Sep 17 00:49:22.133010 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.133011    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ab54468-3a8a-4bf3-b424-63a2e7e5247f" containerName="manager"
Sep 17 00:49:22.133174 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.133132    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ab54468-3a8a-4bf3-b424-63a2e7e5247f" containerName="manager"
Sep 17 00:49:22.137682 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.137662    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.141499 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.141459    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 17 00:49:22.141623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.141461    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qbf9b\""
Sep 17 00:49:22.141889 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.141787    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 17 00:49:22.141889 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.141828    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 17 00:49:22.144365 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.144342    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-vngrx"]
Sep 17 00:49:22.247496 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.247464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e671f004-288b-44d3-b182-72f10dd4783d-webhook-cert\") pod \"maas-controller-6f5bf55f6d-vngrx\" (UID: \"e671f004-288b-44d3-b182-72f10dd4783d\") " pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.247496 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.247498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e671f004-288b-44d3-b182-72f10dd4783d-metrics-certs\") pod \"maas-controller-6f5bf55f6d-vngrx\" (UID: \"e671f004-288b-44d3-b182-72f10dd4783d\") " pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.247716 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.247604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl4t4\" (UniqueName: \"kubernetes.io/projected/e671f004-288b-44d3-b182-72f10dd4783d-kube-api-access-sl4t4\") pod \"maas-controller-6f5bf55f6d-vngrx\" (UID: \"e671f004-288b-44d3-b182-72f10dd4783d\") " pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.348593 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.348557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e671f004-288b-44d3-b182-72f10dd4783d-webhook-cert\") pod \"maas-controller-6f5bf55f6d-vngrx\" (UID: \"e671f004-288b-44d3-b182-72f10dd4783d\") " pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.348593 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.348596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e671f004-288b-44d3-b182-72f10dd4783d-metrics-certs\") pod \"maas-controller-6f5bf55f6d-vngrx\" (UID: \"e671f004-288b-44d3-b182-72f10dd4783d\") " pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.348824 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.348679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl4t4\" (UniqueName: \"kubernetes.io/projected/e671f004-288b-44d3-b182-72f10dd4783d-kube-api-access-sl4t4\") pod \"maas-controller-6f5bf55f6d-vngrx\" (UID: \"e671f004-288b-44d3-b182-72f10dd4783d\") " pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.350872 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.350843    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e671f004-288b-44d3-b182-72f10dd4783d-metrics-certs\") pod \"maas-controller-6f5bf55f6d-vngrx\" (UID: \"e671f004-288b-44d3-b182-72f10dd4783d\") " pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.351016 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.350883    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e671f004-288b-44d3-b182-72f10dd4783d-webhook-cert\") pod \"maas-controller-6f5bf55f6d-vngrx\" (UID: \"e671f004-288b-44d3-b182-72f10dd4783d\") " pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.356366 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.356337    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl4t4\" (UniqueName: \"kubernetes.io/projected/e671f004-288b-44d3-b182-72f10dd4783d-kube-api-access-sl4t4\") pod \"maas-controller-6f5bf55f6d-vngrx\" (UID: \"e671f004-288b-44d3-b182-72f10dd4783d\") " pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.449800 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.449730    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:22.722397 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:22.722373    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6f5bf55f6d-vngrx"]
Sep 17 00:49:22.724328 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:49:22.724286    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode671f004_288b_44d3_b182_72f10dd4783d.slice/crio-f20f0c392cfb34f07e322245aae4d1f5d8949eb70995803d79a653b5614202f0 WatchSource:0}: Error finding container f20f0c392cfb34f07e322245aae4d1f5d8949eb70995803d79a653b5614202f0: Status 404 returned error can't find the container with id f20f0c392cfb34f07e322245aae4d1f5d8949eb70995803d79a653b5614202f0
Sep 17 00:49:23.214791 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:23.213066    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-vngrx" event={"ID":"e671f004-288b-44d3-b182-72f10dd4783d","Type":"ContainerStarted","Data":"597bd7ef816796307ffd4d026842a73ff097132cce5b21434591bc63fbf6797a"}
Sep 17 00:49:23.214791 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:23.213526    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:23.214791 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:23.213567    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6f5bf55f6d-vngrx" event={"ID":"e671f004-288b-44d3-b182-72f10dd4783d","Type":"ContainerStarted","Data":"f20f0c392cfb34f07e322245aae4d1f5d8949eb70995803d79a653b5614202f0"}
Sep 17 00:49:23.231872 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:23.231813    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6f5bf55f6d-vngrx" podStartSLOduration=0.883049497 podStartE2EDuration="1.231798156s" totalImagesPullingTime="348.748659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:49:23.229506461 +0000 UTC m=+2364.338282377" watchObservedRunningTime="2026-09-17 00:49:23.231798156 +0000 UTC m=+2364.340574109"
Sep 17 00:49:34.220943 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:34.220887    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6f5bf55f6d-vngrx"
Sep 17 00:49:59.552949 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:59.552919    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:49:59.601115 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:49:59.601089    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:52:00.029975 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:52:00.029882    2565 scope.go:117] "RemoveContainer" containerID="59b614f60525376034b28665e3f9a981ca591c6b99889df0030661bc69d98b3f"
Sep 17 00:52:00.039150 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:52:00.039128    2565 scope.go:117] "RemoveContainer" containerID="8ed472a8a8dd524afc7e7a2d49cfedd502d4a4c03630c9524fe286b9027e9c1d"
Sep 17 00:52:00.046826 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:52:00.046808    2565 scope.go:117] "RemoveContainer" containerID="06d4e1d3570e709e98215e4c483f3c6ec5187713c3fd0ad2124a1f334a49eec1"
Sep 17 00:53:00.074237 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:00.074202    2565 scope.go:117] "RemoveContainer" containerID="5d612d3f7bf78d53fef19cd1927c91c3a3a9ca3dd4670ccbba38633c9a56b9a1"
Sep 17 00:53:44.105201 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:44.105080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cddc7d965-k8z6c_c65268d6-5d64-482a-9d96-3acfec75ed81/authorino/0.log"
Sep 17 00:53:50.007480 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:50.007445    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f5bf55f6d-vngrx_e671f004-288b-44d3-b182-72f10dd4783d/manager/0.log"
Sep 17 00:53:50.500623 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:50.500590    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc689bf9d-k5fzq_cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6/copy-manifests/0.log"
Sep 17 00:53:50.506847 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:50.506825    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc689bf9d-k5fzq_cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6/manager/0.log"
Sep 17 00:53:51.209689 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:51.209658    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29826750-c22bn_a1a72094-f1c5-4792-ad2e-3fab3a66972d/cleanup/0.log"
Sep 17 00:53:51.320296 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:51.320266    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29826765-knnj2_7ef06717-7425-458e-93d0-896b038ef637/cleanup/0.log"
Sep 17 00:53:51.440125 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:51.440097    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-xvf4r_99a52ec6-8c0a-4313-8fa3-ad1959e045c8/postgres/0.log"
Sep 17 00:53:52.238454 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:52.238428    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cddc7d965-k8z6c_c65268d6-5d64-482a-9d96-3acfec75ed81/authorino/0.log"
Sep 17 00:53:52.479778 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:52.479740    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-2tkv2_902ba8a2-30d3-4978-99a1-cdeaa7ab670c/manager/0.log"
Sep 17 00:53:53.708037 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:53.708007    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f57c6d865-s8j24_d4e95bcf-4adf-4797-b46c-8cfe61ae12b5/kube-auth-proxy/0.log"
Sep 17 00:53:53.833801 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:53.833766    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pr7x5_16626e4d-960e-4f28-a622-96a0e93ebefa/istio-proxy/1.log"
Sep 17 00:53:53.955098 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:53.955056    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-xg9bn_7d509778-e992-481b-8d0f-a7f012c044d8/payload-pre-processing/0.log"
Sep 17 00:53:54.554774 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:54.554726    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-7ncxb_69b5b0d0-2703-443d-8370-95ab9cd77c3c/main/0.log"
Sep 17 00:53:54.793933 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:54.793883    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-248zw_8c772b8d-8bdd-4ba6-8ae8-583c18c37fca/main/0.log"
Sep 17 00:53:55.025434 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:53:55.025403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fxdgk7_f6237ae3-5ae6-450f-9b23-d7852ff1f3ee/main/0.log"
Sep 17 00:54:00.095051 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:00.095017    2565 scope.go:117] "RemoveContainer" containerID="946e6027cba2f838c1f86489235d5964137bfca00e5303d6788c505529546524"
Sep 17 00:54:00.103884 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:00.103864    2565 scope.go:117] "RemoveContainer" containerID="5625a4205478eabe7bf6317dea008d007efd26c70311d7d34d4a1206cc5885f7"
Sep 17 00:54:01.004369 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.004333    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d74xj/must-gather-8vv29"]
Sep 17 00:54:01.009939 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.009888    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d74xj/must-gather-8vv29"
Sep 17 00:54:01.013979 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.013952    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d74xj\"/\"openshift-service-ca.crt\""
Sep 17 00:54:01.014110 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.014018    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-d74xj\"/\"default-dockercfg-l5959\""
Sep 17 00:54:01.014110 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.014024    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-d74xj\"/\"kube-root-ca.crt\""
Sep 17 00:54:01.016266 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.016242    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d74xj/must-gather-8vv29"]
Sep 17 00:54:01.026335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.026312    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsjck\" (UniqueName: \"kubernetes.io/projected/3855ee95-8f2e-4c70-afff-ef93b35f507f-kube-api-access-tsjck\") pod \"must-gather-8vv29\" (UID: \"3855ee95-8f2e-4c70-afff-ef93b35f507f\") " pod="openshift-must-gather-d74xj/must-gather-8vv29"
Sep 17 00:54:01.026435 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.026340    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3855ee95-8f2e-4c70-afff-ef93b35f507f-must-gather-output\") pod \"must-gather-8vv29\" (UID: \"3855ee95-8f2e-4c70-afff-ef93b35f507f\") " pod="openshift-must-gather-d74xj/must-gather-8vv29"
Sep 17 00:54:01.127131 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.127095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsjck\" (UniqueName: \"kubernetes.io/projected/3855ee95-8f2e-4c70-afff-ef93b35f507f-kube-api-access-tsjck\") pod \"must-gather-8vv29\" (UID: \"3855ee95-8f2e-4c70-afff-ef93b35f507f\") " pod="openshift-must-gather-d74xj/must-gather-8vv29"
Sep 17 00:54:01.127131 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.127130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3855ee95-8f2e-4c70-afff-ef93b35f507f-must-gather-output\") pod \"must-gather-8vv29\" (UID: \"3855ee95-8f2e-4c70-afff-ef93b35f507f\") " pod="openshift-must-gather-d74xj/must-gather-8vv29"
Sep 17 00:54:01.127625 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.127441    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3855ee95-8f2e-4c70-afff-ef93b35f507f-must-gather-output\") pod \"must-gather-8vv29\" (UID: \"3855ee95-8f2e-4c70-afff-ef93b35f507f\") " pod="openshift-must-gather-d74xj/must-gather-8vv29"
Sep 17 00:54:01.135966 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.135943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsjck\" (UniqueName: \"kubernetes.io/projected/3855ee95-8f2e-4c70-afff-ef93b35f507f-kube-api-access-tsjck\") pod \"must-gather-8vv29\" (UID: \"3855ee95-8f2e-4c70-afff-ef93b35f507f\") " pod="openshift-must-gather-d74xj/must-gather-8vv29"
Sep 17 00:54:01.320263 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.320177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d74xj/must-gather-8vv29"
Sep 17 00:54:01.592168 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.592141    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d74xj/must-gather-8vv29"]
Sep 17 00:54:01.593809 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:54:01.593783    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3855ee95_8f2e_4c70_afff_ef93b35f507f.slice/crio-c04413d464e815e348b2c00a31a47839a8363b0020a674a4042bb8193d252d50 WatchSource:0}: Error finding container c04413d464e815e348b2c00a31a47839a8363b0020a674a4042bb8193d252d50: Status 404 returned error can't find the container with id c04413d464e815e348b2c00a31a47839a8363b0020a674a4042bb8193d252d50
Sep 17 00:54:01.595716 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.595699    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 17 00:54:01.668742 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:01.668707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d74xj/must-gather-8vv29" event={"ID":"3855ee95-8f2e-4c70-afff-ef93b35f507f","Type":"ContainerStarted","Data":"c04413d464e815e348b2c00a31a47839a8363b0020a674a4042bb8193d252d50"}
Sep 17 00:54:02.678714 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:02.678622    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d74xj/must-gather-8vv29" event={"ID":"3855ee95-8f2e-4c70-afff-ef93b35f507f","Type":"ContainerStarted","Data":"ba4d82e1973a75cc49065078d80f77994164efe9c932b806c76890c38560e9ae"}
Sep 17 00:54:02.678714 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:02.678680    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d74xj/must-gather-8vv29" event={"ID":"3855ee95-8f2e-4c70-afff-ef93b35f507f","Type":"ContainerStarted","Data":"fc51a2e69110b3710958759891908220ccbbf065a2c09e8a07373b600be16c56"}
Sep 17 00:54:02.694676 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:02.694610    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d74xj/must-gather-8vv29" podStartSLOduration=1.95377703 podStartE2EDuration="2.694594849s" totalImagesPullingTime="740.817819ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-17 00:54:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:54:02.694236881 +0000 UTC m=+2643.803012797" watchObservedRunningTime="2026-09-17 00:54:02.694594849 +0000 UTC m=+2643.803370764"
Sep 17 00:54:03.882202 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:03.882165    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9gcbh_f964a8dc-ec08-49f3-9c5e-a427f7fd695b/global-pull-secret-syncer/0.log"
Sep 17 00:54:04.042227 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:04.042198    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-spzhv_a46a1a11-4cc1-4a28-b604-6c409d181e54/konnectivity-agent/0.log"
Sep 17 00:54:04.092616 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:04.092585    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-192.ec2.internal_d7c6efec3d953df3c8f862ee842d933e/haproxy/0.log"
Sep 17 00:54:09.226278 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:09.226008    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5cddc7d965-k8z6c_c65268d6-5d64-482a-9d96-3acfec75ed81/authorino/0.log"
Sep 17 00:54:09.279335 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:09.279287    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-2tkv2_902ba8a2-30d3-4978-99a1-cdeaa7ab670c/manager/0.log"
Sep 17 00:54:10.864961 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:10.864891    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-rhfdq_e18b5f5a-0364-42bd-97be-a83fae10ac10/cluster-monitoring-operator/0.log"
Sep 17 00:54:10.894077 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:10.893955    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-95pfk_82ff24d7-2518-4de6-af9c-b59e10f3fcf0/kube-state-metrics/0.log"
Sep 17 00:54:10.912500 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:10.912466    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-95pfk_82ff24d7-2518-4de6-af9c-b59e10f3fcf0/kube-rbac-proxy-main/0.log"
Sep 17 00:54:10.932641 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:10.932587    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-95pfk_82ff24d7-2518-4de6-af9c-b59e10f3fcf0/kube-rbac-proxy-self/0.log"
Sep 17 00:54:11.016978 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.016946    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2f5rj_245f22b3-7a1b-43e0-b6cc-23b6ff33891a/node-exporter/0.log"
Sep 17 00:54:11.042870 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.042843    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2f5rj_245f22b3-7a1b-43e0-b6cc-23b6ff33891a/kube-rbac-proxy/0.log"
Sep 17 00:54:11.069550 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.069522    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2f5rj_245f22b3-7a1b-43e0-b6cc-23b6ff33891a/init-textfile/0.log"
Sep 17 00:54:11.315432 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.315401    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jkkzm_c3870839-3f33-490e-9026-db8927474e69/kube-rbac-proxy-main/0.log"
Sep 17 00:54:11.340472 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.340441    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jkkzm_c3870839-3f33-490e-9026-db8927474e69/kube-rbac-proxy-self/0.log"
Sep 17 00:54:11.361084 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.361024    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-jkkzm_c3870839-3f33-490e-9026-db8927474e69/openshift-state-metrics/0.log"
Sep 17 00:54:11.404271 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.404235    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee266d5e-c12b-4cda-bb15-30076d127020/prometheus/0.log"
Sep 17 00:54:11.423875 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.423845    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee266d5e-c12b-4cda-bb15-30076d127020/config-reloader/0.log"
Sep 17 00:54:11.446479 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.446447    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee266d5e-c12b-4cda-bb15-30076d127020/thanos-sidecar/0.log"
Sep 17 00:54:11.469376 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.469341    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee266d5e-c12b-4cda-bb15-30076d127020/kube-rbac-proxy-web/0.log"
Sep 17 00:54:11.491115 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.491003    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee266d5e-c12b-4cda-bb15-30076d127020/kube-rbac-proxy/0.log"
Sep 17 00:54:11.517399 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.517350    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee266d5e-c12b-4cda-bb15-30076d127020/kube-rbac-proxy-thanos/0.log"
Sep 17 00:54:11.540258 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.540221    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ee266d5e-c12b-4cda-bb15-30076d127020/init-config-reloader/0.log"
Sep 17 00:54:11.651152 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.651120    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-975697f56-ctshc_79f4c011-6515-45d4-9686-a7dca2a527f7/telemeter-client/0.log"
Sep 17 00:54:11.695597 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.695107    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-975697f56-ctshc_79f4c011-6515-45d4-9686-a7dca2a527f7/reload/0.log"
Sep 17 00:54:11.716322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.716294    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-975697f56-ctshc_79f4c011-6515-45d4-9686-a7dca2a527f7/kube-rbac-proxy/0.log"
Sep 17 00:54:11.749758 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.749679    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79b7fd8499-6b6wc_56da6621-b00a-4cf7-af58-6949200a0550/thanos-query/0.log"
Sep 17 00:54:11.769843 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.769815    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79b7fd8499-6b6wc_56da6621-b00a-4cf7-af58-6949200a0550/kube-rbac-proxy-web/0.log"
Sep 17 00:54:11.790300 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.790270    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79b7fd8499-6b6wc_56da6621-b00a-4cf7-af58-6949200a0550/kube-rbac-proxy/0.log"
Sep 17 00:54:11.810148 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.810115    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79b7fd8499-6b6wc_56da6621-b00a-4cf7-af58-6949200a0550/prom-label-proxy/0.log"
Sep 17 00:54:11.832230 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.832201    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79b7fd8499-6b6wc_56da6621-b00a-4cf7-af58-6949200a0550/kube-rbac-proxy-rules/0.log"
Sep 17 00:54:11.853336 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:11.853306    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-79b7fd8499-6b6wc_56da6621-b00a-4cf7-af58-6949200a0550/kube-rbac-proxy-metrics/0.log"
Sep 17 00:54:14.314444 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.314400    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"]
Sep 17 00:54:14.320730 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.320699    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.326652 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.326619    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"]
Sep 17 00:54:14.391065 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.391034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-proc\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.391256 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.391141    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-sys\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.391256 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.391234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-645x9\" (UniqueName: \"kubernetes.io/projected/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-kube-api-access-645x9\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.391405 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.391280    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-podres\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.391472 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.391419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-lib-modules\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.492804 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.492743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-proc\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.493018 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.492823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-sys\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.493018 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.492919    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-645x9\" (UniqueName: \"kubernetes.io/projected/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-kube-api-access-645x9\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.493018 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.492967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-podres\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.493194 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.493031    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-lib-modules\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.493194 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.493181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-lib-modules\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.493301 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.493226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-proc\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.493478 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.493452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-sys\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.493627 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.493601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-podres\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.502248 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.502186    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-645x9\" (UniqueName: \"kubernetes.io/projected/a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c-kube-api-access-645x9\") pod \"perf-node-gather-daemonset-hrblw\" (UID: \"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c\") " pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.635239 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.635208    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:14.919600 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:14.919572    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"]
Sep 17 00:54:14.923095 ip-10-0-135-192 kubenswrapper[2565]: W0917 00:54:14.923065    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda69ddfbd_3b47_4ab5_a7ab_ed9acd76785c.slice/crio-7edbcd03bc628983fc7d74543d59b4262d98d839681c101dd243540bc6efc64c WatchSource:0}: Error finding container 7edbcd03bc628983fc7d74543d59b4262d98d839681c101dd243540bc6efc64c: Status 404 returned error can't find the container with id 7edbcd03bc628983fc7d74543d59b4262d98d839681c101dd243540bc6efc64c
Sep 17 00:54:15.228070 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:15.227999    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-55kcq_3537920a-d5bb-4a0e-bab7-bac7b4b818c9/volume-data-source-validator/0.log"
Sep 17 00:54:15.778095 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:15.777184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw" event={"ID":"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c","Type":"ContainerStarted","Data":"6130e3dd87abdd4a26c29917bca7417b6eed1b02c5907f0a4713ef94114c8f97"}
Sep 17 00:54:15.778095 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:15.777249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw" event={"ID":"a69ddfbd-3b47-4ab5-a7ab-ed9acd76785c","Type":"ContainerStarted","Data":"7edbcd03bc628983fc7d74543d59b4262d98d839681c101dd243540bc6efc64c"}
Sep 17 00:54:15.778095 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:15.778045    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:15.794945 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:15.794868    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw" podStartSLOduration=1.794849782 podStartE2EDuration="1.794849782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-17 00:54:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-17 00:54:15.792283149 +0000 UTC m=+2656.901059066" watchObservedRunningTime="2026-09-17 00:54:15.794849782 +0000 UTC m=+2656.903625698"
Sep 17 00:54:16.310186 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:16.310146    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nw6jd_2dba56c7-2ca8-416c-af7c-8057b63fb437/dns/0.log"
Sep 17 00:54:16.329913 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:16.329871    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nw6jd_2dba56c7-2ca8-416c-af7c-8057b63fb437/kube-rbac-proxy/0.log"
Sep 17 00:54:16.394655 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:16.394620    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6kvtx_05a14f42-47c1-4c0e-b6a9-82a6ee4eb899/dns-node-resolver/0.log"
Sep 17 00:54:16.990376 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:16.990345    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-lpbnb_f1e60d13-d6b3-43f8-af0e-2865438288f9/node-ca/0.log"
Sep 17 00:54:18.845721 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:18.845693    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f57c6d865-s8j24_d4e95bcf-4adf-4797-b46c-8cfe61ae12b5/kube-auth-proxy/0.log"
Sep 17 00:54:18.872124 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:18.872094    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pr7x5_16626e4d-960e-4f28-a622-96a0e93ebefa/istio-proxy/0.log"
Sep 17 00:54:18.876521 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:18.876496    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pr7x5_16626e4d-960e-4f28-a622-96a0e93ebefa/istio-proxy/1.log"
Sep 17 00:54:18.912539 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:18.912500    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-xg9bn_7d509778-e992-481b-8d0f-a7f012c044d8/payload-pre-processing/0.log"
Sep 17 00:54:19.846567 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:19.846536    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qb7zm_497786de-13ef-4479-b0bf-7a6fcf911f8c/serve-healthcheck-canary/0.log"
Sep 17 00:54:20.352216 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:20.352180    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-6zdqm_26347aba-c871-478d-af3d-bb09d4eb9260/insights-operator/0.log"
Sep 17 00:54:20.352703 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:20.352680    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-6zdqm_26347aba-c871-478d-af3d-bb09d4eb9260/insights-operator/1.log"
Sep 17 00:54:20.376182 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:20.376156    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2dzbh_7965b738-5588-4303-bf99-ac22c00d17ab/kube-rbac-proxy/0.log"
Sep 17 00:54:20.398322 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:20.398295    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2dzbh_7965b738-5588-4303-bf99-ac22c00d17ab/exporter/0.log"
Sep 17 00:54:20.419416 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:20.419388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2dzbh_7965b738-5588-4303-bf99-ac22c00d17ab/extractor/0.log"
Sep 17 00:54:22.807396 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:22.807364    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-d74xj/perf-node-gather-daemonset-hrblw"
Sep 17 00:54:22.839307 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:22.839268    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6f5bf55f6d-vngrx_e671f004-288b-44d3-b182-72f10dd4783d/manager/0.log"
Sep 17 00:54:23.061124 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:23.061040    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc689bf9d-k5fzq_cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6/manager/0.log"
Sep 17 00:54:23.082348 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:23.082320    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cc689bf9d-k5fzq_cc99e8b1-b00b-4f8b-8c66-843cc3cc4db6/copy-manifests/0.log"
Sep 17 00:54:24.471278 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:24.471204    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6685c7f5f5-z2nks_15562294-3ac8-4078-867b-89ab1d1da897/manager/0.log"
Sep 17 00:54:25.153360 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:25.153327    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f57c6d865-s8j24_d4e95bcf-4adf-4797-b46c-8cfe61ae12b5/kube-auth-proxy/0.log"
Sep 17 00:54:25.182441 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:25.182385    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pr7x5_16626e4d-960e-4f28-a622-96a0e93ebefa/istio-proxy/0.log"
Sep 17 00:54:25.184135 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:25.184105    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pr7x5_16626e4d-960e-4f28-a622-96a0e93ebefa/istio-proxy/1.log"
Sep 17 00:54:25.211434 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:25.211397    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-xg9bn_7d509778-e992-481b-8d0f-a7f012c044d8/payload-pre-processing/0.log"
Sep 17 00:54:27.665311 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:27.665253    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5f57c6d865-s8j24_d4e95bcf-4adf-4797-b46c-8cfe61ae12b5/kube-auth-proxy/0.log"
Sep 17 00:54:27.689026 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:27.688998    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pr7x5_16626e4d-960e-4f28-a622-96a0e93ebefa/istio-proxy/0.log"
Sep 17 00:54:27.689943 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:27.689922    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-pr7x5_16626e4d-960e-4f28-a622-96a0e93ebefa/istio-proxy/1.log"
Sep 17 00:54:27.722545 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:27.722519    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-xg9bn_7d509778-e992-481b-8d0f-a7f012c044d8/payload-pre-processing/0.log"
Sep 17 00:54:29.604374 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:29.604332    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-hvccs_ce1083b8-813d-4fc8-b5c4-25a48b661174/migrator/0.log"
Sep 17 00:54:29.624454 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:29.624430    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-hvccs_ce1083b8-813d-4fc8-b5c4-25a48b661174/graceful-termination/0.log"
Sep 17 00:54:30.938454 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:30.938427    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v566_79c3d307-c5ec-454d-ab28-c16840b8acef/kube-multus-additional-cni-plugins/0.log"
Sep 17 00:54:30.959650 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:30.959607    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v566_79c3d307-c5ec-454d-ab28-c16840b8acef/egress-router-binary-copy/0.log"
Sep 17 00:54:30.979117 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:30.979089    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v566_79c3d307-c5ec-454d-ab28-c16840b8acef/cni-plugins/0.log"
Sep 17 00:54:30.998103 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:30.998083    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v566_79c3d307-c5ec-454d-ab28-c16840b8acef/bond-cni-plugin/0.log"
Sep 17 00:54:31.017078 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:31.017055    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v566_79c3d307-c5ec-454d-ab28-c16840b8acef/routeoverride-cni/0.log"
Sep 17 00:54:31.035651 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:31.035621    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v566_79c3d307-c5ec-454d-ab28-c16840b8acef/whereabouts-cni-bincopy/0.log"
Sep 17 00:54:31.054728 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:31.054709    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8v566_79c3d307-c5ec-454d-ab28-c16840b8acef/whereabouts-cni/0.log"
Sep 17 00:54:31.387315 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:31.387286    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-cpqcg_d3cf7de5-498a-482d-b451-a55de2469bb3/kube-multus/0.log"
Sep 17 00:54:31.553114 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:31.553079    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8wnd2_ca6b8957-62ac-403c-a400-1b3c00462448/network-metrics-daemon/0.log"
Sep 17 00:54:31.589622 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:31.589577    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8wnd2_ca6b8957-62ac-403c-a400-1b3c00462448/kube-rbac-proxy/0.log"
Sep 17 00:54:32.896122 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:32.896051    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-controller/0.log"
Sep 17 00:54:32.912108 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:32.912081    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/1.log"
Sep 17 00:54:32.912262 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:32.912113    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovn-acl-logging/0.log"
Sep 17 00:54:32.932785 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:32.932727    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/kube-rbac-proxy-node/0.log"
Sep 17 00:54:32.954034 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:32.954012    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/kube-rbac-proxy-ovn-metrics/0.log"
Sep 17 00:54:32.970735 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:32.970703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/northd/0.log"
Sep 17 00:54:32.990629 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:32.990599    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/nbdb/0.log"
Sep 17 00:54:33.010103 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:33.010078    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/sbdb/0.log"
Sep 17 00:54:33.086686 ip-10-0-135-192 kubenswrapper[2565]: I0917 00:54:33.086650    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kn9vs_1c94c8d6-997a-47ee-a301-a3219e468b73/ovnkube-controller/0.log"