Sep 11 21:30:45.226768 ip-10-0-137-44 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 21:30:45.582404 ip-10-0-137-44 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:30:45.582404 ip-10-0-137-44 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 21:30:45.582404 ip-10-0-137-44 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:30:45.582404 ip-10-0-137-44 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 21:30:45.582404 ip-10-0-137-44 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 21:30:45.583517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.583427    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 21:30:45.586847 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586832    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:30:45.586847 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586846    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586849    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586852    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586855    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586858    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586861    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586863    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586866    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586869    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586871    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586874    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586876    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586878    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586882    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586885    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586887    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586890    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586894    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586898    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:30:45.586908 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586901    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586904    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586915    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586919    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586922    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586924    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586927    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586930    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586932    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586935    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586937    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586940    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586942    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586945    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586948    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586950    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586953    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586955    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586958    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586960    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586963    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:30:45.587355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586966    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586968    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586970    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586973    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586975    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586978    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586980    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586982    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586985    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586987    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586991    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586993    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.586995    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587000    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587004    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587007    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587010    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587012    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587015    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:30:45.587912 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587017    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587020    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587022    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587025    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587027    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587030    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587032    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587036    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587040    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587043    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587045    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587048    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587050    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587052    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587055    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587057    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587059    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587062    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587064    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587067    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:30:45.588376 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587069    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587072    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587074    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587077    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587079    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587081    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587085    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587088    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587090    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587093    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587095    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587098    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587100    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587102    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587105    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587108    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587110    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587113    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587115    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587797    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:30:45.588879 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587804    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587807    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587810    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587813    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587815    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587818    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587822    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587826    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587829    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587832    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587835    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587838    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587841    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587844    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587847    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587850    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587852    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587855    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587859    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:30:45.589355 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587862    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587866    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587869    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587873    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587875    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587878    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587881    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587884    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587887    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587891    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587894    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587897    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587900    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587902    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587905    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587908    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587910    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587913    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587916    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:30:45.589840 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587919    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587922    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587924    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587927    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587929    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587932    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587934    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587937    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587940    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587942    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587945    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587947    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587950    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587952    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587955    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587957    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587960    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587962    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587965    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587968    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:30:45.590310 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587970    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587972    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587975    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587977    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587979    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587982    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587984    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587987    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587989    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587992    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587994    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587997    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.587999    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588001    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588004    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588007    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588009    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588012    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588014    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588017    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:30:45.590864 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588020    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588022    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588025    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588027    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588030    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588033    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588036    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588038    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588040    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588043    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588045    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588048    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588050    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588052    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588055    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588057    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588060    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588062    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588064    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588067    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:30:45.591364 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588433    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588439    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588441    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588444    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588447    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588452    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588455    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588458    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588461    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588464    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588484    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588489    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588499    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588502    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588504    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588507    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588509    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588512    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588514    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588516    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:30:45.591863 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588519    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588521    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588523    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588526    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588528    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588530    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588533    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588535    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588537    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588540    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588542    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588544    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588547    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588549    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588551    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588555    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588558    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588561    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588563    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588566    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:30:45.592361 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588569    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588571    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588574    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588577    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588580    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588583    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588585    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588588    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588591    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588594    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588596    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588599    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588601    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588604    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588606    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588609    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588612    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588614    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588617    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588619    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:30:45.592870 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588621    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588624    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588626    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588629    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588631    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588633    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588636    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588638    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588641    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588643    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588646    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588648    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588651    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588654    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588657    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588659    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588662    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588664    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588667    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:30:45.593369 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588669    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588672    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588674    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588676    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588679    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588681    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588683    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588686    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588689    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588691    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588694    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588696    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588698    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588701    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588703    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588706    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588708    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588712    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588715    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.588718    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:30:45.593845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588783    2577 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588818    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588826    2577 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588830    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588834    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588838    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588842    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588850    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588853    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588856    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588860    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588863    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588867    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588870    2577 flags.go:64] FLAG: --cgroup-root=""
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588872    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588875    2577 flags.go:64] FLAG: --client-ca-file=""
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588878    2577 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588881    2577 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588885    2577 flags.go:64] FLAG: --cluster-domain=""
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588889    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588892    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588895    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588898    2577 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588901    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 21:30:45.594316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588904    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588907    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588911    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588914    2577 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588916    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588919    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588922    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588925    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588929    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588932    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588934    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588937    2577 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588940    2577 flags.go:64] FLAG: --enable-server="true"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588943    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588948    2577 flags.go:64] FLAG: --event-burst="100"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588953    2577 flags.go:64] FLAG: --event-qps="50"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588956    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588959    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588962    2577 flags.go:64] FLAG: --eviction-hard=""
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588965    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588968    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588971    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588974    2577 flags.go:64] FLAG: --eviction-soft=""
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588977    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588979    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 21:30:45.594925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588982    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588985    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588988    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588991    2577 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588993    2577 flags.go:64] FLAG: --feature-gates=""
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.588997    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589000    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589003    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589005    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589008    2577 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589011    2577 flags.go:64] FLAG: --help="false"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589014    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589017    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589020    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589023    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589026    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589029    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589032    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589035    2577 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589038    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589040    2577 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589043    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589047    2577 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589050    2577 flags.go:64] FLAG: --kube-reserved=""
Sep 11 21:30:45.595643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589053    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589056    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589058    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589062    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589065    2577 flags.go:64] FLAG: --lock-file=""
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589069    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589072    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589075    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589081    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589083    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589086    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589088    2577 flags.go:64] FLAG: --logging-format="text"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589091    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589094    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589097    2577 flags.go:64] FLAG: --manifest-url=""
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589100    2577 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589104    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589107    2577 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589111    2577 flags.go:64] FLAG: --max-pods="110"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589114    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589117    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589119    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589122    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589125    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589128    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 21:30:45.596231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589131    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589137    2577 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589140    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589143    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589146    2577 flags.go:64] FLAG: --pod-cidr=""
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589150    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589155    2577 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589158    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589161    2577 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589164    2577 flags.go:64] FLAG: --port="10250"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589168    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589171    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-085edee9ebb7a8ac9"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589174    2577 flags.go:64] FLAG: --qos-reserved=""
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589177    2577 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589181    2577 flags.go:64] FLAG: --register-node="true"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589184    2577 flags.go:64] FLAG: --register-with-taints=""
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589187    2577 flags.go:64] FLAG: --registry-burst="10"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589190    2577 flags.go:64] FLAG: --registry-qps="5"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589193    2577 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589196    2577 flags.go:64] FLAG: --reserved-memory=""
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589199    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589202    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589205    2577 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589208    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589210    2577 flags.go:64] FLAG: --runonce="false"
Sep 11 21:30:45.596848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589213    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589216    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589219    2577 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589221    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589224    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589227    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589230    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589233    2577 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589236    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589239    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589241    2577 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589244    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589247    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589251    2577 flags.go:64] FLAG: --system-cgroups=""
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589254    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589259    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589262    2577 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589266    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589270    2577 flags.go:64] FLAG: --tls-min-version=""
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589272    2577 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589275    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589278    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589281    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589284    2577 flags.go:64] FLAG: --v="2"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589288    2577 flags.go:64] FLAG: --version="false"
Sep 11 21:30:45.597455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589292    2577 flags.go:64] FLAG: --vmodule=""
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589295    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.589298    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589404    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589408    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589410    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589413    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589415    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589418    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589421    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589423    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589426    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589428    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589431    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589434    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589436    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589439    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589441    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589444    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589446    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:30:45.598061 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589450    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589452    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589455    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589458    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589461    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589464    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589480    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589483    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589485    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589488    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589491    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589494    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589497    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589501    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589504    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589507    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589510    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589513    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589515    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:30:45.598650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589518    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589520    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589523    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589525    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589528    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589530    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589533    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589535    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589538    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589541    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589543    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589546    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589548    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589552    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589554    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589557    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589559    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589563    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589565    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589568    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:30:45.599116 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589571    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589573    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589576    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589579    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589581    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589584    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589586    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589589    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589591    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589594    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589596    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589599    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589602    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589606    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589609    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589611    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589614    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589616    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589619    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589621    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:30:45.599623 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589623    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589626    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589628    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589631    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589633    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589637    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589639    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589642    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589644    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589649    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589653    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589655    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589658    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589661    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589663    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589665    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589668    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589671    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589673    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589676    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:30:45.600104 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589678    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589680    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.589683    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.590137    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.596884    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.596898    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.596917    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.596922    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.596973    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.596978    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.596981    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.596984    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.596988    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.596991    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:30:45.600613 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.596996    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.596999    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597001    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597004    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597007    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597010    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597013    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597017    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597020    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597023    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597025    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597028    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597031    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597033    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597036    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597039    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597041    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597044    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597046    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597049    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:30:45.600975 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597051    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597054    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597056    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597060    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597063    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597065    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597068    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597071    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597073    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597076    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597079    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597081    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597084    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597086    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597089    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597091    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597094    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597096    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597099    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:30:45.601458 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597101    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597104    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597106    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597109    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597111    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597113    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597116    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597118    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597120    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597123    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597125    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597128    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597130    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597132    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597135    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597137    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597141    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597144    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597146    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597149    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:30:45.601920 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597152    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597154    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597156    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597159    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597162    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597164    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597167    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597169    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597172    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597174    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597177    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597179    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597182    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597184    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597187    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597189    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597191    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597194    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597197    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597199    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:30:45.602402 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597202    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597204    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597206    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597209    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597211    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597213    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597216    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597218    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597221    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597224    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597228    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597232    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597235    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597238    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:30:45.603064 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.597243    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597347    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597351    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597354    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597357    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597359    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597362    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597365    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597367    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597370    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597373    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597375    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597378    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597380    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597382    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597385    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597387    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597390    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597392    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597395    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 21:30:45.603442 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597398    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597400    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597403    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597405    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597408    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597410    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597413    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597415    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597418    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597421    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597424    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597426    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597428    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597432    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597436    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597438    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597441    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597443    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597446    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 21:30:45.604275 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597449    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597451    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597454    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597456    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597459    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597461    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597464    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597485    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597492    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597496    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597500    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597502    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597505    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597507    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597510    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597512    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597515    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597517    2577 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597519    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597522    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 21:30:45.604963 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597525    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597527    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597529    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597533    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597535    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597538    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597540    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597543    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597545    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597547    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597550    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597552    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597554    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597557    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597559    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597562    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597564    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597567    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597569    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597571    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 21:30:45.605550 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597574    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597576    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597579    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597581    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597584    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597587    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597591    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597593    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597596    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597599    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597601    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597604    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597607    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597609    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597612    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597614    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597618    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597620    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597622    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597625    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 21:30:45.606058 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:45.597627    2577 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 21:30:45.606631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.597632    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 21:30:45.606631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.597738    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 21:30:45.606631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.600515    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 21:30:45.606631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.601185    2577 server.go:1019] "Starting client certificate rotation"
Sep 11 21:30:45.606631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.602570    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:30:45.606631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.602719    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 21:30:45.607134 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.607118    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:30:45.608277 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.608262    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 21:30:45.621029 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.621007    2577 log.go:25] "Validated CRI v1 runtime API"
Sep 11 21:30:45.624580 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.624565    2577 log.go:25] "Validated CRI v1 image API"
Sep 11 21:30:45.625418 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.625405    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 21:30:45.628766 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.628748    2577 fs.go:135] Filesystem UUIDs: map[3a8b5edc-5270-4d60-89b7-5d906e4e724b:/dev/nvme0n1p3 556b22b0-8193-45a8-ae34-42da0ac0e28e:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 11 21:30:45.628823 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.628767    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 21:30:45.633618 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.633518    2577 manager.go:216] Machine: {Timestamp:2026-09-11 21:30:45.633010126 +0000 UTC m=+0.290573882 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096910 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec249c36a261136398b7edaaa3b1160b SystemUUID:ec249c36-a261-1363-98b7-edaaa3b1160b BootID:28e87f9b-005a-4b7e-b93c-81bdde14fc00 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:72:08:d0:b8:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:72:08:d0:b8:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:ec:8f:5a:5d:a1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 21:30:45.633618 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.633613    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 21:30:45.633738 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.633685    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 21:30:45.634991 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.634977    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:30:45.636334 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.636302    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 21:30:45.636491 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.636338    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-44.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 21:30:45.637024 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.637012    2577 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 21:30:45.637024 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.637025    2577 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 21:30:45.637091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.637033    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:30:45.637551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.637540    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 21:30:45.638304 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.638296    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 21:30:45.643006 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.642994    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:30:45.643122 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.643112    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 21:30:45.643153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.643146    2577 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 21:30:45.643200 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.643159    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 21:30:45.643200 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.643185    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 21:30:45.643200 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.643199    2577 kubelet.go:398] "Adding apiserver pod source"
Sep 11 21:30:45.643308 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.643211    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 21:30:45.643529 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.643518    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:30:45.643576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.643536    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 21:30:45.645821 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.645788    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 21:30:45.648017 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.648001    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 21:30:45.648289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.648276    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 21:30:45.649630 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649617    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 21:30:45.649669 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649639    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 21:30:45.649669 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649648    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 21:30:45.649669 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649657    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 21:30:45.649669 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649668    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 21:30:45.649780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649673    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 21:30:45.649780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649686    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 21:30:45.649780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649691    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 21:30:45.649780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649698    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 21:30:45.649780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649703    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 21:30:45.649780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649711    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 21:30:45.649780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649716    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 21:30:45.649780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649738    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 21:30:45.649780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.649743    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 21:30:45.653070 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.653054    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-44.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 21:30:45.653250 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.653230    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 21:30:45.653540 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.653523    2577 server.go:1268] "Started kubelet"
Sep 11 21:30:45.653616 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.653564    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 21:30:45.653669 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.653617    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 21:30:45.653720 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.653671    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 21:30:45.653797 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.653775    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 21:30:45.654484 ip-10-0-137-44 systemd[1]: Started Kubernetes Kubelet.
Sep 11 21:30:45.655262 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.655228    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 21:30:45.655338 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.655325    2577 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 21:30:45.658598 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.657832    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-44.ec2.internal.18d4619541b76729  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-44.ec2.internal,UID:ip-10-0-137-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-44.ec2.internal,},FirstTimestamp:2026-09-11 21:30:45.653489449 +0000 UTC m=+0.311053205,LastTimestamp:2026-09-11 21:30:45.653489449 +0000 UTC m=+0.311053205,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-44.ec2.internal,}"
Sep 11 21:30:45.659639 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.659617    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 21:30:45.660133 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.660115    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 21:30:45.660284 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.660261    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:45.660367 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.660290    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 21:30:45.661035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661018    2577 factory.go:55] Registering systemd factory
Sep 11 21:30:45.661035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661037    2577 factory.go:223] Registration of the systemd container factory successfully
Sep 11 21:30:45.661229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661218    2577 factory.go:153] Registering CRI-O factory
Sep 11 21:30:45.661229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661230    2577 factory.go:223] Registration of the crio container factory successfully
Sep 11 21:30:45.661303 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661267    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 21:30:45.661303 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661281    2577 factory.go:103] Registering Raw factory
Sep 11 21:30:45.661303 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661290    2577 manager.go:1196] Started watching for new ooms in manager
Sep 11 21:30:45.661608 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661597    2577 manager.go:349] Starting recovery of all containers
Sep 11 21:30:45.661849 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661834    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 21:30:45.661902 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661855    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 21:30:45.661972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.661834    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 21:30:45.662031 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.662002    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 21:30:45.662086 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.662053    2577 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 21:30:45.662086 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.662060    2577 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 21:30:45.662175 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.662149    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 21:30:45.666720 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.666569    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2sjhl"
Sep 11 21:30:45.670539 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.670485    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 21:30:45.670960 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.670940    2577 manager.go:354] Recovery completed
Sep 11 21:30:45.674160 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.673049    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2sjhl"
Sep 11 21:30:45.677653 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.677637    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:30:45.679226 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.679210    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:30:45.679333 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.679242    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:30:45.679333 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.679257    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:30:45.679875 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.679860    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 21:30:45.679942 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.679876    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 21:30:45.679942 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.679891    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:30:45.680004 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.679893    2577 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 21:30:45.680556 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.680541    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:30:45.680617 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.680568    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:30:45.680617 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.680578    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:30:45.681931 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.681919    2577 policy_none.go:49] "None policy: Start"
Sep 11 21:30:45.681972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.681936    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 21:30:45.681972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.681946    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 21:30:45.683799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.683790    2577 policy_none.go:47] "Start"
Sep 11 21:30:45.719010 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.718997    2577 manager.go:337] "Starting Device Plugin manager"
Sep 11 21:30:45.738677 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.719035    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 21:30:45.738677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.719047    2577 server.go:87] "Starting device plugin registration server"
Sep 11 21:30:45.738677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.719331    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 21:30:45.738677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.719342    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 21:30:45.738677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.719456    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 21:30:45.738677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.719566    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 21:30:45.738677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.719575    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 21:30:45.738677 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.720025    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 21:30:45.738677 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.720074    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:45.753682 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.753662    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 21:30:45.753755 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.753705    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 21:30:45.753755 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.753722    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 21:30:45.753755 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.753752    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 21:30:45.756105 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.756086    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:30:45.820414 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.820395    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:30:45.821569 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.821555    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:30:45.821661 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.821586    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:30:45.821661 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.821600    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:30:45.821661 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.821631    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.837775 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.837722    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.837775 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.837740    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-44.ec2.internal\": node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:45.854665 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.854643    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal"]
Sep 11 21:30:45.854743 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.854703    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:30:45.855566 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.855554    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:30:45.855650 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.855586    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:30:45.855650 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.855596    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:30:45.857920 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.857908    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:30:45.858058 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.858032    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.858115 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.858080    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:30:45.858832 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.858818    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:30:45.858893 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.858832    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:30:45.858893 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.858861    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:30:45.858893 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.858872    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:30:45.858980 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.858861    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:30:45.858980 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.858936    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:30:45.861117 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.861102    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.861181 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.861125    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 21:30:45.861843 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.861829    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 21:30:45.861843 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.861848    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 21:30:45.861977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.861860    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeHasSufficientPID"
Sep 11 21:30:45.862349 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.862336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/76a1d0169b7ad52781e0506059c05051-config\") pod \"kube-apiserver-proxy-ip-10-0-137-44.ec2.internal\" (UID: \"76a1d0169b7ad52781e0506059c05051\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.862393 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.862355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/004931fdb00cf46c50fbe318b82e4417-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal\" (UID: \"004931fdb00cf46c50fbe318b82e4417\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.862393 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.862371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/004931fdb00cf46c50fbe318b82e4417-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal\" (UID: \"004931fdb00cf46c50fbe318b82e4417\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.876972 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.876954    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-44.ec2.internal\" not found" node="ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.879985 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.879971    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:45.880630 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.880616    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-44.ec2.internal\" not found" node="ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.962466 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.962441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/004931fdb00cf46c50fbe318b82e4417-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal\" (UID: \"004931fdb00cf46c50fbe318b82e4417\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.962466 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.962479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/004931fdb00cf46c50fbe318b82e4417-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal\" (UID: \"004931fdb00cf46c50fbe318b82e4417\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.962642 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.962497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/76a1d0169b7ad52781e0506059c05051-config\") pod \"kube-apiserver-proxy-ip-10-0-137-44.ec2.internal\" (UID: \"76a1d0169b7ad52781e0506059c05051\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.962642 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.962530    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/004931fdb00cf46c50fbe318b82e4417-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal\" (UID: \"004931fdb00cf46c50fbe318b82e4417\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.962642 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.962539    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/004931fdb00cf46c50fbe318b82e4417-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal\" (UID: \"004931fdb00cf46c50fbe318b82e4417\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.962642 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:45.962559    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/76a1d0169b7ad52781e0506059c05051-config\") pod \"kube-apiserver-proxy-ip-10-0-137-44.ec2.internal\" (UID: \"76a1d0169b7ad52781e0506059c05051\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:45.980493 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:45.980460    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.081139 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.081109    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.178955 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.178931    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:46.182070 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.182055    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.182772 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.182757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:46.282887 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.282860    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.383383 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.383364    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.484006 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.483951    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.584509 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.584484    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.601678 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.601654    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 21:30:46.601873 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.601844    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 21:30:46.648782 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.648761    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:30:46.678976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.678949    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 21:25:46 +0000 UTC" deadline="2028-04-23 23:59:06.296436365 +0000 UTC"
Sep 11 21:30:46.678976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.678973    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14162h28m19.617465956s"
Sep 11 21:30:46.685134 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.685115    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.699181 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:46.699154    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a1d0169b7ad52781e0506059c05051.slice/crio-43aede8fe057f8a4f35902b3a3183083d239fcff7a46719c540c76b1269fa29a WatchSource:0}: Error finding container 43aede8fe057f8a4f35902b3a3183083d239fcff7a46719c540c76b1269fa29a: Status 404 returned error can't find the container with id 43aede8fe057f8a4f35902b3a3183083d239fcff7a46719c540c76b1269fa29a
Sep 11 21:30:46.709751 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.709734    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:30:46.715047 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:46.715023    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod004931fdb00cf46c50fbe318b82e4417.slice/crio-ea3f603da560b5dd9f0a7569384ce703e40bc2e4b829c0e4383f042795528f7e WatchSource:0}: Error finding container ea3f603da560b5dd9f0a7569384ce703e40bc2e4b829c0e4383f042795528f7e: Status 404 returned error can't find the container with id ea3f603da560b5dd9f0a7569384ce703e40bc2e4b829c0e4383f042795528f7e
Sep 11 21:30:46.757779 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.757711    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal" event={"ID":"004931fdb00cf46c50fbe318b82e4417","Type":"ContainerStarted","Data":"ea3f603da560b5dd9f0a7569384ce703e40bc2e4b829c0e4383f042795528f7e"}
Sep 11 21:30:46.759421 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.759389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal" event={"ID":"76a1d0169b7ad52781e0506059c05051","Type":"ContainerStarted","Data":"43aede8fe057f8a4f35902b3a3183083d239fcff7a46719c540c76b1269fa29a"}
Sep 11 21:30:46.786176 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.786155    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.845827 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:46.845809    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:30:46.886810 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.886788    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:46.987338 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:46.987313    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-44.ec2.internal\" not found"
Sep 11 21:30:47.019106 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.019046    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:30:47.060905 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.060886    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:47.072530 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.072511    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:30:47.073394 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.073382    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal"
Sep 11 21:30:47.084880 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.084863    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 21:30:47.644765 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.644736    2577 apiserver.go:52] "Watching apiserver"
Sep 11 21:30:47.653486 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.653444    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 21:30:47.653863 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.653840    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-zx9jw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4","openshift-cluster-node-tuning-operator/tuned-q7dkl","openshift-dns/node-resolver-qk2kp","openshift-image-registry/node-ca-44hdm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal","openshift-multus/multus-additional-cni-plugins-wg5r2","openshift-multus/multus-hhbwv","openshift-network-diagnostics/network-check-target-fdwb9","kube-system/global-pull-secret-syncer-2njxc","kube-system/konnectivity-agent-kb4d7","kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal","openshift-multus/network-metrics-daemon-g59xd","openshift-network-operator/iptables-alerter-qx8t6"]
Sep 11 21:30:47.656695 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.656659    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.659030 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.659006    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:47.659173 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.659083    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:30:47.659778 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.659760    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 21:30:47.659886 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.659789    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 21:30:47.659947 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.659934    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 21:30:47.660196 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.660094    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rgmgg\""
Sep 11 21:30:47.660271 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.660253    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 21:30:47.660508 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.660490    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 21:30:47.660589 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.660520    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 21:30:47.664304 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.664273    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.664502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.664466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.666792 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.666772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.667174 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.667157    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 21:30:47.667480 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.667462    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sx64x\""
Sep 11 21:30:47.667588 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.667517    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 21:30:47.667588 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.667530    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rdv4w\""
Sep 11 21:30:47.669083 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.668819    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:30:47.669083 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.668822    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 21:30:47.670377 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.669714    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 21:30:47.670377 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.669741    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mdkhs\""
Sep 11 21:30:47.670377 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.669900    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 21:30:47.670377 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.669955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.670664 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.670529    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 21:30:47.672904 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.672666    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 21:30:47.672904 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.672861    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 21:30:47.673111 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.673091    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 21:30:47.673184 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.673132    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5j6pv\""
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.673376    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.673933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/260ab03b-1ce0-477b-976d-8da2806c4f3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.673971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vffd2\" (UniqueName: \"kubernetes.io/projected/1f74845e-8b42-43c4-add2-30f20239ae52-kube-api-access-vffd2\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a-tmp-dir\") pod \"node-resolver-qk2kp\" (UID: \"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a\") " pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674037    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-modprobe-d\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-sys\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674102    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/260ab03b-1ce0-477b-976d-8da2806c4f3d-system-cni-dir\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdvt2\" (UniqueName: \"kubernetes.io/projected/260ab03b-1ce0-477b-976d-8da2806c4f3d-kube-api-access-pdvt2\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-var-lib-kubelet\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f74845e-8b42-43c4-add2-30f20239ae52-etc-tuned\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/260ab03b-1ce0-477b-976d-8da2806c4f3d-cnibin\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674279    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-sysctl-conf\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f74845e-8b42-43c4-add2-30f20239ae52-tmp\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a-hosts-file\") pod \"node-resolver-qk2kp\" (UID: \"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a\") " pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.674413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674368    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/260ab03b-1ce0-477b-976d-8da2806c4f3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/260ab03b-1ce0-477b-976d-8da2806c4f3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-systemd\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-run\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674662    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmzx7\" (UniqueName: \"kubernetes.io/projected/9774a99e-8c66-47df-97b0-cc061be54f89-kube-api-access-zmzx7\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-sysctl-d\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.674759    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674781    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-host\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/260ab03b-1ce0-477b-976d-8da2806c4f3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-kubernetes\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68sg9\" (UniqueName: \"kubernetes.io/projected/df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a-kube-api-access-68sg9\") pod \"node-resolver-qk2kp\" (UID: \"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a\") " pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.674989    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-sysconfig\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.675263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.675040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-lib-modules\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.678397 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.678025    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.681304 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.680673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.681304 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.681226    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 21:30:47.683344 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.682590    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 21:30:47.683344 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.682661    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 21:30:47.683344 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.682687    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 21:30:47.683344 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.682737    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 21:30:47.683344 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.682590    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n2fcl\""
Sep 11 21:30:47.683344 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.682661    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 21:30:47.683977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.683467    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:47.683977 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.683540    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:30:47.684605 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.684584    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 21:30:47.684709 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.684624    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 21:30:47.684709 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.684594    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tbpbt\""
Sep 11 21:30:47.684872 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.684822    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 21:30:47.686647 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.686279    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:30:47.688817 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.688791    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.688997 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.688977    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 21:30:47.689201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.689185    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 21:30:47.689373 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.689266    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5s2gr\""
Sep 11 21:30:47.691735 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.691715    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 21:30:47.691735 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.691728    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fbdtq\""
Sep 11 21:30:47.701347 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.701322    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fwr5l"
Sep 11 21:30:47.710612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.710594    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fwr5l"
Sep 11 21:30:47.763639 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.763619    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 21:30:47.776143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-cnibin\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.776250 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-var-lib-cni-bin\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.776250 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776178    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-etc-kubernetes\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.776250 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/260ab03b-1ce0-477b-976d-8da2806c4f3d-system-cni-dir\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.776250 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-var-lib-kubelet\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.776468 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3776032-1324-41bb-85ae-d0811934523e-ovn-node-metrics-cert\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.776468 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776301    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/260ab03b-1ce0-477b-976d-8da2806c4f3d-system-cni-dir\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.776468 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776342    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5c7b2cc-2002-4017-abc7-48c1210d57d4-kubelet-config\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:47.776468 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-var-lib-kubelet\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.776468 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776405    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e75675d-b276-422e-a340-463e6d926733-agent-certs\") pod \"konnectivity-agent-kb4d7\" (UID: \"6e75675d-b276-422e-a340-463e6d926733\") " pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:30:47.776468 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776432    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-system-cni-dir\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.776468 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776458    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-run-netns\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-var-lib-kubelet\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/260ab03b-1ce0-477b-976d-8da2806c4f3d-cnibin\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776556    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-sysctl-conf\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776581    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a-hosts-file\") pod \"node-resolver-qk2kp\" (UID: \"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a\") " pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/260ab03b-1ce0-477b-976d-8da2806c4f3d-cnibin\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0203e501-dc3f-4bee-9548-4fceb0ff9093-host\") pod \"node-ca-44hdm\" (UID: \"0203e501-dc3f-4bee-9548-4fceb0ff9093\") " pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-slash\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-run-systemd\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/260ab03b-1ce0-477b-976d-8da2806c4f3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-etc-openvswitch\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-hostroot\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a-hosts-file\") pod \"node-resolver-qk2kp\" (UID: \"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a\") " pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmzx7\" (UniqueName: \"kubernetes.io/projected/9774a99e-8c66-47df-97b0-cc061be54f89-kube-api-access-zmzx7\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-sysctl-d\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgwzt\" (UniqueName: \"kubernetes.io/projected/24c653d7-9bfb-43a5-98c5-55cfce97e640-kube-api-access-jgwzt\") pod \"iptables-alerter-qx8t6\" (UID: \"24c653d7-9bfb-43a5-98c5-55cfce97e640\") " pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.776852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776845    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-var-lib-openvswitch\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-socket-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-registration-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-conf-dir\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776918    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-node-log\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776933    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3776032-1324-41bb-85ae-d0811934523e-ovnkube-config\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3776032-1324-41bb-85ae-d0811934523e-env-overrides\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5c7b2cc-2002-4017-abc7-48c1210d57d4-dbus\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-daemon-config\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777035    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-run-multus-certs\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-sysconfig\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777069    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-lib-modules\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24c653d7-9bfb-43a5-98c5-55cfce97e640-iptables-alerter-script\") pod \"iptables-alerter-qx8t6\" (UID: \"24c653d7-9bfb-43a5-98c5-55cfce97e640\") " pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777102    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vffd2\" (UniqueName: \"kubernetes.io/projected/1f74845e-8b42-43c4-add2-30f20239ae52-kube-api-access-vffd2\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.777652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a-tmp-dir\") pod \"node-resolver-qk2kp\" (UID: \"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a\") " pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777159    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-kubelet\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777174    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-device-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-run-k8s-cni-cncf-io\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777214    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-modprobe-d\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-sys\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777252    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-sys-fs\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdvt2\" (UniqueName: \"kubernetes.io/projected/260ab03b-1ce0-477b-976d-8da2806c4f3d-kube-api-access-pdvt2\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f74845e-8b42-43c4-add2-30f20239ae52-etc-tuned\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24c653d7-9bfb-43a5-98c5-55cfce97e640-host-slash\") pod \"iptables-alerter-qx8t6\" (UID: \"24c653d7-9bfb-43a5-98c5-55cfce97e640\") " pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42b92bc7-e348-4da7-a046-0e347ad0ceca-cni-binary-copy\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-socket-dir-parent\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777386    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-cni-bin\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f74845e-8b42-43c4-add2-30f20239ae52-tmp\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0203e501-dc3f-4bee-9548-4fceb0ff9093-serviceca\") pod \"node-ca-44hdm\" (UID: \"0203e501-dc3f-4bee-9548-4fceb0ff9093\") " pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777434    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4vsl\" (UniqueName: \"kubernetes.io/projected/42b92bc7-e348-4da7-a046-0e347ad0ceca-kube-api-access-x4vsl\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.778517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777460    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/260ab03b-1ce0-477b-976d-8da2806c4f3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-systemd\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-run\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777510    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5vsh\" (UniqueName: \"kubernetes.io/projected/0203e501-dc3f-4bee-9548-4fceb0ff9093-kube-api-access-b5vsh\") pod \"node-ca-44hdm\" (UID: \"0203e501-dc3f-4bee-9548-4fceb0ff9093\") " pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-systemd-units\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-run-ovn\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777624    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3776032-1324-41bb-85ae-d0811934523e-ovnkube-script-lib\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777666    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-host\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777669    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/260ab03b-1ce0-477b-976d-8da2806c4f3d-cni-binary-copy\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-run-netns\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/260ab03b-1ce0-477b-976d-8da2806c4f3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.776709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-sysctl-conf\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-kubernetes\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68sg9\" (UniqueName: \"kubernetes.io/projected/df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a-kube-api-access-68sg9\") pod \"node-resolver-qk2kp\" (UID: \"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a\") " pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777797    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-run-openvswitch\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.779252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777819    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-kubernetes\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw8hz\" (UniqueName: \"kubernetes.io/projected/6c3081af-2110-4bb0-843e-9b5444b561e6-kube-api-access-mw8hz\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.777916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-sysctl-d\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.778211    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a-tmp-dir\") pod \"node-resolver-qk2kp\" (UID: \"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a\") " pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.778354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-modprobe-d\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.778406    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-sys\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.778515    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.778569    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/260ab03b-1ce0-477b-976d-8da2806c4f3d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.778770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-var-lib-cni-multus\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.778806    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/260ab03b-1ce0-477b-976d-8da2806c4f3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/260ab03b-1ce0-477b-976d-8da2806c4f3d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/260ab03b-1ce0-477b-976d-8da2806c4f3d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-systemd\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-run\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-log-socket\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-cni-netd\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.779927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-cni-dir\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.780659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv9tm\" (UniqueName: \"kubernetes.io/projected/c3776032-1324-41bb-85ae-d0811934523e-kube-api-access-tv9tm\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.780659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.780659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e75675d-b276-422e-a340-463e6d926733-konnectivity-ca\") pod \"konnectivity-agent-kb4d7\" (UID: \"6e75675d-b276-422e-a340-463e6d926733\") " pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:30:47.780659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-host\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.780659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-etc-sysconfig\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.780659 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.779888    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:47.780659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.779933    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1f74845e-8b42-43c4-add2-30f20239ae52-lib-modules\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.780659 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.779971    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs podName:9774a99e-8c66-47df-97b0-cc061be54f89 nodeName:}" failed. No retries permitted until 2026-09-11 21:30:48.279937892 +0000 UTC m=+2.937501640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs") pod "network-metrics-daemon-g59xd" (UID: "9774a99e-8c66-47df-97b0-cc061be54f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:47.782580 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.782538    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1f74845e-8b42-43c4-add2-30f20239ae52-etc-tuned\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.782674 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.782584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1f74845e-8b42-43c4-add2-30f20239ae52-tmp\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.790937 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.790914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmzx7\" (UniqueName: \"kubernetes.io/projected/9774a99e-8c66-47df-97b0-cc061be54f89-kube-api-access-zmzx7\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:47.795526 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.795483    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68sg9\" (UniqueName: \"kubernetes.io/projected/df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a-kube-api-access-68sg9\") pod \"node-resolver-qk2kp\" (UID: \"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a\") " pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.795885 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.795863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdvt2\" (UniqueName: \"kubernetes.io/projected/260ab03b-1ce0-477b-976d-8da2806c4f3d-kube-api-access-pdvt2\") pod \"multus-additional-cni-plugins-wg5r2\" (UID: \"260ab03b-1ce0-477b-976d-8da2806c4f3d\") " pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.796111 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.796093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vffd2\" (UniqueName: \"kubernetes.io/projected/1f74845e-8b42-43c4-add2-30f20239ae52-kube-api-access-vffd2\") pod \"tuned-q7dkl\" (UID: \"1f74845e-8b42-43c4-add2-30f20239ae52\") " pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.880529 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880453    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-var-lib-cni-multus\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.880529 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880506    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-log-socket\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.880698 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-cni-netd\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.880698 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880590    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-var-lib-cni-multus\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.880698 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.880698 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-log-socket\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.880698 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-cni-netd\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-etc-selinux\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-cni-dir\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv9tm\" (UniqueName: \"kubernetes.io/projected/c3776032-1324-41bb-85ae-d0811934523e-kube-api-access-tv9tm\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880767    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e75675d-b276-422e-a340-463e6d926733-konnectivity-ca\") pod \"konnectivity-agent-kb4d7\" (UID: \"6e75675d-b276-422e-a340-463e6d926733\") " pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-cnibin\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-cni-dir\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880842    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-var-lib-cni-bin\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880866    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-etc-kubernetes\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-cnibin\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880896    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3776032-1324-41bb-85ae-d0811934523e-ovn-node-metrics-cert\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5c7b2cc-2002-4017-abc7-48c1210d57d4-kubelet-config\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:47.880944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e75675d-b276-422e-a340-463e6d926733-agent-certs\") pod \"konnectivity-agent-kb4d7\" (UID: \"6e75675d-b276-422e-a340-463e6d926733\") " pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-system-cni-dir\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.880994    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-run-netns\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-var-lib-kubelet\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0203e501-dc3f-4bee-9548-4fceb0ff9093-host\") pod \"node-ca-44hdm\" (UID: \"0203e501-dc3f-4bee-9548-4fceb0ff9093\") " pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-slash\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881117    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-run-systemd\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881111    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c5c7b2cc-2002-4017-abc7-48c1210d57d4-kubelet-config\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-etc-openvswitch\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-hostroot\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-var-lib-cni-bin\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgwzt\" (UniqueName: \"kubernetes.io/projected/24c653d7-9bfb-43a5-98c5-55cfce97e640-kube-api-access-jgwzt\") pod \"iptables-alerter-qx8t6\" (UID: \"24c653d7-9bfb-43a5-98c5-55cfce97e640\") " pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881235    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-var-lib-openvswitch\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-socket-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881290    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-registration-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881309    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6e75675d-b276-422e-a340-463e6d926733-konnectivity-ca\") pod \"konnectivity-agent-kb4d7\" (UID: \"6e75675d-b276-422e-a340-463e6d926733\") " pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-conf-dir\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881358    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-var-lib-openvswitch\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.881677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881369    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-node-log\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881395    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-etc-kubernetes\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3776032-1324-41bb-85ae-d0811934523e-ovnkube-config\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881447    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3776032-1324-41bb-85ae-d0811934523e-env-overrides\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5c7b2cc-2002-4017-abc7-48c1210d57d4-dbus\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881484    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-system-cni-dir\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881565    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-run-netns\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.881643    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881645    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-var-lib-kubelet\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.881697    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret podName:c5c7b2cc-2002-4017-abc7-48c1210d57d4 nodeName:}" failed. No retries permitted until 2026-09-11 21:30:48.381678509 +0000 UTC m=+3.039242269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret") pod "global-pull-secret-syncer-2njxc" (UID: "c5c7b2cc-2002-4017-abc7-48c1210d57d4") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0203e501-dc3f-4bee-9548-4fceb0ff9093-host\") pod \"node-ca-44hdm\" (UID: \"0203e501-dc3f-4bee-9548-4fceb0ff9093\") " pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-registration-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-slash\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-socket-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-conf-dir\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c5c7b2cc-2002-4017-abc7-48c1210d57d4-dbus\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:47.882523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881867    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-etc-openvswitch\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881896    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-node-log\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881913    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-hostroot\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-daemon-config\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.881973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-run-multus-certs\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24c653d7-9bfb-43a5-98c5-55cfce97e640-iptables-alerter-script\") pod \"iptables-alerter-qx8t6\" (UID: \"24c653d7-9bfb-43a5-98c5-55cfce97e640\") " pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-kubelet\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-device-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-run-k8s-cni-cncf-io\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-sys-fs\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24c653d7-9bfb-43a5-98c5-55cfce97e640-host-slash\") pod \"iptables-alerter-qx8t6\" (UID: \"24c653d7-9bfb-43a5-98c5-55cfce97e640\") " pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882226    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42b92bc7-e348-4da7-a046-0e347ad0ceca-cni-binary-copy\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-socket-dir-parent\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-cni-bin\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882302    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0203e501-dc3f-4bee-9548-4fceb0ff9093-serviceca\") pod \"node-ca-44hdm\" (UID: \"0203e501-dc3f-4bee-9548-4fceb0ff9093\") " pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.883378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882328    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4vsl\" (UniqueName: \"kubernetes.io/projected/42b92bc7-e348-4da7-a046-0e347ad0ceca-kube-api-access-x4vsl\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882332    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3776032-1324-41bb-85ae-d0811934523e-ovnkube-config\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882597    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-run-ovn-kubernetes\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882650    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-kubelet\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3776032-1324-41bb-85ae-d0811934523e-env-overrides\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882798    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-run-systemd\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882808    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-device-dir\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-run-k8s-cni-cncf-io\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6c3081af-2110-4bb0-843e-9b5444b561e6-sys-fs\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-cni-bin\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24c653d7-9bfb-43a5-98c5-55cfce97e640-host-slash\") pod \"iptables-alerter-qx8t6\" (UID: \"24c653d7-9bfb-43a5-98c5-55cfce97e640\") " pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882959    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-socket-dir-parent\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.882993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5vsh\" (UniqueName: \"kubernetes.io/projected/0203e501-dc3f-4bee-9548-4fceb0ff9093-kube-api-access-b5vsh\") pod \"node-ca-44hdm\" (UID: \"0203e501-dc3f-4bee-9548-4fceb0ff9093\") " pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-systemd-units\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-run-ovn\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.884143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3776032-1324-41bb-85ae-d0811934523e-ovnkube-script-lib\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-run-netns\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42b92bc7-e348-4da7-a046-0e347ad0ceca-cni-binary-copy\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-run-openvswitch\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw8hz\" (UniqueName: \"kubernetes.io/projected/6c3081af-2110-4bb0-843e-9b5444b561e6-kube-api-access-mw8hz\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24c653d7-9bfb-43a5-98c5-55cfce97e640-iptables-alerter-script\") pod \"iptables-alerter-qx8t6\" (UID: \"24c653d7-9bfb-43a5-98c5-55cfce97e640\") " pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883482    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0203e501-dc3f-4bee-9548-4fceb0ff9093-serviceca\") pod \"node-ca-44hdm\" (UID: \"0203e501-dc3f-4bee-9548-4fceb0ff9093\") " pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883531    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/42b92bc7-e348-4da7-a046-0e347ad0ceca-host-run-multus-certs\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-run-ovn\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883631    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-systemd-units\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883690    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/42b92bc7-e348-4da7-a046-0e347ad0ceca-multus-daemon-config\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883687    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-host-run-netns\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.883739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3776032-1324-41bb-85ae-d0811934523e-run-openvswitch\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.884258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3776032-1324-41bb-85ae-d0811934523e-ovnkube-script-lib\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.884532    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3776032-1324-41bb-85ae-d0811934523e-ovn-node-metrics-cert\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.885077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.885062    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6e75675d-b276-422e-a340-463e6d926733-agent-certs\") pod \"konnectivity-agent-kb4d7\" (UID: \"6e75675d-b276-422e-a340-463e6d926733\") " pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:30:47.891771 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.891752    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:30:47.891771 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.891777    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:30:47.891771 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.891787    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p9mtz for pod openshift-network-diagnostics/network-check-target-fdwb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:47.892006 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:47.891837    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz podName:96c2bbfa-865c-498d-9133-ad725c18b7bf nodeName:}" failed. No retries permitted until 2026-09-11 21:30:48.391824488 +0000 UTC m=+3.049388232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p9mtz" (UniqueName: "kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz") pod "network-check-target-fdwb9" (UID: "96c2bbfa-865c-498d-9133-ad725c18b7bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:47.892006 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.891753    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgwzt\" (UniqueName: \"kubernetes.io/projected/24c653d7-9bfb-43a5-98c5-55cfce97e640-kube-api-access-jgwzt\") pod \"iptables-alerter-qx8t6\" (UID: \"24c653d7-9bfb-43a5-98c5-55cfce97e640\") " pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:47.893573 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.893548    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv9tm\" (UniqueName: \"kubernetes.io/projected/c3776032-1324-41bb-85ae-d0811934523e-kube-api-access-tv9tm\") pod \"ovnkube-node-zx9jw\" (UID: \"c3776032-1324-41bb-85ae-d0811934523e\") " pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:47.894173 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.894149    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw8hz\" (UniqueName: \"kubernetes.io/projected/6c3081af-2110-4bb0-843e-9b5444b561e6-kube-api-access-mw8hz\") pod \"aws-ebs-csi-driver-node-97sn4\" (UID: \"6c3081af-2110-4bb0-843e-9b5444b561e6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:47.895247 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.895226    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4vsl\" (UniqueName: \"kubernetes.io/projected/42b92bc7-e348-4da7-a046-0e347ad0ceca-kube-api-access-x4vsl\") pod \"multus-hhbwv\" (UID: \"42b92bc7-e348-4da7-a046-0e347ad0ceca\") " pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:47.896635 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.896616    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5vsh\" (UniqueName: \"kubernetes.io/projected/0203e501-dc3f-4bee-9548-4fceb0ff9093-kube-api-access-b5vsh\") pod \"node-ca-44hdm\" (UID: \"0203e501-dc3f-4bee-9548-4fceb0ff9093\") " pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:47.925644 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.925617    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 21:30:47.972365 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.972320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wg5r2"
Sep 11 21:30:47.981517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.981466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q7dkl"
Sep 11 21:30:47.990379 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.990363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qk2kp"
Sep 11 21:30:47.996981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:47.996956    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-44hdm"
Sep 11 21:30:48.005071 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.005055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qx8t6"
Sep 11 21:30:48.011921 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.011716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:30:48.018641 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.018623    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4"
Sep 11 21:30:48.026412 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.026393    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:30:48.035258 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.035236    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hhbwv"
Sep 11 21:30:48.286314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.286275    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:48.286529 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:48.286457    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:48.286587 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:48.286557    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs podName:9774a99e-8c66-47df-97b0-cc061be54f89 nodeName:}" failed. No retries permitted until 2026-09-11 21:30:49.286535062 +0000 UTC m=+3.944098811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs") pod "network-metrics-daemon-g59xd" (UID: "9774a99e-8c66-47df-97b0-cc061be54f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:48.386702 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.386659    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:48.386874 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:48.386845    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:48.386956 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:48.386924    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret podName:c5c7b2cc-2002-4017-abc7-48c1210d57d4 nodeName:}" failed. No retries permitted until 2026-09-11 21:30:49.386902865 +0000 UTC m=+4.044466635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret") pod "global-pull-secret-syncer-2njxc" (UID: "c5c7b2cc-2002-4017-abc7-48c1210d57d4") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:48.487640 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.487609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:48.487837 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:48.487813    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:30:48.487895 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:48.487850    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:30:48.487895 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:48.487866    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p9mtz for pod openshift-network-diagnostics/network-check-target-fdwb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:48.487962 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:48.487938    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz podName:96c2bbfa-865c-498d-9133-ad725c18b7bf nodeName:}" failed. No retries permitted until 2026-09-11 21:30:49.487918116 +0000 UTC m=+4.145481863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9mtz" (UniqueName: "kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz") pod "network-check-target-fdwb9" (UID: "96c2bbfa-865c-498d-9133-ad725c18b7bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:48.714558 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.714495    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:25:48 +0000 UTC" deadline="2028-02-28 18:07:11.551273774 +0000 UTC"
Sep 11 21:30:48.714558 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.714549    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12836h36m22.83672803s"
Sep 11 21:30:48.755012 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:48.754984    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:48.755153 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:48.755091    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:30:48.778854 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:48.778822    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260ab03b_1ce0_477b_976d_8da2806c4f3d.slice/crio-e3c265d01b91becc1ae5b0465d30fd9a51d8aef2dd60c4fa276f92cc5739ba0d WatchSource:0}: Error finding container e3c265d01b91becc1ae5b0465d30fd9a51d8aef2dd60c4fa276f92cc5739ba0d: Status 404 returned error can't find the container with id e3c265d01b91becc1ae5b0465d30fd9a51d8aef2dd60c4fa276f92cc5739ba0d
Sep 11 21:30:48.806281 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:48.806132    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf3c63c2_3ae5_4590_b4b3_4dd8d0711c6a.slice/crio-2c12cbfb7afa2801df1d16d0d2066cb2a76d2b039232f46f3690eb4290e3af73 WatchSource:0}: Error finding container 2c12cbfb7afa2801df1d16d0d2066cb2a76d2b039232f46f3690eb4290e3af73: Status 404 returned error can't find the container with id 2c12cbfb7afa2801df1d16d0d2066cb2a76d2b039232f46f3690eb4290e3af73
Sep 11 21:30:48.807721 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:48.807580    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3081af_2110_4bb0_843e_9b5444b561e6.slice/crio-f1ea42cbcaf84bfdbfc36b65874fca503b82fd5e0996d675718a3fb714c7e9fd WatchSource:0}: Error finding container f1ea42cbcaf84bfdbfc36b65874fca503b82fd5e0996d675718a3fb714c7e9fd: Status 404 returned error can't find the container with id f1ea42cbcaf84bfdbfc36b65874fca503b82fd5e0996d675718a3fb714c7e9fd
Sep 11 21:30:48.808447 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:48.808407    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f74845e_8b42_43c4_add2_30f20239ae52.slice/crio-d4938764c9fdd95b705a9239758b670707ed7a80b74e2d9786c83ea96d004e64 WatchSource:0}: Error finding container d4938764c9fdd95b705a9239758b670707ed7a80b74e2d9786c83ea96d004e64: Status 404 returned error can't find the container with id d4938764c9fdd95b705a9239758b670707ed7a80b74e2d9786c83ea96d004e64
Sep 11 21:30:48.809383 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:48.809271    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0203e501_dc3f_4bee_9548_4fceb0ff9093.slice/crio-bd39d0b61a0c52a8d945a6fefbd34a80df844551230527db04079505c8842d0c WatchSource:0}: Error finding container bd39d0b61a0c52a8d945a6fefbd34a80df844551230527db04079505c8842d0c: Status 404 returned error can't find the container with id bd39d0b61a0c52a8d945a6fefbd34a80df844551230527db04079505c8842d0c
Sep 11 21:30:48.811389 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:48.810446    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e75675d_b276_422e_a340_463e6d926733.slice/crio-1078d19ad5badff8ae61cfb3dd4cad092babcdc4f224ce8b0e829d0ec31b1d7c WatchSource:0}: Error finding container 1078d19ad5badff8ae61cfb3dd4cad092babcdc4f224ce8b0e829d0ec31b1d7c: Status 404 returned error can't find the container with id 1078d19ad5badff8ae61cfb3dd4cad092babcdc4f224ce8b0e829d0ec31b1d7c
Sep 11 21:30:48.811389 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:48.810965    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c653d7_9bfb_43a5_98c5_55cfce97e640.slice/crio-de604449dd1bbf4b1c0ae4242507b8d111ae201b1c1618bda7c6ef30d2249cf0 WatchSource:0}: Error finding container de604449dd1bbf4b1c0ae4242507b8d111ae201b1c1618bda7c6ef30d2249cf0: Status 404 returned error can't find the container with id de604449dd1bbf4b1c0ae4242507b8d111ae201b1c1618bda7c6ef30d2249cf0
Sep 11 21:30:48.811732 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:48.811712    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3776032_1324_41bb_85ae_d0811934523e.slice/crio-011be98a77f3637794a4aca5b397f1f8a5ed258a622e210d98faaf0d2851d330 WatchSource:0}: Error finding container 011be98a77f3637794a4aca5b397f1f8a5ed258a622e210d98faaf0d2851d330: Status 404 returned error can't find the container with id 011be98a77f3637794a4aca5b397f1f8a5ed258a622e210d98faaf0d2851d330
Sep 11 21:30:48.812573 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:30:48.812552    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b92bc7_e348_4da7_a046_0e347ad0ceca.slice/crio-2c42d7e0da36ed6a5e2e1806899395726c97b229d932eb0e441cd6cfd2bb7e47 WatchSource:0}: Error finding container 2c42d7e0da36ed6a5e2e1806899395726c97b229d932eb0e441cd6cfd2bb7e47: Status 404 returned error can't find the container with id 2c42d7e0da36ed6a5e2e1806899395726c97b229d932eb0e441cd6cfd2bb7e47
Sep 11 21:30:49.293873 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.293790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:49.294048 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.293980    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:49.294114 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.294066    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs podName:9774a99e-8c66-47df-97b0-cc061be54f89 nodeName:}" failed. No retries permitted until 2026-09-11 21:30:51.294040075 +0000 UTC m=+5.951603835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs") pod "network-metrics-daemon-g59xd" (UID: "9774a99e-8c66-47df-97b0-cc061be54f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:49.395006 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.394955    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:49.395180 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.395126    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:49.395256 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.395193    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret podName:c5c7b2cc-2002-4017-abc7-48c1210d57d4 nodeName:}" failed. No retries permitted until 2026-09-11 21:30:51.395174481 +0000 UTC m=+6.052738240 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret") pod "global-pull-secret-syncer-2njxc" (UID: "c5c7b2cc-2002-4017-abc7-48c1210d57d4") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:49.496123 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.496075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:49.496303 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.496258    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:30:49.496303 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.496285    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:30:49.496303 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.496299    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p9mtz for pod openshift-network-diagnostics/network-check-target-fdwb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:49.496473 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.496362    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz podName:96c2bbfa-865c-498d-9133-ad725c18b7bf nodeName:}" failed. No retries permitted until 2026-09-11 21:30:51.496340385 +0000 UTC m=+6.153904134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9mtz" (UniqueName: "kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz") pod "network-check-target-fdwb9" (UID: "96c2bbfa-865c-498d-9133-ad725c18b7bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:49.715611 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.715540    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 21:25:48 +0000 UTC" deadline="2028-05-18 15:12:09.444224793 +0000 UTC"
Sep 11 21:30:49.715611 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.715586    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14753h41m19.728643804s"
Sep 11 21:30:49.757130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.757098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:49.757327 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.757242    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:30:49.758026 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.757961    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:49.758127 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:49.758065    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:30:49.783612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.783523    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhbwv" event={"ID":"42b92bc7-e348-4da7-a046-0e347ad0ceca","Type":"ContainerStarted","Data":"2c42d7e0da36ed6a5e2e1806899395726c97b229d932eb0e441cd6cfd2bb7e47"}
Sep 11 21:30:49.800151 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.800020    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" event={"ID":"c3776032-1324-41bb-85ae-d0811934523e","Type":"ContainerStarted","Data":"011be98a77f3637794a4aca5b397f1f8a5ed258a622e210d98faaf0d2851d330"}
Sep 11 21:30:49.807787 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.807684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qx8t6" event={"ID":"24c653d7-9bfb-43a5-98c5-55cfce97e640","Type":"ContainerStarted","Data":"de604449dd1bbf4b1c0ae4242507b8d111ae201b1c1618bda7c6ef30d2249cf0"}
Sep 11 21:30:49.818216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.818175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kb4d7" event={"ID":"6e75675d-b276-422e-a340-463e6d926733","Type":"ContainerStarted","Data":"1078d19ad5badff8ae61cfb3dd4cad092babcdc4f224ce8b0e829d0ec31b1d7c"}
Sep 11 21:30:49.835022 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.834521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44hdm" event={"ID":"0203e501-dc3f-4bee-9548-4fceb0ff9093","Type":"ContainerStarted","Data":"bd39d0b61a0c52a8d945a6fefbd34a80df844551230527db04079505c8842d0c"}
Sep 11 21:30:49.837626 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.837594    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qk2kp" event={"ID":"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a","Type":"ContainerStarted","Data":"2c12cbfb7afa2801df1d16d0d2066cb2a76d2b039232f46f3690eb4290e3af73"}
Sep 11 21:30:49.851224 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.851180    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal" event={"ID":"76a1d0169b7ad52781e0506059c05051","Type":"ContainerStarted","Data":"defb2c519f2005f4011d8ae76df300987319409c3597c0441ab68087050cb925"}
Sep 11 21:30:49.865792 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.865713    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q7dkl" event={"ID":"1f74845e-8b42-43c4-add2-30f20239ae52","Type":"ContainerStarted","Data":"d4938764c9fdd95b705a9239758b670707ed7a80b74e2d9786c83ea96d004e64"}
Sep 11 21:30:49.872590 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.872501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" event={"ID":"260ab03b-1ce0-477b-976d-8da2806c4f3d","Type":"ContainerStarted","Data":"e3c265d01b91becc1ae5b0465d30fd9a51d8aef2dd60c4fa276f92cc5739ba0d"}
Sep 11 21:30:49.873930 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.873229    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-44.ec2.internal" podStartSLOduration=2.873210993 podStartE2EDuration="2.873210993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:49.872651492 +0000 UTC m=+4.530215264" watchObservedRunningTime="2026-09-11 21:30:49.873210993 +0000 UTC m=+4.530774764"
Sep 11 21:30:49.890613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.890569    2577 generic.go:356] "Generic (PLEG): container finished" podID="004931fdb00cf46c50fbe318b82e4417" containerID="6af292f648ca23c350d8ec2f2aac48b4841f23c264996e0114e2b672e9cbb3c4" exitCode=0
Sep 11 21:30:49.890772 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.890656    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal" event={"ID":"004931fdb00cf46c50fbe318b82e4417","Type":"ContainerDied","Data":"6af292f648ca23c350d8ec2f2aac48b4841f23c264996e0114e2b672e9cbb3c4"}
Sep 11 21:30:49.897602 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:49.897567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4" event={"ID":"6c3081af-2110-4bb0-843e-9b5444b561e6","Type":"ContainerStarted","Data":"f1ea42cbcaf84bfdbfc36b65874fca503b82fd5e0996d675718a3fb714c7e9fd"}
Sep 11 21:30:50.754824 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:50.754792    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:50.755488 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:50.754937    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:30:50.925446 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:50.925406    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal" event={"ID":"004931fdb00cf46c50fbe318b82e4417","Type":"ContainerStarted","Data":"221569e4ad403e0d6718121f01a46306629636e2dd2830af1082bf70c73bed47"}
Sep 11 21:30:50.951042 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:50.950196    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-44.ec2.internal" podStartSLOduration=3.9501765989999997 podStartE2EDuration="3.950176599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:30:50.944521843 +0000 UTC m=+5.602085612" watchObservedRunningTime="2026-09-11 21:30:50.950176599 +0000 UTC m=+5.607740371"
Sep 11 21:30:51.314256 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:51.314219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:51.314451 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.314366    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:51.314451 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.314433    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs podName:9774a99e-8c66-47df-97b0-cc061be54f89 nodeName:}" failed. No retries permitted until 2026-09-11 21:30:55.314411003 +0000 UTC m=+9.971974762 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs") pod "network-metrics-daemon-g59xd" (UID: "9774a99e-8c66-47df-97b0-cc061be54f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:51.415334 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:51.415296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:51.415540 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.415517    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:51.415640 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.415584    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret podName:c5c7b2cc-2002-4017-abc7-48c1210d57d4 nodeName:}" failed. No retries permitted until 2026-09-11 21:30:55.415565031 +0000 UTC m=+10.073128791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret") pod "global-pull-secret-syncer-2njxc" (UID: "c5c7b2cc-2002-4017-abc7-48c1210d57d4") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:51.516765 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:51.516728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:51.517035 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.516984    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:30:51.517035 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.517011    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:30:51.517035 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.517024    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p9mtz for pod openshift-network-diagnostics/network-check-target-fdwb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:51.517260 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.517086    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz podName:96c2bbfa-865c-498d-9133-ad725c18b7bf nodeName:}" failed. No retries permitted until 2026-09-11 21:30:55.51706614 +0000 UTC m=+10.174629902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9mtz" (UniqueName: "kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz") pod "network-check-target-fdwb9" (UID: "96c2bbfa-865c-498d-9133-ad725c18b7bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:51.755121 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:51.754596    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:51.755121 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.754734    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:30:51.757581 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:51.755865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:51.757581 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:51.755977    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:30:52.754495 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:52.754461    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:52.754684 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:52.754633    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:30:53.759081 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:53.759040    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:53.759574 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:53.759287    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:30:53.759974 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:53.759944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:53.760120 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:53.760099    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:30:54.754444 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:54.754401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:54.754644 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:54.754550    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:30:55.347996 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:55.347958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:55.348453 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.348075    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:55.348453 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.348122    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs podName:9774a99e-8c66-47df-97b0-cc061be54f89 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:03.348110152 +0000 UTC m=+18.005673897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs") pod "network-metrics-daemon-g59xd" (UID: "9774a99e-8c66-47df-97b0-cc061be54f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:30:55.449362 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:55.449323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:55.449557 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.449503    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:55.449635 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.449572    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret podName:c5c7b2cc-2002-4017-abc7-48c1210d57d4 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:03.449551393 +0000 UTC m=+18.107115154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret") pod "global-pull-secret-syncer-2njxc" (UID: "c5c7b2cc-2002-4017-abc7-48c1210d57d4") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:30:55.550166 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:55.550131    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:55.550328 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.550286    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:30:55.550328 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.550303    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:30:55.550328 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.550317    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p9mtz for pod openshift-network-diagnostics/network-check-target-fdwb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:55.550487 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.550362    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz podName:96c2bbfa-865c-498d-9133-ad725c18b7bf nodeName:}" failed. No retries permitted until 2026-09-11 21:31:03.550349149 +0000 UTC m=+18.207912892 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9mtz" (UniqueName: "kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz") pod "network-check-target-fdwb9" (UID: "96c2bbfa-865c-498d-9133-ad725c18b7bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:30:55.756269 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:55.756241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:55.756411 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.756329    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:30:55.756699 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:55.756681    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:55.756814 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:55.756789    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:30:56.755012 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:56.754573    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:56.755012 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:56.754717    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:30:57.756463 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:57.756433    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:57.756946 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:57.756565    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:30:57.757041 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:57.756951    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:57.757091 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:57.757043    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:30:58.754900 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:58.754863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:30:58.755049 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:58.754974    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:30:59.754943 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:59.754898    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:30:59.755434 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:59.755034    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:30:59.755434 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:30:59.755079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:30:59.755434 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:30:59.755187    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:00.754286 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:00.754110    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:00.754457 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:00.754386    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:01.756394 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:01.756354    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:01.756852 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:01.756513    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:01.756924 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:01.756878    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:01.756983 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:01.756960    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:02.754907 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:02.754877    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:02.755157 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:02.755003    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:03.402925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:03.402892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:03.403380 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.402996    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:31:03.403380 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.403051    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs podName:9774a99e-8c66-47df-97b0-cc061be54f89 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:19.403033101 +0000 UTC m=+34.060596856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs") pod "network-metrics-daemon-g59xd" (UID: "9774a99e-8c66-47df-97b0-cc061be54f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:31:03.503931 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:03.503897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:03.504082 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.504038    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:31:03.504122 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.504094    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret podName:c5c7b2cc-2002-4017-abc7-48c1210d57d4 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:19.504079799 +0000 UTC m=+34.161643545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret") pod "global-pull-secret-syncer-2njxc" (UID: "c5c7b2cc-2002-4017-abc7-48c1210d57d4") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:31:03.604825 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:03.604795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:03.605014 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.604992    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:31:03.605057 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.605025    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:31:03.605057 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.605040    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p9mtz for pod openshift-network-diagnostics/network-check-target-fdwb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:31:03.605119 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.605104    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz podName:96c2bbfa-865c-498d-9133-ad725c18b7bf nodeName:}" failed. No retries permitted until 2026-09-11 21:31:19.605084765 +0000 UTC m=+34.262648526 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9mtz" (UniqueName: "kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz") pod "network-check-target-fdwb9" (UID: "96c2bbfa-865c-498d-9133-ad725c18b7bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:31:03.754979 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:03.754926    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:03.755138 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.755045    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:03.755138 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:03.755109    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:03.755265 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:03.755217    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:04.754211 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:04.754181    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:04.754627 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:04.754309    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:05.754765 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:05.754738    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:05.755198 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:05.754841    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:05.755198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:05.754920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:05.755198 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:05.755017    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:06.754154 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:06.754108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:06.754310 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:06.754266    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:07.754345 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.754178    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:07.755063 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.754242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:07.755063 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:07.754418    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:07.755063 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:07.754517    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:07.971269 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.971234    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kb4d7" event={"ID":"6e75675d-b276-422e-a340-463e6d926733","Type":"ContainerStarted","Data":"9b2a968da4bfc851940612e0b62a4f8c5abc23a846bfb46668bb34ecc7079fd0"}
Sep 11 21:31:07.972841 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.972813    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-44hdm" event={"ID":"0203e501-dc3f-4bee-9548-4fceb0ff9093","Type":"ContainerStarted","Data":"2127e23f24e68de9ae6b3f25dec071c30bd5c7627e7897e215f1dfe0c2636180"}
Sep 11 21:31:07.974378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.974354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qk2kp" event={"ID":"df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a","Type":"ContainerStarted","Data":"31d8da9515ee2a1cc4c9823bc3bc68b1a144ad6db5cc3a5d29be06d3781a315b"}
Sep 11 21:31:07.975830 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.975810    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q7dkl" event={"ID":"1f74845e-8b42-43c4-add2-30f20239ae52","Type":"ContainerStarted","Data":"7c889009f0927a333a51df76e86c8bb0f5446b77786c08a5ef52ca91af74b547"}
Sep 11 21:31:07.977311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.977290    2577 generic.go:356] "Generic (PLEG): container finished" podID="260ab03b-1ce0-477b-976d-8da2806c4f3d" containerID="6fd8422fc475dbce6fac8f1d38a7adbf1eb5e58921fa64e46eabea054abbb257" exitCode=0
Sep 11 21:31:07.977396 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.977353    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" event={"ID":"260ab03b-1ce0-477b-976d-8da2806c4f3d","Type":"ContainerDied","Data":"6fd8422fc475dbce6fac8f1d38a7adbf1eb5e58921fa64e46eabea054abbb257"}
Sep 11 21:31:07.979075 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.979041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4" event={"ID":"6c3081af-2110-4bb0-843e-9b5444b561e6","Type":"ContainerStarted","Data":"1561ced0d4226c859b7c78dd75cb4a00da758948b711d0280f9f64ec464d6b1e"}
Sep 11 21:31:07.980732 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.980707    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hhbwv" event={"ID":"42b92bc7-e348-4da7-a046-0e347ad0ceca","Type":"ContainerStarted","Data":"58e3156cceb836c18e36ae68d34f96b94000df07ae91aea8a8c49bfe637b5120"}
Sep 11 21:31:07.986835 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.986810    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" event={"ID":"c3776032-1324-41bb-85ae-d0811934523e","Type":"ContainerStarted","Data":"e8dda6378d573de284700adf682b0228c7b2b97be16791d164e1cb58f9f1ad8b"}
Sep 11 21:31:07.986932 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.986896    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" event={"ID":"c3776032-1324-41bb-85ae-d0811934523e","Type":"ContainerStarted","Data":"57ca747eeb0175f9e8c8c05bfcdd346d9854cfdd70a990ee46bc51257878e9a6"}
Sep 11 21:31:07.986993 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.986957    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" event={"ID":"c3776032-1324-41bb-85ae-d0811934523e","Type":"ContainerStarted","Data":"23cf98079646adf5fd5ea71811e9d4cc5e8f3d1348dfd86b31adddd7e9f8e8d2"}
Sep 11 21:31:07.987044 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.987011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" event={"ID":"c3776032-1324-41bb-85ae-d0811934523e","Type":"ContainerStarted","Data":"51aff0fd9e0c1ce7475c01c9b2adfceb8fcf6dbe96628318126be3ac3e345066"}
Sep 11 21:31:07.987093 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.987062    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" event={"ID":"c3776032-1324-41bb-85ae-d0811934523e","Type":"ContainerStarted","Data":"107118349e44fc13f65052f7a6e807b5ad30ff9a8920f9feee61c93678cc1669"}
Sep 11 21:31:07.987143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.987114    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" event={"ID":"c3776032-1324-41bb-85ae-d0811934523e","Type":"ContainerStarted","Data":"c3ae4991288a1a93ab26862bfa9c678a886b4e6442c26f8cb26a5da085de733a"}
Sep 11 21:31:07.987338 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:07.987300    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kb4d7" podStartSLOduration=3.496290292 podStartE2EDuration="21.987287428s" totalImagesPullingTime="18.490997136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:07.98674479 +0000 UTC m=+22.644308555" watchObservedRunningTime="2026-09-11 21:31:07.987287428 +0000 UTC m=+22.644851188"
Sep 11 21:31:08.007819 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:08.007780    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q7dkl" podStartSLOduration=3.5142123229999997 podStartE2EDuration="22.007763453s" totalImagesPullingTime="18.49355113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:08.007432098 +0000 UTC m=+22.664995861" watchObservedRunningTime="2026-09-11 21:31:08.007763453 +0000 UTC m=+22.665327219"
Sep 11 21:31:08.037459 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:08.037415    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qk2kp" podStartSLOduration=3.525688846 podStartE2EDuration="22.037400636s" totalImagesPullingTime="18.51171179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:08.021875164 +0000 UTC m=+22.679438930" watchObservedRunningTime="2026-09-11 21:31:08.037400636 +0000 UTC m=+22.694964407"
Sep 11 21:31:08.037626 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:08.037529    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-44hdm" podStartSLOduration=3.537138925 podStartE2EDuration="22.037520375s" totalImagesPullingTime="18.50038145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:08.036172327 +0000 UTC m=+22.693736093" watchObservedRunningTime="2026-09-11 21:31:08.037520375 +0000 UTC m=+22.695084139"
Sep 11 21:31:08.054073 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:08.054026    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hhbwv" podStartSLOduration=3.497103247 podStartE2EDuration="22.054010992s" totalImagesPullingTime="18.556907745s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:08.053418182 +0000 UTC m=+22.710981945" watchObservedRunningTime="2026-09-11 21:31:08.054010992 +0000 UTC m=+22.711574756"
Sep 11 21:31:08.754812 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:08.754784    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:08.755277 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:08.754890    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:08.875139 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:08.875118    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 21:31:08.991230 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:08.991195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4" event={"ID":"6c3081af-2110-4bb0-843e-9b5444b561e6","Type":"ContainerStarted","Data":"db30bea2b405f722dfb32e2bb204e5689e98239aaba51ba71f69069f7a098364"}
Sep 11 21:31:08.992710 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:08.992683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qx8t6" event={"ID":"24c653d7-9bfb-43a5-98c5-55cfce97e640","Type":"ContainerStarted","Data":"1faa2c99ee4f49bff552fe7fc701cdf2dee5574d8cb5045610b928bc022c379e"}
Sep 11 21:31:09.008208 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:09.008160    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qx8t6" podStartSLOduration=4.515175192 podStartE2EDuration="23.008145731s" totalImagesPullingTime="18.492970539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:09.008005228 +0000 UTC m=+23.665568993" watchObservedRunningTime="2026-09-11 21:31:09.008145731 +0000 UTC m=+23.665709494"
Sep 11 21:31:09.733118 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:09.733014    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T21:31:08.875135457Z","UUID":"a8b092d7-fb17-42ba-9d17-b78688bbacfa","Handler":null,"Name":"","Endpoint":""}
Sep 11 21:31:09.734743 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:09.734718    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 21:31:09.734892 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:09.734757    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 21:31:09.759534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:09.759500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:09.759534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:09.759514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:09.760018 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:09.759654    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:09.760255 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:09.760227    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:10.754260 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:10.754220    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:10.754482 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:10.754367    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:10.999868 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:10.999833    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4" event={"ID":"6c3081af-2110-4bb0-843e-9b5444b561e6","Type":"ContainerStarted","Data":"2d956f85ce8c48cba4775f080c461e1f6ccf9a517253403886afb938ab44e0c0"}
Sep 11 21:31:11.003701 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:11.003673    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" event={"ID":"c3776032-1324-41bb-85ae-d0811934523e","Type":"ContainerStarted","Data":"34803885fca1211c500cc62317f34ebff4946d76a24567a1c15c8f741172bcb1"}
Sep 11 21:31:11.283838 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:11.283804    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:31:11.284524 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:11.284501    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:31:11.310322 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:11.310269    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-97sn4" podStartSLOduration=4.580129101 podStartE2EDuration="25.31025057s" totalImagesPullingTime="20.730121469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:11.017529135 +0000 UTC m=+25.675092901" watchObservedRunningTime="2026-09-11 21:31:11.31025057 +0000 UTC m=+25.967814316"
Sep 11 21:31:11.754810 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:11.754776    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:11.754987 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:11.754910    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:11.754987 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:11.754963    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:11.755106 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:11.755084    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:12.006184 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:12.006110    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:31:12.006729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:12.006701    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kb4d7"
Sep 11 21:31:12.754083 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:12.754064    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:12.754187 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:12.754168    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:13.016086 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:13.015683    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" event={"ID":"c3776032-1324-41bb-85ae-d0811934523e","Type":"ContainerStarted","Data":"2d2ebe1da4a15b18fa4094cb1c3120ce3aa1e115276ade9de4e33346a952c386"}
Sep 11 21:31:13.016086 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:13.015963    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:31:13.016086 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:13.016031    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:31:13.017811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:13.017786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" event={"ID":"260ab03b-1ce0-477b-976d-8da2806c4f3d","Type":"ContainerStarted","Data":"cc53b05e3e7a202e220b277247e1e74b4d29458f88cb3d58d7b6e30e58057c68"}
Sep 11 21:31:13.031006 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:13.030984    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:31:13.042991 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:13.042951    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw" podStartSLOduration=8.486608207 podStartE2EDuration="27.042934946s" totalImagesPullingTime="18.556326739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:13.042341861 +0000 UTC m=+27.699905626" watchObservedRunningTime="2026-09-11 21:31:13.042934946 +0000 UTC m=+27.700498711"
Sep 11 21:31:13.757118 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:13.757091    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:13.757274 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:13.757182    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:13.757274 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:13.757209    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:13.757274 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:13.757254    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:14.023042 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.022925    2577 generic.go:356] "Generic (PLEG): container finished" podID="260ab03b-1ce0-477b-976d-8da2806c4f3d" containerID="cc53b05e3e7a202e220b277247e1e74b4d29458f88cb3d58d7b6e30e58057c68" exitCode=0
Sep 11 21:31:14.024644 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.024613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" event={"ID":"260ab03b-1ce0-477b-976d-8da2806c4f3d","Type":"ContainerDied","Data":"cc53b05e3e7a202e220b277247e1e74b4d29458f88cb3d58d7b6e30e58057c68"}
Sep 11 21:31:14.025528 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.025504    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:31:14.043745 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.043721    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:31:14.694768 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.694737    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2njxc"]
Sep 11 21:31:14.694917 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.694855    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:14.694998 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:14.694975    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:14.700097 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.699627    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g59xd"]
Sep 11 21:31:14.700097 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.700055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:14.700573 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:14.700431    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:14.702185 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.702120    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fdwb9"]
Sep 11 21:31:14.702263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:14.702212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:14.702329 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:14.702302    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:15.027691 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:15.027601    2577 generic.go:356] "Generic (PLEG): container finished" podID="260ab03b-1ce0-477b-976d-8da2806c4f3d" containerID="f9c0f231786c5b569bb7b210b1caa362db47c9b580955c83d2f6c90fc9aeb828" exitCode=0
Sep 11 21:31:15.028353 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:15.027682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" event={"ID":"260ab03b-1ce0-477b-976d-8da2806c4f3d","Type":"ContainerDied","Data":"f9c0f231786c5b569bb7b210b1caa362db47c9b580955c83d2f6c90fc9aeb828"}
Sep 11 21:31:15.760043 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:15.760018    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod260ab03b_1ce0_477b_976d_8da2806c4f3d.slice/crio-78485d1d93427de68b11e75b559babfb001db255e79e36b9936822a771661eb4.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 21:31:16.031609 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:16.031580    2577 generic.go:356] "Generic (PLEG): container finished" podID="260ab03b-1ce0-477b-976d-8da2806c4f3d" containerID="78485d1d93427de68b11e75b559babfb001db255e79e36b9936822a771661eb4" exitCode=0
Sep 11 21:31:16.031938 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:16.031656    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" event={"ID":"260ab03b-1ce0-477b-976d-8da2806c4f3d","Type":"ContainerDied","Data":"78485d1d93427de68b11e75b559babfb001db255e79e36b9936822a771661eb4"}
Sep 11 21:31:16.754140 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:16.754107    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:16.754140 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:16.754128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:16.754396 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:16.754123    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:16.754396 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:16.754218    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:16.754396 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:16.754331    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:16.754660 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:16.754421    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:18.754289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:18.754211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:18.754289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:18.754212    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:18.754768 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:18.754214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:18.754768 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:18.754333    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2njxc" podUID="c5c7b2cc-2002-4017-abc7-48c1210d57d4"
Sep 11 21:31:18.754768 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:18.754446    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g59xd" podUID="9774a99e-8c66-47df-97b0-cc061be54f89"
Sep 11 21:31:18.754768 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:18.754568    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fdwb9" podUID="96c2bbfa-865c-498d-9133-ad725c18b7bf"
Sep 11 21:31:19.415099 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:19.415064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:19.415384 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:19.415231    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:31:19.415384 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:19.415290    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs podName:9774a99e-8c66-47df-97b0-cc061be54f89 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:51.415272518 +0000 UTC m=+66.072836275 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs") pod "network-metrics-daemon-g59xd" (UID: "9774a99e-8c66-47df-97b0-cc061be54f89") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 21:31:19.515966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:19.515930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:19.516143 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:19.516074    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 21:31:19.516143 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:19.516133    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret podName:c5c7b2cc-2002-4017-abc7-48c1210d57d4 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:51.516116737 +0000 UTC m=+66.173680495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret") pod "global-pull-secret-syncer-2njxc" (UID: "c5c7b2cc-2002-4017-abc7-48c1210d57d4") : object "kube-system"/"original-pull-secret" not registered
Sep 11 21:31:19.616293 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:19.616260    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:19.616500 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:19.616378    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 21:31:19.616500 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:19.616394    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 21:31:19.616500 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:19.616407    2577 projected.go:196] Error preparing data for projected volume kube-api-access-p9mtz for pod openshift-network-diagnostics/network-check-target-fdwb9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:31:19.616500 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:19.616456    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz podName:96c2bbfa-865c-498d-9133-ad725c18b7bf nodeName:}" failed. No retries permitted until 2026-09-11 21:31:51.616443647 +0000 UTC m=+66.274007389 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p9mtz" (UniqueName: "kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz") pod "network-check-target-fdwb9" (UID: "96c2bbfa-865c-498d-9133-ad725c18b7bf") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 21:31:20.098416 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.098336    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-44.ec2.internal" event="NodeReady"
Sep 11 21:31:20.098841 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.098460    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 21:31:20.142292 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.142257    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qvtpj"]
Sep 11 21:31:20.168986 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.168946    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2tffz"]
Sep 11 21:31:20.169131 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.169108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.172180 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.172156    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 21:31:20.172301 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.172183    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 21:31:20.172301 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.172214    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59g8b\""
Sep 11 21:31:20.182487 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.182453    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvtpj"]
Sep 11 21:31:20.182578 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.182511    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2tffz"]
Sep 11 21:31:20.182624 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.182586    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2tffz"
Sep 11 21:31:20.185334 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.185313    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 21:31:20.185334 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.185328    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 21:31:20.185499 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.185339    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 21:31:20.186146 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.185704    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vcb9z\""
Sep 11 21:31:20.321264 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.321225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.321433 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.321276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpxbb\" (UniqueName: \"kubernetes.io/projected/e14323f8-b148-472b-90a1-a435a41d7cd9-kube-api-access-vpxbb\") pod \"ingress-canary-2tffz\" (UID: \"e14323f8-b148-472b-90a1-a435a41d7cd9\") " pod="openshift-ingress-canary/ingress-canary-2tffz"
Sep 11 21:31:20.321433 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.321308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e14323f8-b148-472b-90a1-a435a41d7cd9-cert\") pod \"ingress-canary-2tffz\" (UID: \"e14323f8-b148-472b-90a1-a435a41d7cd9\") " pod="openshift-ingress-canary/ingress-canary-2tffz"
Sep 11 21:31:20.321433 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.321390    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37d16b56-27f1-401b-a3f4-a389d0c47db2-config-volume\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.321433 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.321422    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d16b56-27f1-401b-a3f4-a389d0c47db2-tmp-dir\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.321649 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.321455    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpk8m\" (UniqueName: \"kubernetes.io/projected/37d16b56-27f1-401b-a3f4-a389d0c47db2-kube-api-access-vpk8m\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.422593 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.422553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d16b56-27f1-401b-a3f4-a389d0c47db2-tmp-dir\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.422761 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.422605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpk8m\" (UniqueName: \"kubernetes.io/projected/37d16b56-27f1-401b-a3f4-a389d0c47db2-kube-api-access-vpk8m\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.422761 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.422657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.422761 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.422686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpxbb\" (UniqueName: \"kubernetes.io/projected/e14323f8-b148-472b-90a1-a435a41d7cd9-kube-api-access-vpxbb\") pod \"ingress-canary-2tffz\" (UID: \"e14323f8-b148-472b-90a1-a435a41d7cd9\") " pod="openshift-ingress-canary/ingress-canary-2tffz"
Sep 11 21:31:20.422761 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.422742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e14323f8-b148-472b-90a1-a435a41d7cd9-cert\") pod \"ingress-canary-2tffz\" (UID: \"e14323f8-b148-472b-90a1-a435a41d7cd9\") " pod="openshift-ingress-canary/ingress-canary-2tffz"
Sep 11 21:31:20.422976 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:20.422792    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:31:20.422976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.422812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37d16b56-27f1-401b-a3f4-a389d0c47db2-config-volume\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.422976 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:20.422856    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls podName:37d16b56-27f1-401b-a3f4-a389d0c47db2 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:20.922837309 +0000 UTC m=+35.580401055 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls") pod "dns-default-qvtpj" (UID: "37d16b56-27f1-401b-a3f4-a389d0c47db2") : secret "dns-default-metrics-tls" not found
Sep 11 21:31:20.422976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.422954    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37d16b56-27f1-401b-a3f4-a389d0c47db2-tmp-dir\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.423406 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.423379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/37d16b56-27f1-401b-a3f4-a389d0c47db2-config-volume\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.428099 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.428073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e14323f8-b148-472b-90a1-a435a41d7cd9-cert\") pod \"ingress-canary-2tffz\" (UID: \"e14323f8-b148-472b-90a1-a435a41d7cd9\") " pod="openshift-ingress-canary/ingress-canary-2tffz"
Sep 11 21:31:20.432956 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.432923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpxbb\" (UniqueName: \"kubernetes.io/projected/e14323f8-b148-472b-90a1-a435a41d7cd9-kube-api-access-vpxbb\") pod \"ingress-canary-2tffz\" (UID: \"e14323f8-b148-472b-90a1-a435a41d7cd9\") " pod="openshift-ingress-canary/ingress-canary-2tffz"
Sep 11 21:31:20.433077 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.433056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpk8m\" (UniqueName: \"kubernetes.io/projected/37d16b56-27f1-401b-a3f4-a389d0c47db2-kube-api-access-vpk8m\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.492257 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.492234    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2tffz"
Sep 11 21:31:20.754533 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.754502    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:20.754676 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.754660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:20.754896 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.754755    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:20.757790 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.757770    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:31:20.757917 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.757822    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 21:31:20.757917 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.757879    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 21:31:20.758932 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.758913    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r57v4\""
Sep 11 21:31:20.759059 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.758957    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:31:20.759059 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.758976    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxgvf\""
Sep 11 21:31:20.926110 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.926079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:20.926261 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:20.926183    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:31:20.926261 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:20.926238    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls podName:37d16b56-27f1-401b-a3f4-a389d0c47db2 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:21.926223375 +0000 UTC m=+36.583787137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls") pod "dns-default-qvtpj" (UID: "37d16b56-27f1-401b-a3f4-a389d0c47db2") : secret "dns-default-metrics-tls" not found
Sep 11 21:31:20.973888 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:20.973827    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2tffz"]
Sep 11 21:31:20.977112 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:31:20.977075    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14323f8_b148_472b_90a1_a435a41d7cd9.slice/crio-2dd426a24a7b202a6f36afdea5ea5792218f948a73443451e5b20eb869dbae6c WatchSource:0}: Error finding container 2dd426a24a7b202a6f36afdea5ea5792218f948a73443451e5b20eb869dbae6c: Status 404 returned error can't find the container with id 2dd426a24a7b202a6f36afdea5ea5792218f948a73443451e5b20eb869dbae6c
Sep 11 21:31:21.044593 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:21.044566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2tffz" event={"ID":"e14323f8-b148-472b-90a1-a435a41d7cd9","Type":"ContainerStarted","Data":"2dd426a24a7b202a6f36afdea5ea5792218f948a73443451e5b20eb869dbae6c"}
Sep 11 21:31:21.933202 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:21.933166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:21.933617 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:21.933334    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:31:21.933617 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:21.933412    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls podName:37d16b56-27f1-401b-a3f4-a389d0c47db2 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:23.933389017 +0000 UTC m=+38.590952765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls") pod "dns-default-qvtpj" (UID: "37d16b56-27f1-401b-a3f4-a389d0c47db2") : secret "dns-default-metrics-tls" not found
Sep 11 21:31:22.050528 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:22.050496    2577 generic.go:356] "Generic (PLEG): container finished" podID="260ab03b-1ce0-477b-976d-8da2806c4f3d" containerID="82a5b8eec3e923e99aad92f2d3a0451479bde6bc8ad494e48b8ad5f51c702f97" exitCode=0
Sep 11 21:31:22.050690 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:22.050559    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" event={"ID":"260ab03b-1ce0-477b-976d-8da2806c4f3d","Type":"ContainerDied","Data":"82a5b8eec3e923e99aad92f2d3a0451479bde6bc8ad494e48b8ad5f51c702f97"}
Sep 11 21:31:23.057302 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:23.057263    2577 generic.go:356] "Generic (PLEG): container finished" podID="260ab03b-1ce0-477b-976d-8da2806c4f3d" containerID="7dabc3c66c2cccea40ab217c2bdc1f6b61dd48d922c3210c76f83c23658f2238" exitCode=0
Sep 11 21:31:23.057871 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:23.057346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" event={"ID":"260ab03b-1ce0-477b-976d-8da2806c4f3d","Type":"ContainerDied","Data":"7dabc3c66c2cccea40ab217c2bdc1f6b61dd48d922c3210c76f83c23658f2238"}
Sep 11 21:31:23.950459 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:23.950429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:23.950615 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:23.950569    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:31:23.950651 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:23.950628    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls podName:37d16b56-27f1-401b-a3f4-a389d0c47db2 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:27.950614216 +0000 UTC m=+42.608177963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls") pod "dns-default-qvtpj" (UID: "37d16b56-27f1-401b-a3f4-a389d0c47db2") : secret "dns-default-metrics-tls" not found
Sep 11 21:31:24.064879 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:24.064847    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" event={"ID":"260ab03b-1ce0-477b-976d-8da2806c4f3d","Type":"ContainerStarted","Data":"d742e1300947daa15624bd9f4ac45baf883658a7d89d7d861b0d1cebc66c684d"}
Sep 11 21:31:24.066667 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:24.066641    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2tffz" event={"ID":"e14323f8-b148-472b-90a1-a435a41d7cd9","Type":"ContainerStarted","Data":"bdac6f8b36d32d1f7816f1d66919337225a59a78c4aa5de364c09a22a6a125db"}
Sep 11 21:31:24.089354 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:24.089311    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wg5r2" podStartSLOduration=8.439005993 podStartE2EDuration="38.089292475s" totalImagesPullingTime="29.650286482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:24.088384102 +0000 UTC m=+38.745947866" watchObservedRunningTime="2026-09-11 21:31:24.089292475 +0000 UTC m=+38.746856242"
Sep 11 21:31:24.107452 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:24.107412    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2tffz" podStartSLOduration=1.7050574410000001 podStartE2EDuration="4.107398435s" totalImagesPullingTime="2.402340994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:24.10625685 +0000 UTC m=+38.763820613" watchObservedRunningTime="2026-09-11 21:31:24.107398435 +0000 UTC m=+38.764962193"
Sep 11 21:31:27.979243 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:27.979203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:27.979641 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:27.979309    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:31:27.979641 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:27.979358    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls podName:37d16b56-27f1-401b-a3f4-a389d0c47db2 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:35.979345752 +0000 UTC m=+50.636909498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls") pod "dns-default-qvtpj" (UID: "37d16b56-27f1-401b-a3f4-a389d0c47db2") : secret "dns-default-metrics-tls" not found
Sep 11 21:31:36.034856 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:36.034814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:36.035348 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:36.034923    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:31:36.035348 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:36.035004    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls podName:37d16b56-27f1-401b-a3f4-a389d0c47db2 nodeName:}" failed. No retries permitted until 2026-09-11 21:31:52.034970997 +0000 UTC m=+66.692534759 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls") pod "dns-default-qvtpj" (UID: "37d16b56-27f1-401b-a3f4-a389d0c47db2") : secret "dns-default-metrics-tls" not found
Sep 11 21:31:36.985674 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:36.985638    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd"]
Sep 11 21:31:36.998412 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:36.998390    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"]
Sep 11 21:31:36.998588 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:36.998553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd"
Sep 11 21:31:37.004914 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.004890    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-8zq8v\""
Sep 11 21:31:37.005039 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.004969    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 21:31:37.005235 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.005217    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:31:37.011141 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.011122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd"]
Sep 11 21:31:37.011248 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.011153    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"]
Sep 11 21:31:37.011248 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.011239    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.025158 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.024981    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 21:31:37.025158 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.025030    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 21:31:37.025158 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.025087    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 21:31:37.025158 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.025130    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xff6v\""
Sep 11 21:31:37.025580 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.025418    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:31:37.100172 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.100150    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-68j49"]
Sep 11 21:31:37.117131 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.117107    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.117245 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.117110    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"]
Sep 11 21:31:37.120994 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.120956    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:31:37.121111 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.121016    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 21:31:37.121111 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.121089    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 21:31:37.121111 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.121100    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-82dxq\""
Sep 11 21:31:37.121272 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.121020    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 21:31:37.128725 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.128707    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 21:31:37.142664 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.142644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wvv9\" (UniqueName: \"kubernetes.io/projected/d0aba8ef-4c48-4e84-a846-5c3265089c47-kube-api-access-5wvv9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-b84fl\" (UID: \"d0aba8ef-4c48-4e84-a846-5c3265089c47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.142779 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.142707    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0aba8ef-4c48-4e84-a846-5c3265089c47-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-b84fl\" (UID: \"d0aba8ef-4c48-4e84-a846-5c3265089c47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.142779 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.142767    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts2n6\" (UniqueName: \"kubernetes.io/projected/c8a57eed-da5e-4c48-b65c-f0e8cd2870f4-kube-api-access-ts2n6\") pod \"volume-data-source-validator-86695b7cc7-8mcdd\" (UID: \"c8a57eed-da5e-4c48-b65c-f0e8cd2870f4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd"
Sep 11 21:31:37.142892 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.142796    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0aba8ef-4c48-4e84-a846-5c3265089c47-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-b84fl\" (UID: \"d0aba8ef-4c48-4e84-a846-5c3265089c47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.143284 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.143263    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-68j49"]
Sep 11 21:31:37.143375 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.143363    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.143901 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.143878    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"]
Sep 11 21:31:37.146861 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.146844    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 21:31:37.147060 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.147006    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 21:31:37.147201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.147176    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5txcp\""
Sep 11 21:31:37.147432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.147416    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 21:31:37.155552 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.155535    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 21:31:37.243855 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.243804    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-installation-pull-secrets\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.243855 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.243830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22w5l\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-kube-api-access-22w5l\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.243855 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.243852    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00e2c510-c4df-4cbb-b060-c1d838c1af8e-ca-trust-extracted\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.243996 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.243934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0aba8ef-4c48-4e84-a846-5c3265089c47-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-b84fl\" (UID: \"d0aba8ef-4c48-4e84-a846-5c3265089c47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.243996 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.243963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h42sr\" (UniqueName: \"kubernetes.io/projected/5db6f14e-085e-4e88-8478-9fcd12a4ada3-kube-api-access-h42sr\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.243996 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.243982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-image-registry-private-configuration\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.244128 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.243998    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.244128 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts2n6\" (UniqueName: \"kubernetes.io/projected/c8a57eed-da5e-4c48-b65c-f0e8cd2870f4-kube-api-access-ts2n6\") pod \"volume-data-source-validator-86695b7cc7-8mcdd\" (UID: \"c8a57eed-da5e-4c48-b65c-f0e8cd2870f4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd"
Sep 11 21:31:37.244229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0aba8ef-4c48-4e84-a846-5c3265089c47-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-b84fl\" (UID: \"d0aba8ef-4c48-4e84-a846-5c3265089c47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.244229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-trusted-ca\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.244229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244183    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-bound-sa-token\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.244374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wvv9\" (UniqueName: \"kubernetes.io/projected/d0aba8ef-4c48-4e84-a846-5c3265089c47-kube-api-access-5wvv9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-b84fl\" (UID: \"d0aba8ef-4c48-4e84-a846-5c3265089c47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.244374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244285    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5db6f14e-085e-4e88-8478-9fcd12a4ada3-config\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.244374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5db6f14e-085e-4e88-8478-9fcd12a4ada3-serving-cert\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.244374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5db6f14e-085e-4e88-8478-9fcd12a4ada3-trusted-ca\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.244374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244360    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-certificates\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.244678 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.244657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d0aba8ef-4c48-4e84-a846-5c3265089c47-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-b84fl\" (UID: \"d0aba8ef-4c48-4e84-a846-5c3265089c47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.247228 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.247213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d0aba8ef-4c48-4e84-a846-5c3265089c47-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-b84fl\" (UID: \"d0aba8ef-4c48-4e84-a846-5c3265089c47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.253505 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.253465    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wvv9\" (UniqueName: \"kubernetes.io/projected/d0aba8ef-4c48-4e84-a846-5c3265089c47-kube-api-access-5wvv9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-b84fl\" (UID: \"d0aba8ef-4c48-4e84-a846-5c3265089c47\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.257056 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.257034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts2n6\" (UniqueName: \"kubernetes.io/projected/c8a57eed-da5e-4c48-b65c-f0e8cd2870f4-kube-api-access-ts2n6\") pod \"volume-data-source-validator-86695b7cc7-8mcdd\" (UID: \"c8a57eed-da5e-4c48-b65c-f0e8cd2870f4\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd"
Sep 11 21:31:37.314227 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.314209    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd"
Sep 11 21:31:37.320361 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.320347    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"
Sep 11 21:31:37.345179 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345156    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5db6f14e-085e-4e88-8478-9fcd12a4ada3-trusted-ca\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.345329 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-certificates\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.345329 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-installation-pull-secrets\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.345329 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22w5l\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-kube-api-access-22w5l\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.345329 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00e2c510-c4df-4cbb-b060-c1d838c1af8e-ca-trust-extracted\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.345554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h42sr\" (UniqueName: \"kubernetes.io/projected/5db6f14e-085e-4e88-8478-9fcd12a4ada3-kube-api-access-h42sr\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.345554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345415    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-image-registry-private-configuration\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.345554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.345554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-trusted-ca\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.345743 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-bound-sa-token\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.345743 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5db6f14e-085e-4e88-8478-9fcd12a4ada3-config\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.345743 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:37.345727    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:31:37.345880 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:37.345751    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p: secret "image-registry-tls" not found
Sep 11 21:31:37.345880 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:37.345818    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls podName:00e2c510-c4df-4cbb-b060-c1d838c1af8e nodeName:}" failed. No retries permitted until 2026-09-11 21:31:37.845793765 +0000 UTC m=+52.503357517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls") pod "image-registry-6bcd4cf6bf-t2r6p" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e") : secret "image-registry-tls" not found
Sep 11 21:31:37.345993 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-certificates\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.346060 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.345733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5db6f14e-085e-4e88-8478-9fcd12a4ada3-serving-cert\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.346846 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.346804    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5db6f14e-085e-4e88-8478-9fcd12a4ada3-config\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.346933 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.346889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00e2c510-c4df-4cbb-b060-c1d838c1af8e-ca-trust-extracted\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.346933 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.346922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5db6f14e-085e-4e88-8478-9fcd12a4ada3-trusted-ca\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.347356 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.347334    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-trusted-ca\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.348544 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.348519    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5db6f14e-085e-4e88-8478-9fcd12a4ada3-serving-cert\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.349199 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.349181    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-image-registry-private-configuration\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.349298 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.349281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-installation-pull-secrets\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.356307 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.356289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-bound-sa-token\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.356896 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.356874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h42sr\" (UniqueName: \"kubernetes.io/projected/5db6f14e-085e-4e88-8478-9fcd12a4ada3-kube-api-access-h42sr\") pod \"console-operator-696884fb9c-68j49\" (UID: \"5db6f14e-085e-4e88-8478-9fcd12a4ada3\") " pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.358570 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.358550    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22w5l\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-kube-api-access-22w5l\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.427831 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.427805    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:37.601652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.601580    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd"]
Sep 11 21:31:37.604818 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:31:37.604788    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a57eed_da5e_4c48_b65c_f0e8cd2870f4.slice/crio-6dd9b9cfb90d109ae7f60788397733f8d13e98f67f3255aea465b92dabb242d4 WatchSource:0}: Error finding container 6dd9b9cfb90d109ae7f60788397733f8d13e98f67f3255aea465b92dabb242d4: Status 404 returned error can't find the container with id 6dd9b9cfb90d109ae7f60788397733f8d13e98f67f3255aea465b92dabb242d4
Sep 11 21:31:37.623087 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.623060    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl"]
Sep 11 21:31:37.625786 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:31:37.625758    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0aba8ef_4c48_4e84_a846_5c3265089c47.slice/crio-0e7068f19551eb603a92b72f6a60b1b67e04efcc9b002d17b12dcb3dc181b2f4 WatchSource:0}: Error finding container 0e7068f19551eb603a92b72f6a60b1b67e04efcc9b002d17b12dcb3dc181b2f4: Status 404 returned error can't find the container with id 0e7068f19551eb603a92b72f6a60b1b67e04efcc9b002d17b12dcb3dc181b2f4
Sep 11 21:31:37.692355 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.692333    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-68j49"]
Sep 11 21:31:37.694868 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:31:37.694835    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5db6f14e_085e_4e88_8478_9fcd12a4ada3.slice/crio-7fd1b2ce005cdc3b106d17bc6ff5d7b29eacdb9383bc7cd6922bfad6850c3eeb WatchSource:0}: Error finding container 7fd1b2ce005cdc3b106d17bc6ff5d7b29eacdb9383bc7cd6922bfad6850c3eeb: Status 404 returned error can't find the container with id 7fd1b2ce005cdc3b106d17bc6ff5d7b29eacdb9383bc7cd6922bfad6850c3eeb
Sep 11 21:31:37.849651 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:37.849616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:37.849829 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:37.849807    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:31:37.849915 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:37.849833    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p: secret "image-registry-tls" not found
Sep 11 21:31:37.849915 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:37.849902    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls podName:00e2c510-c4df-4cbb-b060-c1d838c1af8e nodeName:}" failed. No retries permitted until 2026-09-11 21:31:38.849882714 +0000 UTC m=+53.507446470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls") pod "image-registry-6bcd4cf6bf-t2r6p" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e") : secret "image-registry-tls" not found
Sep 11 21:31:38.100719 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:38.100678    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-68j49" event={"ID":"5db6f14e-085e-4e88-8478-9fcd12a4ada3","Type":"ContainerStarted","Data":"7fd1b2ce005cdc3b106d17bc6ff5d7b29eacdb9383bc7cd6922bfad6850c3eeb"}
Sep 11 21:31:38.102367 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:38.102341    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl" event={"ID":"d0aba8ef-4c48-4e84-a846-5c3265089c47","Type":"ContainerStarted","Data":"0e7068f19551eb603a92b72f6a60b1b67e04efcc9b002d17b12dcb3dc181b2f4"}
Sep 11 21:31:38.103518 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:38.103495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd" event={"ID":"c8a57eed-da5e-4c48-b65c-f0e8cd2870f4","Type":"ContainerStarted","Data":"6dd9b9cfb90d109ae7f60788397733f8d13e98f67f3255aea465b92dabb242d4"}
Sep 11 21:31:38.858120 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:38.858093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:38.858249 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:38.858228    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:31:38.858249 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:38.858240    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p: secret "image-registry-tls" not found
Sep 11 21:31:38.858349 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:38.858282    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls podName:00e2c510-c4df-4cbb-b060-c1d838c1af8e nodeName:}" failed. No retries permitted until 2026-09-11 21:31:40.858270337 +0000 UTC m=+55.515834083 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls") pod "image-registry-6bcd4cf6bf-t2r6p" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e") : secret "image-registry-tls" not found
Sep 11 21:31:39.108148 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:39.108071    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd" event={"ID":"c8a57eed-da5e-4c48-b65c-f0e8cd2870f4","Type":"ContainerStarted","Data":"60a307a4e1168f66767ed355cbc40eac4c31c6735320af0cbfabd07eec716e3a"}
Sep 11 21:31:39.123752 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:39.123700    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-8mcdd" podStartSLOduration=1.953318797 podStartE2EDuration="3.123679949s" totalImagesPullingTime="1.170361152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:39.123310549 +0000 UTC m=+53.780874326" watchObservedRunningTime="2026-09-11 21:31:39.123679949 +0000 UTC m=+53.781243713"
Sep 11 21:31:40.871374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:40.871341    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:40.871825 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:40.871489    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:31:40.871825 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:40.871506    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p: secret "image-registry-tls" not found
Sep 11 21:31:40.871825 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:40.871574    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls podName:00e2c510-c4df-4cbb-b060-c1d838c1af8e nodeName:}" failed. No retries permitted until 2026-09-11 21:31:44.871554789 +0000 UTC m=+59.529118532 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls") pod "image-registry-6bcd4cf6bf-t2r6p" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e") : secret "image-registry-tls" not found
Sep 11 21:31:41.117787 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:41.117758    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/0.log"
Sep 11 21:31:41.117977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:41.117807    2577 generic.go:356] "Generic (PLEG): container finished" podID="5db6f14e-085e-4e88-8478-9fcd12a4ada3" containerID="2b89688a172ee42bd1a9563e0a24af56eaff66ab053a2baa985b6fa858304666" exitCode=255
Sep 11 21:31:41.117977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:41.117844    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-68j49" event={"ID":"5db6f14e-085e-4e88-8478-9fcd12a4ada3","Type":"ContainerDied","Data":"2b89688a172ee42bd1a9563e0a24af56eaff66ab053a2baa985b6fa858304666"}
Sep 11 21:31:41.118131 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:41.118104    2577 scope.go:117] "RemoveContainer" containerID="2b89688a172ee42bd1a9563e0a24af56eaff66ab053a2baa985b6fa858304666"
Sep 11 21:31:41.119527 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:41.119506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl" event={"ID":"d0aba8ef-4c48-4e84-a846-5c3265089c47","Type":"ContainerStarted","Data":"7a5018ce15eeb78b6fec30e576d978ac946cae8d108c7878e4c89c9859e173bd"}
Sep 11 21:31:41.152383 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:41.152346    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl" podStartSLOduration=2.634278274 podStartE2EDuration="5.152330162s" totalImagesPullingTime="2.518051888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:41.15215639 +0000 UTC m=+55.809720154" watchObservedRunningTime="2026-09-11 21:31:41.152330162 +0000 UTC m=+55.809893919"
Sep 11 21:31:42.124071 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.124039    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:31:42.124450 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.124431    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/0.log"
Sep 11 21:31:42.124515 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.124464    2577 generic.go:356] "Generic (PLEG): container finished" podID="5db6f14e-085e-4e88-8478-9fcd12a4ada3" containerID="0a6fe8bf89e44cad935d4c50fdad0f53be7808aa5bd675ab0e3c76803efb0ee3" exitCode=255
Sep 11 21:31:42.124592 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.124567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-68j49" event={"ID":"5db6f14e-085e-4e88-8478-9fcd12a4ada3","Type":"ContainerDied","Data":"0a6fe8bf89e44cad935d4c50fdad0f53be7808aa5bd675ab0e3c76803efb0ee3"}
Sep 11 21:31:42.124659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.124645    2577 scope.go:117] "RemoveContainer" containerID="2b89688a172ee42bd1a9563e0a24af56eaff66ab053a2baa985b6fa858304666"
Sep 11 21:31:42.124749 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.124737    2577 scope.go:117] "RemoveContainer" containerID="0a6fe8bf89e44cad935d4c50fdad0f53be7808aa5bd675ab0e3c76803efb0ee3"
Sep 11 21:31:42.124968 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:42.124945    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-68j49_openshift-console-operator(5db6f14e-085e-4e88-8478-9fcd12a4ada3)\"" pod="openshift-console-operator/console-operator-696884fb9c-68j49" podUID="5db6f14e-085e-4e88-8478-9fcd12a4ada3"
Sep 11 21:31:42.355375 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.355345    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m"]
Sep 11 21:31:42.357752 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.357726    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m"
Sep 11 21:31:42.360318 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.360297    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 21:31:42.360447 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.360425    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 21:31:42.360611 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.360596    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9ntzl\""
Sep 11 21:31:42.365646 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.365626    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m"]
Sep 11 21:31:42.483065 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.483039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkcrc\" (UniqueName: \"kubernetes.io/projected/3ab48ac4-cc66-4d2a-ac9a-90582d43876a-kube-api-access-fkcrc\") pod \"migrator-8b4d697c5-jkz5m\" (UID: \"3ab48ac4-cc66-4d2a-ac9a-90582d43876a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m"
Sep 11 21:31:42.498209 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.498187    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8dg6h"]
Sep 11 21:31:42.500161 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.500148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.504779 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.504751    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hpqdp\""
Sep 11 21:31:42.504908 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.504812    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 21:31:42.505172 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.505157    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 21:31:42.505256 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.505240    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 21:31:42.505599 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.505585    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 21:31:42.517913 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.517890    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8dg6h"]
Sep 11 21:31:42.584289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.584264    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkcrc\" (UniqueName: \"kubernetes.io/projected/3ab48ac4-cc66-4d2a-ac9a-90582d43876a-kube-api-access-fkcrc\") pod \"migrator-8b4d697c5-jkz5m\" (UID: \"3ab48ac4-cc66-4d2a-ac9a-90582d43876a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m"
Sep 11 21:31:42.593272 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.593252    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkcrc\" (UniqueName: \"kubernetes.io/projected/3ab48ac4-cc66-4d2a-ac9a-90582d43876a-kube-api-access-fkcrc\") pod \"migrator-8b4d697c5-jkz5m\" (UID: \"3ab48ac4-cc66-4d2a-ac9a-90582d43876a\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m"
Sep 11 21:31:42.667550 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.667516    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m"
Sep 11 21:31:42.684931 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.684898    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d3e45c2-175b-4a26-a246-d234a868430c-data-volume\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.685057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.684930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.685057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.684969    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxfvf\" (UniqueName: \"kubernetes.io/projected/7d3e45c2-175b-4a26-a246-d234a868430c-kube-api-access-jxfvf\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.685173 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.685111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d3e45c2-175b-4a26-a246-d234a868430c-crio-socket\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.685173 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.685154    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.786251 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.786196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d3e45c2-175b-4a26-a246-d234a868430c-data-volume\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.786251 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.786227    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.786433 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.786262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxfvf\" (UniqueName: \"kubernetes.io/projected/7d3e45c2-175b-4a26-a246-d234a868430c-kube-api-access-jxfvf\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.786433 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:42.786339    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:31:42.786433 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:42.786409    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:43.286392308 +0000 UTC m=+57.943956050 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : configmap "kube-rbac-proxy" not found
Sep 11 21:31:42.786620 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.786550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d3e45c2-175b-4a26-a246-d234a868430c-crio-socket\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.786620 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.786587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.786721 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.786643    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d3e45c2-175b-4a26-a246-d234a868430c-crio-socket\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.786779 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.786702    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d3e45c2-175b-4a26-a246-d234a868430c-data-volume\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.786779 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:42.786718    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:42.786862 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:42.786818    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:43.286799324 +0000 UTC m=+57.944363083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:42.795371 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.795345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxfvf\" (UniqueName: \"kubernetes.io/projected/7d3e45c2-175b-4a26-a246-d234a868430c-kube-api-access-jxfvf\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:42.933332 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:42.933312    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m"]
Sep 11 21:31:42.935818 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:31:42.935794    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab48ac4_cc66_4d2a_ac9a_90582d43876a.slice/crio-de0fc572bfee80443896348991f0bd982fb41afd6967f0a113118dda639f5c87 WatchSource:0}: Error finding container de0fc572bfee80443896348991f0bd982fb41afd6967f0a113118dda639f5c87: Status 404 returned error can't find the container with id de0fc572bfee80443896348991f0bd982fb41afd6967f0a113118dda639f5c87
Sep 11 21:31:43.128036 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:43.127968    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:31:43.128415 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:43.128341    2577 scope.go:117] "RemoveContainer" containerID="0a6fe8bf89e44cad935d4c50fdad0f53be7808aa5bd675ab0e3c76803efb0ee3"
Sep 11 21:31:43.128530 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:43.128511    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-68j49_openshift-console-operator(5db6f14e-085e-4e88-8478-9fcd12a4ada3)\"" pod="openshift-console-operator/console-operator-696884fb9c-68j49" podUID="5db6f14e-085e-4e88-8478-9fcd12a4ada3"
Sep 11 21:31:43.129243 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:43.129221    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m" event={"ID":"3ab48ac4-cc66-4d2a-ac9a-90582d43876a","Type":"ContainerStarted","Data":"de0fc572bfee80443896348991f0bd982fb41afd6967f0a113118dda639f5c87"}
Sep 11 21:31:43.291377 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:43.291338    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:43.291559 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:43.291428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:43.291559 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:43.291463    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:43.291559 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:43.291521    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:31:43.291559 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:43.291554    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:44.291534043 +0000 UTC m=+58.949097803 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:43.291720 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:43.291576    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:44.291566437 +0000 UTC m=+58.949130181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : configmap "kube-rbac-proxy" not found
Sep 11 21:31:44.297855 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:44.297822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:44.298210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:44.297868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:44.298210 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:44.297953    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:31:44.298210 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:44.297963    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:44.298210 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:44.298004    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:46.297990809 +0000 UTC m=+60.955554554 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : configmap "kube-rbac-proxy" not found
Sep 11 21:31:44.298210 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:44.298017    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:46.298011022 +0000 UTC m=+60.955574765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:44.903223 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:44.903135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:44.903384 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:44.903268    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:31:44.903384 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:44.903285    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p: secret "image-registry-tls" not found
Sep 11 21:31:44.903384 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:44.903352    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls podName:00e2c510-c4df-4cbb-b060-c1d838c1af8e nodeName:}" failed. No retries permitted until 2026-09-11 21:31:52.903333788 +0000 UTC m=+67.560897547 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls") pod "image-registry-6bcd4cf6bf-t2r6p" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e") : secret "image-registry-tls" not found
Sep 11 21:31:45.136074 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:45.136034    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m" event={"ID":"3ab48ac4-cc66-4d2a-ac9a-90582d43876a","Type":"ContainerStarted","Data":"d097f985a62781fff565bb3d9ba27106e44be277de77b98bcb894e30120b914c"}
Sep 11 21:31:45.136237 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:45.136113    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m" event={"ID":"3ab48ac4-cc66-4d2a-ac9a-90582d43876a","Type":"ContainerStarted","Data":"7ac54f1c72799fd836c75165d467a611a59d3e3a2fb8813526a214b1b95135c4"}
Sep 11 21:31:45.151162 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:45.151115    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-jkz5m" podStartSLOduration=1.5791129659999998 podStartE2EDuration="3.15109958s" totalImagesPullingTime="1.571986614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:45.150493338 +0000 UTC m=+59.808057099" watchObservedRunningTime="2026-09-11 21:31:45.15109958 +0000 UTC m=+59.808663344"
Sep 11 21:31:45.535136 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:45.535107    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qk2kp_df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a/dns-node-resolver/0.log"
Sep 11 21:31:46.043052 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:46.043023    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zx9jw"
Sep 11 21:31:46.135201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:46.135178    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44hdm_0203e501-dc3f-4bee-9548-4fceb0ff9093/node-ca/0.log"
Sep 11 21:31:46.312709 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:46.312619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:46.312866 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:46.312729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:46.312866 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:46.312735    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:31:46.312866 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:46.312804    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:50.312787437 +0000 UTC m=+64.970351183 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : configmap "kube-rbac-proxy" not found
Sep 11 21:31:46.312866 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:46.312823    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:46.312999 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:46.312871    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:50.312855841 +0000 UTC m=+64.970419597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:46.934983 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:46.934958    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2tffz_e14323f8-b148-472b-90a1-a435a41d7cd9/serve-healthcheck-canary/0.log"
Sep 11 21:31:47.428922 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:47.428895    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:47.429061 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:47.428945    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:31:47.429256 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:47.429244    2577 scope.go:117] "RemoveContainer" containerID="0a6fe8bf89e44cad935d4c50fdad0f53be7808aa5bd675ab0e3c76803efb0ee3"
Sep 11 21:31:47.429387 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:47.429371    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-68j49_openshift-console-operator(5db6f14e-085e-4e88-8478-9fcd12a4ada3)\"" pod="openshift-console-operator/console-operator-696884fb9c-68j49" podUID="5db6f14e-085e-4e88-8478-9fcd12a4ada3"
Sep 11 21:31:47.535179 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:47.535153    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-jkz5m_3ab48ac4-cc66-4d2a-ac9a-90582d43876a/migrator/0.log"
Sep 11 21:31:47.734100 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:47.734032    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-jkz5m_3ab48ac4-cc66-4d2a-ac9a-90582d43876a/graceful-termination/0.log"
Sep 11 21:31:47.936283 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:47.936253    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-b84fl_d0aba8ef-4c48-4e84-a846-5c3265089c47/kube-storage-version-migrator-operator/0.log"
Sep 11 21:31:50.343560 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:50.343529    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:50.343930 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:50.343576    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:50.343930 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:50.343671    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 21:31:50.343930 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:50.343681    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:50.343930 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:50.343715    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:58.343702479 +0000 UTC m=+73.001266226 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : configmap "kube-rbac-proxy" not found
Sep 11 21:31:50.343930 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:50.343738    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:31:58.343720082 +0000 UTC m=+73.001283830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:51.453547 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.453509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:31:51.456661 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.456631    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 21:31:51.463778 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:51.463755    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 21:31:51.463885 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:51.463820    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs podName:9774a99e-8c66-47df-97b0-cc061be54f89 nodeName:}" failed. No retries permitted until 2026-09-11 21:32:55.463805443 +0000 UTC m=+130.121369185 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs") pod "network-metrics-daemon-g59xd" (UID: "9774a99e-8c66-47df-97b0-cc061be54f89") : secret "metrics-daemon-secret" not found
Sep 11 21:31:51.554454 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.554430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:51.557194 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.557177    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 21:31:51.567683 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.567663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c5c7b2cc-2002-4017-abc7-48c1210d57d4-original-pull-secret\") pod \"global-pull-secret-syncer-2njxc\" (UID: \"c5c7b2cc-2002-4017-abc7-48c1210d57d4\") " pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:51.655116 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.655095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:51.658054 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.658039    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 21:31:51.664209 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.664194    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2njxc"
Sep 11 21:31:51.668595 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.668580    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 21:31:51.679062 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.679039    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9mtz\" (UniqueName: \"kubernetes.io/projected/96c2bbfa-865c-498d-9133-ad725c18b7bf-kube-api-access-p9mtz\") pod \"network-check-target-fdwb9\" (UID: \"96c2bbfa-865c-498d-9133-ad725c18b7bf\") " pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:51.961497 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.961451    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2njxc"]
Sep 11 21:31:51.964344 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:31:51.964307    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c7b2cc_2002_4017_abc7_48c1210d57d4.slice/crio-1bc713bcb84f1153066952fe42ec3172cf686e4a814e3ac4ca5da2917aa0e90d WatchSource:0}: Error finding container 1bc713bcb84f1153066952fe42ec3172cf686e4a814e3ac4ca5da2917aa0e90d: Status 404 returned error can't find the container with id 1bc713bcb84f1153066952fe42ec3172cf686e4a814e3ac4ca5da2917aa0e90d
Sep 11 21:31:51.975385 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.975370    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wxgvf\""
Sep 11 21:31:51.983672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:51.983655    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:52.057125 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:52.057098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:31:52.057274 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:52.057256    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 21:31:52.057340 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:52.057330    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls podName:37d16b56-27f1-401b-a3f4-a389d0c47db2 nodeName:}" failed. No retries permitted until 2026-09-11 21:32:24.057310184 +0000 UTC m=+98.714873929 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls") pod "dns-default-qvtpj" (UID: "37d16b56-27f1-401b-a3f4-a389d0c47db2") : secret "dns-default-metrics-tls" not found
Sep 11 21:31:52.159184 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:52.159156    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2njxc" event={"ID":"c5c7b2cc-2002-4017-abc7-48c1210d57d4","Type":"ContainerStarted","Data":"1bc713bcb84f1153066952fe42ec3172cf686e4a814e3ac4ca5da2917aa0e90d"}
Sep 11 21:31:52.249872 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:52.249815    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fdwb9"]
Sep 11 21:31:52.252283 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:31:52.252261    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c2bbfa_865c_498d_9133_ad725c18b7bf.slice/crio-d9a813376c3595e3e784ce1902826ead4241aa107410de0f40215fb7b1555364 WatchSource:0}: Error finding container d9a813376c3595e3e784ce1902826ead4241aa107410de0f40215fb7b1555364: Status 404 returned error can't find the container with id d9a813376c3595e3e784ce1902826ead4241aa107410de0f40215fb7b1555364
Sep 11 21:31:52.965223 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:52.965184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:31:52.965667 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:52.965343    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 21:31:52.965667 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:52.965358    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p: secret "image-registry-tls" not found
Sep 11 21:31:52.965667 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:52.965410    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls podName:00e2c510-c4df-4cbb-b060-c1d838c1af8e nodeName:}" failed. No retries permitted until 2026-09-11 21:32:08.965392778 +0000 UTC m=+83.622956539 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls") pod "image-registry-6bcd4cf6bf-t2r6p" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e") : secret "image-registry-tls" not found
Sep 11 21:31:53.164915 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:53.164874    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fdwb9" event={"ID":"96c2bbfa-865c-498d-9133-ad725c18b7bf","Type":"ContainerStarted","Data":"d9a813376c3595e3e784ce1902826ead4241aa107410de0f40215fb7b1555364"}
Sep 11 21:31:57.179570 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:57.179526    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2njxc" event={"ID":"c5c7b2cc-2002-4017-abc7-48c1210d57d4","Type":"ContainerStarted","Data":"eaec6ed8a4228763f36c71e996a8113aeddbbeb99bed099298aecf3f4a1f0378"}
Sep 11 21:31:57.181116 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:57.181087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fdwb9" event={"ID":"96c2bbfa-865c-498d-9133-ad725c18b7bf","Type":"ContainerStarted","Data":"ce1df36ca70fb6a7f1c0f30668cfc1fced3531c60e0f3c182d7e1c8a2731f6e7"}
Sep 11 21:31:57.181342 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:57.181225    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:31:57.196255 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:57.196212    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2njxc" podStartSLOduration=66.374597412 podStartE2EDuration="1m11.196198302s" totalImagesPullingTime="4.82160089s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:57.195345666 +0000 UTC m=+71.852909431" watchObservedRunningTime="2026-09-11 21:31:57.196198302 +0000 UTC m=+71.853762066"
Sep 11 21:31:57.212820 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:57.212772    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fdwb9" podStartSLOduration=66.678991295 podStartE2EDuration="1m11.212759097s" totalImagesPullingTime="4.533767802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:31:57.211255763 +0000 UTC m=+71.868819539" watchObservedRunningTime="2026-09-11 21:31:57.212759097 +0000 UTC m=+71.870322877"
Sep 11 21:31:58.407518 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:58.407484    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:58.407930 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:58.407547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:31:58.407930 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:58.407628    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:58.407930 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:31:58.407705    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls podName:7d3e45c2-175b-4a26-a246-d234a868430c nodeName:}" failed. No retries permitted until 2026-09-11 21:32:14.407687215 +0000 UTC m=+89.065250961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-8dg6h" (UID: "7d3e45c2-175b-4a26-a246-d234a868430c") : secret "insights-runtime-extractor-tls" not found
Sep 11 21:31:58.408193 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:31:58.408175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d3e45c2-175b-4a26-a246-d234a868430c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:32:01.754722 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:01.754687    2577 scope.go:117] "RemoveContainer" containerID="0a6fe8bf89e44cad935d4c50fdad0f53be7808aa5bd675ab0e3c76803efb0ee3"
Sep 11 21:32:02.200140 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:02.200112    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:32:02.200290 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:02.200161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-68j49" event={"ID":"5db6f14e-085e-4e88-8478-9fcd12a4ada3","Type":"ContainerStarted","Data":"8af19722c464bd54ddae8303dd73caa689edaa43705868a419ee282e94ecc0f6"}
Sep 11 21:32:02.200511 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:02.200484    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:32:02.218625 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:02.218584    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-68j49" podStartSLOduration=22.769095764 podStartE2EDuration="25.218571709s" totalImagesPullingTime="2.449475945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:02.217974336 +0000 UTC m=+76.875538100" watchObservedRunningTime="2026-09-11 21:32:02.218571709 +0000 UTC m=+76.876135473"
Sep 11 21:32:03.039380 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:03.039355    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-68j49"
Sep 11 21:32:08.959018 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:08.958907    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"]
Sep 11 21:32:08.959381 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:32:08.959095    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p" podUID="00e2c510-c4df-4cbb-b060-c1d838c1af8e"
Sep 11 21:32:08.984049 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:08.984024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:32:08.986581 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:08.986566    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"image-registry-6bcd4cf6bf-t2r6p\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") " pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:32:09.073951 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.073925    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-fm7wj"]
Sep 11 21:32:09.076565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.076529    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-fm7wj"
Sep 11 21:32:09.077327 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.077307    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b4f9b6787-nfmhg"]
Sep 11 21:32:09.078841 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.078821    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.079540 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.079520    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 21:32:09.079803 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.079789    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 21:32:09.081892 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.081868    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-l6mb7\""
Sep 11 21:32:09.091117 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.091095    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-fm7wj"]
Sep 11 21:32:09.093678 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.093657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4f9b6787-nfmhg"]
Sep 11 21:32:09.185130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.185100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-bound-sa-token\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.185130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.185133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jjjf\" (UniqueName: \"kubernetes.io/projected/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-kube-api-access-6jjjf\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.185320 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.185151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-image-registry-private-configuration\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.185320 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.185172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-registry-certificates\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.185320 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.185279    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-registry-tls\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.185320 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.185307    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-ca-trust-extracted\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.185554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.185361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l85kk\" (UniqueName: \"kubernetes.io/projected/77d36878-31ac-4fa1-93f8-208f7b5b7be5-kube-api-access-l85kk\") pod \"downloads-76f99584f4-fm7wj\" (UID: \"77d36878-31ac-4fa1-93f8-208f7b5b7be5\") " pod="openshift-console/downloads-76f99584f4-fm7wj"
Sep 11 21:32:09.185554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.185425    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-trusted-ca\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.185554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.185451    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-installation-pull-secrets\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.220370 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.220317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:32:09.225532 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.225515    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:32:09.286365 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286340    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00e2c510-c4df-4cbb-b060-c1d838c1af8e-ca-trust-extracted\") pod \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") "
Sep 11 21:32:09.286365 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286366    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-image-registry-private-configuration\") pod \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") "
Sep 11 21:32:09.286527 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286384    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-installation-pull-secrets\") pod \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") "
Sep 11 21:32:09.286527 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286414    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-bound-sa-token\") pod \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") "
Sep 11 21:32:09.286527 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286487    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22w5l\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-kube-api-access-22w5l\") pod \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") "
Sep 11 21:32:09.286641 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286533    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-certificates\") pod \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") "
Sep 11 21:32:09.286641 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286566    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-trusted-ca\") pod \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") "
Sep 11 21:32:09.286641 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286590    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") pod \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\" (UID: \"00e2c510-c4df-4cbb-b060-c1d838c1af8e\") "
Sep 11 21:32:09.286805 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286641    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00e2c510-c4df-4cbb-b060-c1d838c1af8e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "00e2c510-c4df-4cbb-b060-c1d838c1af8e" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:32:09.286805 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286701    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-trusted-ca\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.286805 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-installation-pull-secrets\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.286805 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-bound-sa-token\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.286805 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jjjf\" (UniqueName: \"kubernetes.io/projected/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-kube-api-access-6jjjf\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.287057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-image-registry-private-configuration\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.287057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-registry-certificates\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.287057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286938    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "00e2c510-c4df-4cbb-b060-c1d838c1af8e" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:32:09.287057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-registry-tls\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.287057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286997    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-ca-trust-extracted\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.287057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.286992    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "00e2c510-c4df-4cbb-b060-c1d838c1af8e" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:32:09.287057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.287044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l85kk\" (UniqueName: \"kubernetes.io/projected/77d36878-31ac-4fa1-93f8-208f7b5b7be5-kube-api-access-l85kk\") pod \"downloads-76f99584f4-fm7wj\" (UID: \"77d36878-31ac-4fa1-93f8-208f7b5b7be5\") " pod="openshift-console/downloads-76f99584f4-fm7wj"
Sep 11 21:32:09.287400 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.287086    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-certificates\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:32:09.287400 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.287102    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/00e2c510-c4df-4cbb-b060-c1d838c1af8e-trusted-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:32:09.287400 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.287116    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/00e2c510-c4df-4cbb-b060-c1d838c1af8e-ca-trust-extracted\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:32:09.287400 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.287292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-ca-trust-extracted\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.288303 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.287938    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-trusted-ca\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.289017 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.288984    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-registry-certificates\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.289690 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.289663    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "00e2c510-c4df-4cbb-b060-c1d838c1af8e" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:32:09.290229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.290205    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-installation-pull-secrets\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.290345 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.290324    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "00e2c510-c4df-4cbb-b060-c1d838c1af8e" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:32:09.290394 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.290344    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-kube-api-access-22w5l" (OuterVolumeSpecName: "kube-api-access-22w5l") pod "00e2c510-c4df-4cbb-b060-c1d838c1af8e" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e"). InnerVolumeSpecName "kube-api-access-22w5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:32:09.290446 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.290423    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "00e2c510-c4df-4cbb-b060-c1d838c1af8e" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:32:09.290446 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.290432    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "00e2c510-c4df-4cbb-b060-c1d838c1af8e" (UID: "00e2c510-c4df-4cbb-b060-c1d838c1af8e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:32:09.290990 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.290972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-registry-tls\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.291144 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.291125    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-image-registry-private-configuration\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.295736 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.295704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l85kk\" (UniqueName: \"kubernetes.io/projected/77d36878-31ac-4fa1-93f8-208f7b5b7be5-kube-api-access-l85kk\") pod \"downloads-76f99584f4-fm7wj\" (UID: \"77d36878-31ac-4fa1-93f8-208f7b5b7be5\") " pod="openshift-console/downloads-76f99584f4-fm7wj"
Sep 11 21:32:09.295971 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.295949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-bound-sa-token\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.297376 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.297355    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jjjf\" (UniqueName: \"kubernetes.io/projected/ce310f77-4a97-4b8a-bdfb-390c9d741ffd-kube-api-access-6jjjf\") pod \"image-registry-b4f9b6787-nfmhg\" (UID: \"ce310f77-4a97-4b8a-bdfb-390c9d741ffd\") " pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.387175 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.387141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-fm7wj"
Sep 11 21:32:09.387459 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.387440    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-image-registry-private-configuration\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:32:09.387565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.387491    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/00e2c510-c4df-4cbb-b060-c1d838c1af8e-installation-pull-secrets\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:32:09.387565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.387507    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-bound-sa-token\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:32:09.387565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.387520    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22w5l\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-kube-api-access-22w5l\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:32:09.387565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.387533    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/00e2c510-c4df-4cbb-b060-c1d838c1af8e-registry-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:32:09.395203 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.395183    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5txcp\""
Sep 11 21:32:09.403412 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.403391    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:09.660533 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.660438    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-fm7wj"]
Sep 11 21:32:09.664861 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:09.664827    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d36878_31ac_4fa1_93f8_208f7b5b7be5.slice/crio-7eb9e4917a03b199cdaa0bf7ec31d46673be71891f3cc0e992495d23e307b913 WatchSource:0}: Error finding container 7eb9e4917a03b199cdaa0bf7ec31d46673be71891f3cc0e992495d23e307b913: Status 404 returned error can't find the container with id 7eb9e4917a03b199cdaa0bf7ec31d46673be71891f3cc0e992495d23e307b913
Sep 11 21:32:09.683093 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:09.683072    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b4f9b6787-nfmhg"]
Sep 11 21:32:09.685657 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:09.685634    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce310f77_4a97_4b8a_bdfb_390c9d741ffd.slice/crio-0ebbf890005d76bb063bbe084cd5e382bf698ef1e39ad8f680f2cb97f0af1600 WatchSource:0}: Error finding container 0ebbf890005d76bb063bbe084cd5e382bf698ef1e39ad8f680f2cb97f0af1600: Status 404 returned error can't find the container with id 0ebbf890005d76bb063bbe084cd5e382bf698ef1e39ad8f680f2cb97f0af1600
Sep 11 21:32:10.226520 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:10.226479    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-fm7wj" event={"ID":"77d36878-31ac-4fa1-93f8-208f7b5b7be5","Type":"ContainerStarted","Data":"7eb9e4917a03b199cdaa0bf7ec31d46673be71891f3cc0e992495d23e307b913"}
Sep 11 21:32:10.228258 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:10.228231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"
Sep 11 21:32:10.228386 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:10.228265    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg" event={"ID":"ce310f77-4a97-4b8a-bdfb-390c9d741ffd","Type":"ContainerStarted","Data":"839f839dfd84e0314b7a66a3a8b843b38f21a193cf1b0710aa29bfd3630198c2"}
Sep 11 21:32:10.228386 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:10.228305    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg" event={"ID":"ce310f77-4a97-4b8a-bdfb-390c9d741ffd","Type":"ContainerStarted","Data":"0ebbf890005d76bb063bbe084cd5e382bf698ef1e39ad8f680f2cb97f0af1600"}
Sep 11 21:32:10.249368 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:10.249319    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg" podStartSLOduration=1.249305558 podStartE2EDuration="1.249305558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:10.247126138 +0000 UTC m=+84.904689901" watchObservedRunningTime="2026-09-11 21:32:10.249305558 +0000 UTC m=+84.906869321"
Sep 11 21:32:10.280991 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:10.280962    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"]
Sep 11 21:32:10.285681 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:10.285655    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bcd4cf6bf-t2r6p"]
Sep 11 21:32:11.232784 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:11.232752    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:11.759014 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:11.758985    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00e2c510-c4df-4cbb-b060-c1d838c1af8e" path="/var/lib/kubelet/pods/00e2c510-c4df-4cbb-b060-c1d838c1af8e/volumes"
Sep 11 21:32:12.729748 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.729714    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f78448869-c29tc"]
Sep 11 21:32:12.732519 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.732492    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.734959 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.734934    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 21:32:12.735160 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.735136    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 21:32:12.736459 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.736437    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 21:32:12.736576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.736522    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 21:32:12.736576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.736557    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 21:32:12.736884 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.736866    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jg727\""
Sep 11 21:32:12.741684 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.741665    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 21:32:12.743577 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.743555    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f78448869-c29tc"]
Sep 11 21:32:12.815417 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.815385    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-oauth-config\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.815587 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.815422    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-oauth-serving-cert\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.815587 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.815559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-serving-cert\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.815699 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.815606    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf2rr\" (UniqueName: \"kubernetes.io/projected/eafeb950-5de6-40bc-9f20-6a8d8b49f571-kube-api-access-wf2rr\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.815786 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.815764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-service-ca\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.815911 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.815810    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-config\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.815911 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.815862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-trusted-ca-bundle\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.916778 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.916740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-trusted-ca-bundle\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.916986 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.916833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-oauth-config\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.916986 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.916869    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-oauth-serving-cert\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.916986 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.916926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-serving-cert\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.916986 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.916960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf2rr\" (UniqueName: \"kubernetes.io/projected/eafeb950-5de6-40bc-9f20-6a8d8b49f571-kube-api-access-wf2rr\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.917197 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.917006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-service-ca\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.917197 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.917034    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-config\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.917796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.917747    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-service-ca\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.917796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.917761    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-config\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.917796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.917761    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-oauth-serving-cert\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.918065 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.918044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-trusted-ca-bundle\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.919811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.919785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-oauth-config\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.920047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.920025    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-serving-cert\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:12.926016 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:12.925973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf2rr\" (UniqueName: \"kubernetes.io/projected/eafeb950-5de6-40bc-9f20-6a8d8b49f571-kube-api-access-wf2rr\") pod \"console-6f78448869-c29tc\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") " pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:13.043620 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:13.043546    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:13.337629 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:13.337604    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f78448869-c29tc"]
Sep 11 21:32:13.340006 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:13.339976    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeafeb950_5de6_40bc_9f20_6a8d8b49f571.slice/crio-0ce8000eb8c969daabdbe5b6ff2a250659b6b23bbec2066194baaa2fd4f1fa57 WatchSource:0}: Error finding container 0ce8000eb8c969daabdbe5b6ff2a250659b6b23bbec2066194baaa2fd4f1fa57: Status 404 returned error can't find the container with id 0ce8000eb8c969daabdbe5b6ff2a250659b6b23bbec2066194baaa2fd4f1fa57
Sep 11 21:32:14.246568 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:14.246518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f78448869-c29tc" event={"ID":"eafeb950-5de6-40bc-9f20-6a8d8b49f571","Type":"ContainerStarted","Data":"0ce8000eb8c969daabdbe5b6ff2a250659b6b23bbec2066194baaa2fd4f1fa57"}
Sep 11 21:32:14.443759 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:14.443714    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:32:14.447749 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:14.447693    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d3e45c2-175b-4a26-a246-d234a868430c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8dg6h\" (UID: \"7d3e45c2-175b-4a26-a246-d234a868430c\") " pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:32:14.611592 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:14.611518    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hpqdp\""
Sep 11 21:32:14.619870 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:14.619841    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8dg6h"
Sep 11 21:32:14.909057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:14.908915    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8dg6h"]
Sep 11 21:32:14.912454 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:14.912421    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3e45c2_175b_4a26_a246_d234a868430c.slice/crio-f502845fbcd466e0dbf3577112b5d2e748f8103d0419f0a79242123b404973de WatchSource:0}: Error finding container f502845fbcd466e0dbf3577112b5d2e748f8103d0419f0a79242123b404973de: Status 404 returned error can't find the container with id f502845fbcd466e0dbf3577112b5d2e748f8103d0419f0a79242123b404973de
Sep 11 21:32:15.252840 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:15.252794    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dg6h" event={"ID":"7d3e45c2-175b-4a26-a246-d234a868430c","Type":"ContainerStarted","Data":"60693126ca10ce59dcb5af5f7d3b98dcf001dd613ef5dda199d6814abbb7e4f6"}
Sep 11 21:32:15.253295 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:15.252915    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dg6h" event={"ID":"7d3e45c2-175b-4a26-a246-d234a868430c","Type":"ContainerStarted","Data":"f502845fbcd466e0dbf3577112b5d2e748f8103d0419f0a79242123b404973de"}
Sep 11 21:32:17.263070 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:17.263031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f78448869-c29tc" event={"ID":"eafeb950-5de6-40bc-9f20-6a8d8b49f571","Type":"ContainerStarted","Data":"95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf"}
Sep 11 21:32:17.265356 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:17.265326    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dg6h" event={"ID":"7d3e45c2-175b-4a26-a246-d234a868430c","Type":"ContainerStarted","Data":"920959ba89faa316e85a458cd73394f576a7ce7b349e85c781e5ab360e6b9668"}
Sep 11 21:32:17.286941 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:17.286888    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f78448869-c29tc" podStartSLOduration=2.313403473 podStartE2EDuration="5.28686956s" totalImagesPullingTime="2.973466087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:17.284569687 +0000 UTC m=+91.942133452" watchObservedRunningTime="2026-09-11 21:32:17.28686956 +0000 UTC m=+91.944433324"
Sep 11 21:32:18.272438 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:18.272404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8dg6h" event={"ID":"7d3e45c2-175b-4a26-a246-d234a868430c","Type":"ContainerStarted","Data":"39203cdd2cf4221f8da889cb8ca2ab196ee0cf53f2077d0e19fbada6881516cd"}
Sep 11 21:32:18.303666 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:18.303611    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8dg6h" podStartSLOduration=33.451363454 podStartE2EDuration="36.30359096s" totalImagesPullingTime="2.852227506s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 21:31:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:18.302271249 +0000 UTC m=+92.959835027" watchObservedRunningTime="2026-09-11 21:32:18.30359096 +0000 UTC m=+92.961154725"
Sep 11 21:32:23.043669 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:23.043620    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:23.044137 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:23.043709    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:23.045272 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:23.045247    2577 patch_prober.go:28] interesting pod/console-6f78448869-c29tc container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body=
Sep 11 21:32:23.045391 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:23.045301    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6f78448869-c29tc" podUID="eafeb950-5de6-40bc-9f20-6a8d8b49f571" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused"
Sep 11 21:32:24.128968 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.128918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:32:24.131769 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.131745    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/37d16b56-27f1-401b-a3f4-a389d0c47db2-metrics-tls\") pod \"dns-default-qvtpj\" (UID: \"37d16b56-27f1-401b-a3f4-a389d0c47db2\") " pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:32:24.260761 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.260727    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"]
Sep 11 21:32:24.265648 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.265628    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.268194 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.268170    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 11 21:32:24.268713 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.268692    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 21:32:24.269410 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.269390    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 21:32:24.269695 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.269679    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 21:32:24.269695 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.269686    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 11 21:32:24.269845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.269706    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-lslt8\""
Sep 11 21:32:24.274646 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.274627    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"]
Sep 11 21:32:24.282294 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.282273    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"]
Sep 11 21:32:24.287269 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.287243    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.290270 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.290253    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-rrkwp\""
Sep 11 21:32:24.292125 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.292108    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 11 21:32:24.292995 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.292979    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 11 21:32:24.293092 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.293047    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 11 21:32:24.317526 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.317504    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"]
Sep 11 21:32:24.362267 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.362245    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vjdvw"]
Sep 11 21:32:24.365630 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.365613    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.369445 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.369425    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 21:32:24.369565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.369427    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 21:32:24.369565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.369510    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 21:32:24.369829 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.369792    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b8zbj\""
Sep 11 21:32:24.383976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.383930    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59g8b\""
Sep 11 21:32:24.391412 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.391396    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:32:24.431378 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4cqj\" (UniqueName: \"kubernetes.io/projected/e12c8cad-9f43-4741-9851-a45bd620459c-kube-api-access-r4cqj\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.431501 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqf4k\" (UniqueName: \"kubernetes.io/projected/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-api-access-dqf4k\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.431559 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e12c8cad-9f43-4741-9851-a45bd620459c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.431559 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12c8cad-9f43-4741-9851-a45bd620459c-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.431665 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e12c8cad-9f43-4741-9851-a45bd620459c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.431665 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.431665 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.431757 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b29c9789-741d-4b48-9c86-cc8101209e2d-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.431757 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431725    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.431839 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.431760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b29c9789-741d-4b48-9c86-cc8101209e2d-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.532529 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e12c8cad-9f43-4741-9851-a45bd620459c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.532529 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.532769 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:32:24.532652    2577 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 11 21:32:24.532769 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.532769 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.532769 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:32:24.532732    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e12c8cad-9f43-4741-9851-a45bd620459c-openshift-state-metrics-tls podName:e12c8cad-9f43-4741-9851-a45bd620459c nodeName:}" failed. No retries permitted until 2026-09-11 21:32:25.032716062 +0000 UTC m=+99.690279817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e12c8cad-9f43-4741-9851-a45bd620459c-openshift-state-metrics-tls") pod "openshift-state-metrics-67dcf8c979-sfrbk" (UID: "e12c8cad-9f43-4741-9851-a45bd620459c") : secret "openshift-state-metrics-tls" not found
Sep 11 21:32:24.532769 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.533053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57c8e7a-638e-418f-abc9-b8fba855151a-metrics-client-ca\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.533053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532807    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-899l7\" (UniqueName: \"kubernetes.io/projected/d57c8e7a-638e-418f-abc9-b8fba855151a-kube-api-access-899l7\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.533053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d57c8e7a-638e-418f-abc9-b8fba855151a-sys\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.533053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-tls\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.533053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-wtmp\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.533053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532921    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b29c9789-741d-4b48-9c86-cc8101209e2d-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.533053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.533053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.532990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b29c9789-741d-4b48-9c86-cc8101209e2d-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.533053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.533029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4cqj\" (UniqueName: \"kubernetes.io/projected/e12c8cad-9f43-4741-9851-a45bd620459c-kube-api-access-r4cqj\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.533427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.533201    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqf4k\" (UniqueName: \"kubernetes.io/projected/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-api-access-dqf4k\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.533427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.533230    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-textfile\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.533427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.533383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e12c8cad-9f43-4741-9851-a45bd620459c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.533427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.533415    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12c8cad-9f43-4741-9851-a45bd620459c-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.533604 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.533441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d57c8e7a-638e-418f-abc9-b8fba855151a-root\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.533791 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.533767    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b29c9789-741d-4b48-9c86-cc8101209e2d-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.534044 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.534020    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.534134 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.534051    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b29c9789-741d-4b48-9c86-cc8101209e2d-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.534360 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.534336    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e12c8cad-9f43-4741-9851-a45bd620459c-metrics-client-ca\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.535645 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.535601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.535926 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.535896    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.536254 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.536232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e12c8cad-9f43-4741-9851-a45bd620459c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.543000 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.542977    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqf4k\" (UniqueName: \"kubernetes.io/projected/b29c9789-741d-4b48-9c86-cc8101209e2d-kube-api-access-dqf4k\") pod \"kube-state-metrics-59fbdd77d-g2bf9\" (UID: \"b29c9789-741d-4b48-9c86-cc8101209e2d\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.544288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.544265    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4cqj\" (UniqueName: \"kubernetes.io/projected/e12c8cad-9f43-4741-9851-a45bd620459c-kube-api-access-r4cqj\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:24.598392 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.598362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"
Sep 11 21:32:24.634525 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-textfile\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634525 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634514    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d57c8e7a-638e-418f-abc9-b8fba855151a-root\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634693 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634544    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634693 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634693 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d57c8e7a-638e-418f-abc9-b8fba855151a-root\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634693 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57c8e7a-638e-418f-abc9-b8fba855151a-metrics-client-ca\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634871 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-899l7\" (UniqueName: \"kubernetes.io/projected/d57c8e7a-638e-418f-abc9-b8fba855151a-kube-api-access-899l7\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634871 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d57c8e7a-638e-418f-abc9-b8fba855151a-sys\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634871 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634753    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-tls\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634871 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-wtmp\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.634871 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634831    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-textfile\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.635086 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d57c8e7a-638e-418f-abc9-b8fba855151a-sys\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.635086 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.634918    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-wtmp\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.635086 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:32:24.634982    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 21:32:24.635086 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:32:24.635039    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-tls podName:d57c8e7a-638e-418f-abc9-b8fba855151a nodeName:}" failed. No retries permitted until 2026-09-11 21:32:25.135020059 +0000 UTC m=+99.792583806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-tls") pod "node-exporter-vjdvw" (UID: "d57c8e7a-638e-418f-abc9-b8fba855151a") : secret "node-exporter-tls" not found
Sep 11 21:32:24.635250 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.635151    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-accelerators-collector-config\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.635250 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.635230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d57c8e7a-638e-418f-abc9-b8fba855151a-metrics-client-ca\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.637292 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.637262    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:24.645860 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:24.645841    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-899l7\" (UniqueName: \"kubernetes.io/projected/d57c8e7a-638e-418f-abc9-b8fba855151a-kube-api-access-899l7\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:25.039659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.039617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e12c8cad-9f43-4741-9851-a45bd620459c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:25.042497 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.042455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e12c8cad-9f43-4741-9851-a45bd620459c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-67dcf8c979-sfrbk\" (UID: \"e12c8cad-9f43-4741-9851-a45bd620459c\") " pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:25.140933 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.140892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-tls\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:25.143725 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.143705    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d57c8e7a-638e-418f-abc9-b8fba855151a-node-exporter-tls\") pod \"node-exporter-vjdvw\" (UID: \"d57c8e7a-638e-418f-abc9-b8fba855151a\") " pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:25.176865 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.176833    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"
Sep 11 21:32:25.276803 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.276775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vjdvw"
Sep 11 21:32:25.379935 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.379900    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:32:25.393690 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.393662    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.396938 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.396903    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 11 21:32:25.397051 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.396958    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 11 21:32:25.397194 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.397178    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 11 21:32:25.397279 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.397265    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 11 21:32:25.397844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.397419    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:32:25.397844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.397446    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 11 21:32:25.397844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.397500    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zznqs\""
Sep 11 21:32:25.397844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.397576    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 11 21:32:25.397844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.397578    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 11 21:32:25.397844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.397677    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 11 21:32:25.397844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.397737    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 11 21:32:25.544702 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.544673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caa3930e-2cef-45cf-85db-91c1e2feca7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.544702 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.544703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.544943 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.544722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa3930e-2cef-45cf-85db-91c1e2feca7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.544943 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.544748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.544943 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.544773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.544943 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.544871    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.544943 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.544930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.545162 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.544954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caa3930e-2cef-45cf-85db-91c1e2feca7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.545162 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.544991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.545162 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.545015    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caa3930e-2cef-45cf-85db-91c1e2feca7b-config-out\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.545162 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.545052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa3930e-2cef-45cf-85db-91c1e2feca7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.545162 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.545081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj9wc\" (UniqueName: \"kubernetes.io/projected/caa3930e-2cef-45cf-85db-91c1e2feca7b-kube-api-access-gj9wc\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.545162 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.545111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-web-config\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.645684 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645601    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caa3930e-2cef-45cf-85db-91c1e2feca7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.645684 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645648    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.645684 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa3930e-2cef-45cf-85db-91c1e2feca7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.645973 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.645973 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.645973 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.645973 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645809    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.645973 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caa3930e-2cef-45cf-85db-91c1e2feca7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.645973 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645959    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.646266 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.645984    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caa3930e-2cef-45cf-85db-91c1e2feca7b-config-out\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.646266 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.646012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa3930e-2cef-45cf-85db-91c1e2feca7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.646266 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.646041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj9wc\" (UniqueName: \"kubernetes.io/projected/caa3930e-2cef-45cf-85db-91c1e2feca7b-kube-api-access-gj9wc\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.646266 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.646084    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-web-config\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.647843 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.647463    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caa3930e-2cef-45cf-85db-91c1e2feca7b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.647843 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.647498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/caa3930e-2cef-45cf-85db-91c1e2feca7b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.647843 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.647790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/caa3930e-2cef-45cf-85db-91c1e2feca7b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.649390 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.649361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.650874 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.650850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/caa3930e-2cef-45cf-85db-91c1e2feca7b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.651306 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.651040    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-web-config\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.651306 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.651081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.651306 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.651257    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.651306 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.651271    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.651586 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.651314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-config-volume\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.651891 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.651866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/caa3930e-2cef-45cf-85db-91c1e2feca7b-config-out\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.651994 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.651958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/caa3930e-2cef-45cf-85db-91c1e2feca7b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.655391 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.655366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj9wc\" (UniqueName: \"kubernetes.io/projected/caa3930e-2cef-45cf-85db-91c1e2feca7b-kube-api-access-gj9wc\") pod \"alertmanager-main-0\" (UID: \"caa3930e-2cef-45cf-85db-91c1e2feca7b\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:25.706249 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:25.706221    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 11 21:32:26.303815 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:26.303781    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjdvw" event={"ID":"d57c8e7a-638e-418f-abc9-b8fba855151a","Type":"ContainerStarted","Data":"3c4a5607bfa9eb508b62abaf27612657ba87b9e13456b805b1308a123532fdde"}
Sep 11 21:32:26.444402 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:26.444370    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qvtpj"]
Sep 11 21:32:26.448567 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:26.448544    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 11 21:32:26.449934 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:26.449885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9"]
Sep 11 21:32:26.461996 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:26.461926    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk"]
Sep 11 21:32:26.465243 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:26.465219    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37d16b56_27f1_401b_a3f4_a389d0c47db2.slice/crio-6d969b6afc9f75c78f4ce07c8f5938498cecd2f55fa823c56c056b08f200bc05 WatchSource:0}: Error finding container 6d969b6afc9f75c78f4ce07c8f5938498cecd2f55fa823c56c056b08f200bc05: Status 404 returned error can't find the container with id 6d969b6afc9f75c78f4ce07c8f5938498cecd2f55fa823c56c056b08f200bc05
Sep 11 21:32:26.465980 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:26.465964    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa3930e_2cef_45cf_85db_91c1e2feca7b.slice/crio-bd9f24f2d6d01f7d96ddd6ed81dd9314ea33b4e7ed5740bef3305cb671391b66 WatchSource:0}: Error finding container bd9f24f2d6d01f7d96ddd6ed81dd9314ea33b4e7ed5740bef3305cb671391b66: Status 404 returned error can't find the container with id bd9f24f2d6d01f7d96ddd6ed81dd9314ea33b4e7ed5740bef3305cb671391b66
Sep 11 21:32:26.467721 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:26.467697    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb29c9789_741d_4b48_9c86_cc8101209e2d.slice/crio-1f87a02542e4c9e955b1430544af1b502aa0d7c27bbaca7e867eb3b2b117e683 WatchSource:0}: Error finding container 1f87a02542e4c9e955b1430544af1b502aa0d7c27bbaca7e867eb3b2b117e683: Status 404 returned error can't find the container with id 1f87a02542e4c9e955b1430544af1b502aa0d7c27bbaca7e867eb3b2b117e683
Sep 11 21:32:26.468053 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:26.467991    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode12c8cad_9f43_4741_9851_a45bd620459c.slice/crio-f823ddb3409cd011efc9ca361522bd0d3fec2fc3fa14565c1c7a1192503d161e WatchSource:0}: Error finding container f823ddb3409cd011efc9ca361522bd0d3fec2fc3fa14565c1c7a1192503d161e: Status 404 returned error can't find the container with id f823ddb3409cd011efc9ca361522bd0d3fec2fc3fa14565c1c7a1192503d161e
Sep 11 21:32:27.311202 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.311115    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9" event={"ID":"b29c9789-741d-4b48-9c86-cc8101209e2d","Type":"ContainerStarted","Data":"1f87a02542e4c9e955b1430544af1b502aa0d7c27bbaca7e867eb3b2b117e683"}
Sep 11 21:32:27.313227 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.313170    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-fm7wj" event={"ID":"77d36878-31ac-4fa1-93f8-208f7b5b7be5","Type":"ContainerStarted","Data":"92b075af1b18d8b44f10bbddd5930310015538616052dab772144648c9c563b5"}
Sep 11 21:32:27.313742 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.313706    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-fm7wj"
Sep 11 21:32:27.315555 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.315435    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvtpj" event={"ID":"37d16b56-27f1-401b-a3f4-a389d0c47db2","Type":"ContainerStarted","Data":"6d969b6afc9f75c78f4ce07c8f5938498cecd2f55fa823c56c056b08f200bc05"}
Sep 11 21:32:27.317981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.317901    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk" event={"ID":"e12c8cad-9f43-4741-9851-a45bd620459c","Type":"ContainerStarted","Data":"386f4fde53d2a13c9d09aaaa70c73d0bad44d82b9f6198f263f454c9bba07ce6"}
Sep 11 21:32:27.317981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.317953    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk" event={"ID":"e12c8cad-9f43-4741-9851-a45bd620459c","Type":"ContainerStarted","Data":"37a19330d0007408183ccd6adae617bfc62ceedc02b9046d56425bbe2ab31bce"}
Sep 11 21:32:27.318102 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.317985    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk" event={"ID":"e12c8cad-9f43-4741-9851-a45bd620459c","Type":"ContainerStarted","Data":"f823ddb3409cd011efc9ca361522bd0d3fec2fc3fa14565c1c7a1192503d161e"}
Sep 11 21:32:27.319316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.319290    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa3930e-2cef-45cf-85db-91c1e2feca7b","Type":"ContainerStarted","Data":"bd9f24f2d6d01f7d96ddd6ed81dd9314ea33b4e7ed5740bef3305cb671391b66"}
Sep 11 21:32:27.326217 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.326193    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-fm7wj"
Sep 11 21:32:27.334040 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:27.333993    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-fm7wj" podStartSLOduration=1.460189027 podStartE2EDuration="18.333978224s" totalImagesPullingTime="16.873789197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:27.332459115 +0000 UTC m=+101.990022891" watchObservedRunningTime="2026-09-11 21:32:27.333978224 +0000 UTC m=+101.991541988"
Sep 11 21:32:28.193584 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.193551    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fdwb9"
Sep 11 21:32:28.328365 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.328226    2577 generic.go:356] "Generic (PLEG): container finished" podID="d57c8e7a-638e-418f-abc9-b8fba855151a" containerID="88488a98341eb8e6bd0ce3c40f347943260393cbe94702ee1c9e4e1172b0939b" exitCode=0
Sep 11 21:32:28.329711 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.329446    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjdvw" event={"ID":"d57c8e7a-638e-418f-abc9-b8fba855151a","Type":"ContainerDied","Data":"88488a98341eb8e6bd0ce3c40f347943260393cbe94702ee1c9e4e1172b0939b"}
Sep 11 21:32:28.668048 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.666586    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"]
Sep 11 21:32:28.685228 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.685057    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"]
Sep 11 21:32:28.685500 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.685216    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.689364 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.689032    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 11 21:32:28.689364 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.689316    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 11 21:32:28.690035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.689629    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7ejpn750cgjfm\""
Sep 11 21:32:28.690035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.689734    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 11 21:32:28.690035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.689810    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 11 21:32:28.690035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.689949    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-h97r9\""
Sep 11 21:32:28.781792 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.781756    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f90d420-5199-4a9c-b3a4-08356b049c3a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.781972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.781799    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6f90d420-5199-4a9c-b3a4-08356b049c3a-audit-log\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.781972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.781836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6f90d420-5199-4a9c-b3a4-08356b049c3a-metrics-server-audit-profiles\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.781972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.781858    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6f90d420-5199-4a9c-b3a4-08356b049c3a-secret-metrics-server-client-certs\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.781972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.781959    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6f90d420-5199-4a9c-b3a4-08356b049c3a-secret-metrics-server-tls\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.782183 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.782039    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l28qv\" (UniqueName: \"kubernetes.io/projected/6f90d420-5199-4a9c-b3a4-08356b049c3a-kube-api-access-l28qv\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.782183 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.782112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f90d420-5199-4a9c-b3a4-08356b049c3a-client-ca-bundle\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.884502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.883373    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6f90d420-5199-4a9c-b3a4-08356b049c3a-secret-metrics-server-tls\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.884502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.883445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l28qv\" (UniqueName: \"kubernetes.io/projected/6f90d420-5199-4a9c-b3a4-08356b049c3a-kube-api-access-l28qv\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.884502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.883535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f90d420-5199-4a9c-b3a4-08356b049c3a-client-ca-bundle\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.884502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.883569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f90d420-5199-4a9c-b3a4-08356b049c3a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.884502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.883596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6f90d420-5199-4a9c-b3a4-08356b049c3a-audit-log\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.884502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.883631    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6f90d420-5199-4a9c-b3a4-08356b049c3a-metrics-server-audit-profiles\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.884502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.883656    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6f90d420-5199-4a9c-b3a4-08356b049c3a-secret-metrics-server-client-certs\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.884502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.884422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6f90d420-5199-4a9c-b3a4-08356b049c3a-audit-log\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.885044 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.884948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f90d420-5199-4a9c-b3a4-08356b049c3a-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.886207 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.886161    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6f90d420-5199-4a9c-b3a4-08356b049c3a-metrics-server-audit-profiles\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.887696 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.887639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6f90d420-5199-4a9c-b3a4-08356b049c3a-secret-metrics-server-tls\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.887796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.887719    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6f90d420-5199-4a9c-b3a4-08356b049c3a-client-ca-bundle\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.887960 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.887940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6f90d420-5199-4a9c-b3a4-08356b049c3a-secret-metrics-server-client-certs\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:28.903856 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:28.903829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l28qv\" (UniqueName: \"kubernetes.io/projected/6f90d420-5199-4a9c-b3a4-08356b049c3a-kube-api-access-l28qv\") pod \"metrics-server-5bd5645c6d-7ftm2\" (UID: \"6f90d420-5199-4a9c-b3a4-08356b049c3a\") " pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:29.000304 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.000225    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:29.076977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.076946    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"]
Sep 11 21:32:29.089839 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.088303    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:29.089839 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.089381    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"]
Sep 11 21:32:29.092770 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.091550    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-vmhgv\""
Sep 11 21:32:29.092770 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.091569    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 11 21:32:29.181575 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.181535    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6944bb8b8b-rr5th"]
Sep 11 21:32:29.185596 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.185567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qzkg\" (UniqueName: \"kubernetes.io/projected/f06fb64c-bca1-4f19-bb00-3954239d1632-kube-api-access-7qzkg\") pod \"monitoring-plugin-5d85778b9d-dwhcx\" (UID: \"f06fb64c-bca1-4f19-bb00-3954239d1632\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:29.185738 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.185678    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f06fb64c-bca1-4f19-bb00-3954239d1632-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-dwhcx\" (UID: \"f06fb64c-bca1-4f19-bb00-3954239d1632\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:29.197862 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.197833    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6944bb8b8b-rr5th"]
Sep 11 21:32:29.197997 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.197949    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.287021 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.286930    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-serving-cert\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.287021 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.286980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qzkg\" (UniqueName: \"kubernetes.io/projected/f06fb64c-bca1-4f19-bb00-3954239d1632-kube-api-access-7qzkg\") pod \"monitoring-plugin-5d85778b9d-dwhcx\" (UID: \"f06fb64c-bca1-4f19-bb00-3954239d1632\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:29.287021 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.287018    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-trusted-ca-bundle\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.287288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.287047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-service-ca\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.287288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.287068    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rvcv\" (UniqueName: \"kubernetes.io/projected/a68d20a9-c308-4225-8292-64f41781ab99-kube-api-access-8rvcv\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.287288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.287106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-oauth-config\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.287288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.287167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f06fb64c-bca1-4f19-bb00-3954239d1632-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-dwhcx\" (UID: \"f06fb64c-bca1-4f19-bb00-3954239d1632\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:29.287288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.287213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-oauth-serving-cert\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.287288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.287239    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-console-config\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.290829 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.290780    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f06fb64c-bca1-4f19-bb00-3954239d1632-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-dwhcx\" (UID: \"f06fb64c-bca1-4f19-bb00-3954239d1632\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:29.296806 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.296781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qzkg\" (UniqueName: \"kubernetes.io/projected/f06fb64c-bca1-4f19-bb00-3954239d1632-kube-api-access-7qzkg\") pod \"monitoring-plugin-5d85778b9d-dwhcx\" (UID: \"f06fb64c-bca1-4f19-bb00-3954239d1632\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:29.388080 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.388036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-oauth-serving-cert\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.388080 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.388079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-console-config\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.388617 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.388111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-serving-cert\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.388617 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.388150    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-trusted-ca-bundle\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.388617 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.388176    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-service-ca\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.388617 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.388199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rvcv\" (UniqueName: \"kubernetes.io/projected/a68d20a9-c308-4225-8292-64f41781ab99-kube-api-access-8rvcv\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.388617 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.388253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-oauth-config\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.389407 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.389358    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-service-ca\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.389653 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.389618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-trusted-ca-bundle\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.389775 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.389671    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-oauth-serving-cert\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.389840 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.389788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-console-config\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.391169 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.391147    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-oauth-config\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.391282 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.391266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-serving-cert\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.404368 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.404351    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rvcv\" (UniqueName: \"kubernetes.io/projected/a68d20a9-c308-4225-8292-64f41781ab99-kube-api-access-8rvcv\") pod \"console-6944bb8b8b-rr5th\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") " pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:29.405316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.405294    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:29.408389 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.408368    2577 patch_prober.go:28] interesting pod/image-registry-b4f9b6787-nfmhg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 21:32:29.408508 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.408411    2577 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg" podUID="ce310f77-4a97-4b8a-bdfb-390c9d741ffd" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:32:29.510643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:29.510612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:31.288044 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.287941    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"]
Sep 11 21:32:31.298652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.298424    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"]
Sep 11 21:32:31.334197 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:31.334144    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f90d420_5199_4a9c_b3a4_08356b049c3a.slice/crio-db9cd213527ab45548f94766e2123ce5c8401a9d7384c8b32e170621037b02d9 WatchSource:0}: Error finding container db9cd213527ab45548f94766e2123ce5c8401a9d7384c8b32e170621037b02d9: Status 404 returned error can't find the container with id db9cd213527ab45548f94766e2123ce5c8401a9d7384c8b32e170621037b02d9
Sep 11 21:32:31.348583 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.348152    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6944bb8b8b-rr5th"]
Sep 11 21:32:31.388800 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.387256    2577 generic.go:356] "Generic (PLEG): container finished" podID="caa3930e-2cef-45cf-85db-91c1e2feca7b" containerID="d3605c4e5c5f9715fb8d8f859cd923528f4604b62ae327d42c0e60ea5be92148" exitCode=0
Sep 11 21:32:31.388800 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.387404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa3930e-2cef-45cf-85db-91c1e2feca7b","Type":"ContainerDied","Data":"d3605c4e5c5f9715fb8d8f859cd923528f4604b62ae327d42c0e60ea5be92148"}
Sep 11 21:32:31.410338 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.410299    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjdvw" event={"ID":"d57c8e7a-638e-418f-abc9-b8fba855151a","Type":"ContainerStarted","Data":"e68c71b2a6ac46d8b0b1a5045519f5cf1f1f5abf99e4ef7378b14b1da7ef9619"}
Sep 11 21:32:31.410461 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.410421    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vjdvw" event={"ID":"d57c8e7a-638e-418f-abc9-b8fba855151a","Type":"ContainerStarted","Data":"bc44054fb30843ea3096689a7e87ec2df84230d4627ab1adb6e0c675d2d3a3c6"}
Sep 11 21:32:31.424816 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.424780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9" event={"ID":"b29c9789-741d-4b48-9c86-cc8101209e2d","Type":"ContainerStarted","Data":"dde2dcb9f672b6ed7fa1a574edcff8c0b05950cab1f39449c8a6c9e54b114558"}
Sep 11 21:32:31.426960 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.426927    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2" event={"ID":"6f90d420-5199-4a9c-b3a4-08356b049c3a","Type":"ContainerStarted","Data":"db9cd213527ab45548f94766e2123ce5c8401a9d7384c8b32e170621037b02d9"}
Sep 11 21:32:31.436191 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.436136    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvtpj" event={"ID":"37d16b56-27f1-401b-a3f4-a389d0c47db2","Type":"ContainerStarted","Data":"a62d524e5751f0d5361fbf55c37c74e44257ff1158241a3a74617aa7159d3b2e"}
Sep 11 21:32:31.439538 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.439414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk" event={"ID":"e12c8cad-9f43-4741-9851-a45bd620459c","Type":"ContainerStarted","Data":"d0c4e031ef6d057e107301007aa50a432556a4b6429c0578becadc2d4a10d706"}
Sep 11 21:32:31.448178 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.448087    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vjdvw" podStartSLOduration=5.773048532 podStartE2EDuration="7.44806793s" totalImagesPullingTime="1.52913738s" totalInitContainerRuntime="145.882018ms" isStatefulPod=true podCreationTimestamp="2026-09-11 21:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:31.445976992 +0000 UTC m=+106.103540768" watchObservedRunningTime="2026-09-11 21:32:31.44806793 +0000 UTC m=+106.105631695"
Sep 11 21:32:31.465799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:31.465753    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-67dcf8c979-sfrbk" podStartSLOduration=3.215211584 podStartE2EDuration="7.465736847s" totalImagesPullingTime="4.250525263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:31.465553979 +0000 UTC m=+106.123117743" watchObservedRunningTime="2026-09-11 21:32:31.465736847 +0000 UTC m=+106.123300615"
Sep 11 21:32:32.244497 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.244014    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b4f9b6787-nfmhg"
Sep 11 21:32:32.450840 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.450748    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx" event={"ID":"f06fb64c-bca1-4f19-bb00-3954239d1632","Type":"ContainerStarted","Data":"8d86265d84dc1d7bd2b1ae5df4c520f8168e3c32a97f9f24ec2f8869aaffbda5"}
Sep 11 21:32:32.454160 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.453358    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6944bb8b8b-rr5th" event={"ID":"a68d20a9-c308-4225-8292-64f41781ab99","Type":"ContainerStarted","Data":"9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b"}
Sep 11 21:32:32.454160 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.453407    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6944bb8b8b-rr5th" event={"ID":"a68d20a9-c308-4225-8292-64f41781ab99","Type":"ContainerStarted","Data":"b50398471c73abccf7c7a3c09c2bf1ca6bbe2a01e8908456d8b834b59f73da0b"}
Sep 11 21:32:32.458658 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.458566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qvtpj" event={"ID":"37d16b56-27f1-401b-a3f4-a389d0c47db2","Type":"ContainerStarted","Data":"316bc762544da45b35bb672ec6e428e023ef44e266b76dc653a195d4a91739b5"}
Sep 11 21:32:32.459021 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.458830    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:32:32.465650 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.465520    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9" event={"ID":"b29c9789-741d-4b48-9c86-cc8101209e2d","Type":"ContainerStarted","Data":"6b90d5bb0156dbf7ff238985c608636a231317a198ce8b2e07d747d70a6dcd14"}
Sep 11 21:32:32.465650 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.465575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9" event={"ID":"b29c9789-741d-4b48-9c86-cc8101209e2d","Type":"ContainerStarted","Data":"a1a8c0a9ef7b2c7d073a8af03f30241df4b3a1ff2da711eb094ff453cf099929"}
Sep 11 21:32:32.473163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.473112    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6944bb8b8b-rr5th" podStartSLOduration=3.473095379 podStartE2EDuration="3.473095379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:32.472310766 +0000 UTC m=+107.129874530" watchObservedRunningTime="2026-09-11 21:32:32.473095379 +0000 UTC m=+107.130659143"
Sep 11 21:32:32.489687 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.489642    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qvtpj" podStartSLOduration=67.995761736 podStartE2EDuration="1m12.489624121s" totalImagesPullingTime="4.493862385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:32.488127962 +0000 UTC m=+107.145691728" watchObservedRunningTime="2026-09-11 21:32:32.489624121 +0000 UTC m=+107.147187886"
Sep 11 21:32:32.510140 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:32.509053    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-g2bf9" podStartSLOduration=4.013620236 podStartE2EDuration="8.5090321s" totalImagesPullingTime="4.495411864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:32.507692208 +0000 UTC m=+107.165255994" watchObservedRunningTime="2026-09-11 21:32:32.5090321 +0000 UTC m=+107.166595865"
Sep 11 21:32:33.050823 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:33.050786    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:33.055852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:33.055826    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:32:35.483966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:35.483931    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx" event={"ID":"f06fb64c-bca1-4f19-bb00-3954239d1632","Type":"ContainerStarted","Data":"cb74f7726d2cc804703129386dba44d548496e5e35a989fcd0aa6bc274b23034"}
Sep 11 21:32:35.484761 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:35.484665    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:35.487461 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:35.487340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa3930e-2cef-45cf-85db-91c1e2feca7b","Type":"ContainerStarted","Data":"68cff43dd50c0ff5efba602f702f98e63e56d9d98a1c7eef0c79403d031dd1d8"}
Sep 11 21:32:35.487461 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:35.487411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa3930e-2cef-45cf-85db-91c1e2feca7b","Type":"ContainerStarted","Data":"352321a6b8999d959edbea85bec8514ecf568ad5a56efe68b0a7aabead2babb3"}
Sep 11 21:32:35.489585 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:35.489064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2" event={"ID":"6f90d420-5199-4a9c-b3a4-08356b049c3a","Type":"ContainerStarted","Data":"8e3e979e13d6d7fe92cc186df405c47b23493ce91b644437a9a82f6a5a411a8e"}
Sep 11 21:32:35.491175 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:35.491148    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx"
Sep 11 21:32:35.501124 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:35.501078    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-dwhcx" podStartSLOduration=2.691049423 podStartE2EDuration="6.501065621s" totalImagesPullingTime="3.810016198s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:35.500610643 +0000 UTC m=+110.158174408" watchObservedRunningTime="2026-09-11 21:32:35.501065621 +0000 UTC m=+110.158629384"
Sep 11 21:32:35.518367 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:35.518331    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2" podStartSLOduration=3.672295976 podStartE2EDuration="7.518318555s" totalImagesPullingTime="3.846022579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:35.516705696 +0000 UTC m=+110.174269460" watchObservedRunningTime="2026-09-11 21:32:35.518318555 +0000 UTC m=+110.175882319"
Sep 11 21:32:36.499184 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:36.499152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa3930e-2cef-45cf-85db-91c1e2feca7b","Type":"ContainerStarted","Data":"f5e82e754ab5c794a6fb0bb763aee5c20caeb681d5a6729156920985a791f5e7"}
Sep 11 21:32:36.499581 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:36.499224    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa3930e-2cef-45cf-85db-91c1e2feca7b","Type":"ContainerStarted","Data":"449b166cfe8e6a70511b195437d2c1a1280418d9f66b8592c3b0eecf9b93399b"}
Sep 11 21:32:36.499581 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:36.499251    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa3930e-2cef-45cf-85db-91c1e2feca7b","Type":"ContainerStarted","Data":"a0bd282c1c4456f29c71e2769697927b18bd2f67937d05717824ed3930fd8fd4"}
Sep 11 21:32:37.506728 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:37.506691    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"caa3930e-2cef-45cf-85db-91c1e2feca7b","Type":"ContainerStarted","Data":"52c23a6ee0f71842413b1fdeac253f23cb4ebad613248dded90b141fb915f244"}
Sep 11 21:32:37.535977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:37.535933    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.02314693 podStartE2EDuration="12.535919117s" totalImagesPullingTime="9.479497434s" totalInitContainerRuntime="33.274753ms" isStatefulPod=false podCreationTimestamp="2026-09-11 21:32:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:37.53466951 +0000 UTC m=+112.192233274" watchObservedRunningTime="2026-09-11 21:32:37.535919117 +0000 UTC m=+112.193482880"
Sep 11 21:32:39.511079 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:39.511045    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:39.511678 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:39.511129    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:39.515845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:39.515823    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:40.522180 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:40.522153    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:32:40.567371 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:40.567345    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f78448869-c29tc"]
Sep 11 21:32:42.472847 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:42.472816    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qvtpj"
Sep 11 21:32:49.001071 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:49.001038    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:49.001568 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:49.001097    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:32:55.528348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:55.528314    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:32:55.530830 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:55.530807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9774a99e-8c66-47df-97b0-cc061be54f89-metrics-certs\") pod \"network-metrics-daemon-g59xd\" (UID: \"9774a99e-8c66-47df-97b0-cc061be54f89\") " pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:32:55.576772 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:55.576746    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-r57v4\""
Sep 11 21:32:55.584927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:55.584909    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g59xd"
Sep 11 21:32:55.857369 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:55.857346    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g59xd"]
Sep 11 21:32:55.859729 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:32:55.859697    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9774a99e_8c66_47df_97b0_cc061be54f89.slice/crio-c6f787a409fa05069f7b5e30ba8ff4ba9d55b72f91a9d038b4bd8acf62c5d47b WatchSource:0}: Error finding container c6f787a409fa05069f7b5e30ba8ff4ba9d55b72f91a9d038b4bd8acf62c5d47b: Status 404 returned error can't find the container with id c6f787a409fa05069f7b5e30ba8ff4ba9d55b72f91a9d038b4bd8acf62c5d47b
Sep 11 21:32:56.582881 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:56.582844    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g59xd" event={"ID":"9774a99e-8c66-47df-97b0-cc061be54f89","Type":"ContainerStarted","Data":"c6f787a409fa05069f7b5e30ba8ff4ba9d55b72f91a9d038b4bd8acf62c5d47b"}
Sep 11 21:32:57.589856 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:57.589818    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g59xd" event={"ID":"9774a99e-8c66-47df-97b0-cc061be54f89","Type":"ContainerStarted","Data":"ded927e4cdb3056c68232a140cd051fd3cc8ec2ebd49684f565b22cf58a55802"}
Sep 11 21:32:57.590217 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:57.589872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g59xd" event={"ID":"9774a99e-8c66-47df-97b0-cc061be54f89","Type":"ContainerStarted","Data":"7944ae6a1f9afe022012a9170caced5090c629ee24c6534daf859b13581f5bb3"}
Sep 11 21:32:57.609146 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:32:57.609103    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g59xd" podStartSLOduration=130.821831151 podStartE2EDuration="2m11.609086384s" totalImagesPullingTime="787.255233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:30:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:32:57.607941523 +0000 UTC m=+132.265505308" watchObservedRunningTime="2026-09-11 21:32:57.609086384 +0000 UTC m=+132.266650147"
Sep 11 21:33:01.605509 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:01.605459    2577 generic.go:356] "Generic (PLEG): container finished" podID="d0aba8ef-4c48-4e84-a846-5c3265089c47" containerID="7a5018ce15eeb78b6fec30e576d978ac946cae8d108c7878e4c89c9859e173bd" exitCode=0
Sep 11 21:33:01.605953 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:01.605535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl" event={"ID":"d0aba8ef-4c48-4e84-a846-5c3265089c47","Type":"ContainerDied","Data":"7a5018ce15eeb78b6fec30e576d978ac946cae8d108c7878e4c89c9859e173bd"}
Sep 11 21:33:01.605953 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:01.605850    2577 scope.go:117] "RemoveContainer" containerID="7a5018ce15eeb78b6fec30e576d978ac946cae8d108c7878e4c89c9859e173bd"
Sep 11 21:33:02.611666 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:02.611634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-b84fl" event={"ID":"d0aba8ef-4c48-4e84-a846-5c3265089c47","Type":"ContainerStarted","Data":"d727f1aa2c38ade4cec65544982cbe2bbb4b5ef6a0ae954c344af88db377816a"}
Sep 11 21:33:05.588221 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:05.588176    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f78448869-c29tc" podUID="eafeb950-5de6-40bc-9f20-6a8d8b49f571" containerName="console" containerID="cri-o://95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf" gracePeriod=15
Sep 11 21:33:05.855002 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:05.854946    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:33:06.013975 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.013952    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-oauth-config\") pod \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") "
Sep 11 21:33:06.014116 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014000    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-service-ca\") pod \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") "
Sep 11 21:33:06.014116 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014031    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-serving-cert\") pod \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") "
Sep 11 21:33:06.014116 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014055    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-trusted-ca-bundle\") pod \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") "
Sep 11 21:33:06.014116 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014073    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-oauth-serving-cert\") pod \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") "
Sep 11 21:33:06.014116 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014114    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf2rr\" (UniqueName: \"kubernetes.io/projected/eafeb950-5de6-40bc-9f20-6a8d8b49f571-kube-api-access-wf2rr\") pod \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") "
Sep 11 21:33:06.014333 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014129    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-config\") pod \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\" (UID: \"eafeb950-5de6-40bc-9f20-6a8d8b49f571\") "
Sep 11 21:33:06.014524 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014495    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-service-ca" (OuterVolumeSpecName: "service-ca") pod "eafeb950-5de6-40bc-9f20-6a8d8b49f571" (UID: "eafeb950-5de6-40bc-9f20-6a8d8b49f571"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:06.014524 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014499    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eafeb950-5de6-40bc-9f20-6a8d8b49f571" (UID: "eafeb950-5de6-40bc-9f20-6a8d8b49f571"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:06.014677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014555    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-config" (OuterVolumeSpecName: "console-config") pod "eafeb950-5de6-40bc-9f20-6a8d8b49f571" (UID: "eafeb950-5de6-40bc-9f20-6a8d8b49f571"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:06.014729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014673    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-trusted-ca-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:33:06.014729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014691    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-config\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:33:06.014729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.014703    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:33:06.016434 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.016409    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eafeb950-5de6-40bc-9f20-6a8d8b49f571-kube-api-access-wf2rr" (OuterVolumeSpecName: "kube-api-access-wf2rr") pod "eafeb950-5de6-40bc-9f20-6a8d8b49f571" (UID: "eafeb950-5de6-40bc-9f20-6a8d8b49f571"). InnerVolumeSpecName "kube-api-access-wf2rr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:33:06.016777 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.016752    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eafeb950-5de6-40bc-9f20-6a8d8b49f571" (UID: "eafeb950-5de6-40bc-9f20-6a8d8b49f571"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:33:06.016777 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.016766    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eafeb950-5de6-40bc-9f20-6a8d8b49f571" (UID: "eafeb950-5de6-40bc-9f20-6a8d8b49f571"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:33:06.019213 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.019189    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eafeb950-5de6-40bc-9f20-6a8d8b49f571" (UID: "eafeb950-5de6-40bc-9f20-6a8d8b49f571"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:33:06.115909 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.115859    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-serving-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:33:06.115909 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.115880    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafeb950-5de6-40bc-9f20-6a8d8b49f571-oauth-serving-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:33:06.115909 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.115889    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf2rr\" (UniqueName: \"kubernetes.io/projected/eafeb950-5de6-40bc-9f20-6a8d8b49f571-kube-api-access-wf2rr\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:33:06.115909 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.115898    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafeb950-5de6-40bc-9f20-6a8d8b49f571-console-oauth-config\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:33:06.632358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.632326    2577 generic.go:356] "Generic (PLEG): container finished" podID="eafeb950-5de6-40bc-9f20-6a8d8b49f571" containerID="95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf" exitCode=0
Sep 11 21:33:06.632828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.632370    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f78448869-c29tc"
Sep 11 21:33:06.632828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.632405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f78448869-c29tc" event={"ID":"eafeb950-5de6-40bc-9f20-6a8d8b49f571","Type":"ContainerDied","Data":"95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf"}
Sep 11 21:33:06.632828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.632459    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f78448869-c29tc" event={"ID":"eafeb950-5de6-40bc-9f20-6a8d8b49f571","Type":"ContainerDied","Data":"0ce8000eb8c969daabdbe5b6ff2a250659b6b23bbec2066194baaa2fd4f1fa57"}
Sep 11 21:33:06.632828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.632504    2577 scope.go:117] "RemoveContainer" containerID="95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf"
Sep 11 21:33:06.645808 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.645788    2577 scope.go:117] "RemoveContainer" containerID="95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf"
Sep 11 21:33:06.646079 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:33:06.646060    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf\": container with ID starting with 95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf not found: ID does not exist" containerID="95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf"
Sep 11 21:33:06.646129 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.646091    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf"} err="failed to get container status \"95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf\": rpc error: code = NotFound desc = could not find container \"95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf\": container with ID starting with 95ae8ee3244c9de4965552da14333cbfcce6d6857f42ec3cbb7e5a3a73293dbf not found: ID does not exist"
Sep 11 21:33:06.653592 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.653567    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f78448869-c29tc"]
Sep 11 21:33:06.657873 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:06.657855    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f78448869-c29tc"]
Sep 11 21:33:07.759506 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:07.759456    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eafeb950-5de6-40bc-9f20-6a8d8b49f571" path="/var/lib/kubelet/pods/eafeb950-5de6-40bc-9f20-6a8d8b49f571/volumes"
Sep 11 21:33:09.006781 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:09.006755    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:33:09.010645 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:09.010624    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bd5645c6d-7ftm2"
Sep 11 21:33:48.579571 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.579539    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-8657f4855f-kp67p"]
Sep 11 21:33:48.579966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.579833    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eafeb950-5de6-40bc-9f20-6a8d8b49f571" containerName="console"
Sep 11 21:33:48.579966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.579843    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eafeb950-5de6-40bc-9f20-6a8d8b49f571" containerName="console"
Sep 11 21:33:48.579966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.579901    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eafeb950-5de6-40bc-9f20-6a8d8b49f571" containerName="console"
Sep 11 21:33:48.582727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.582707    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.587493 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.587455    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5zjh7\""
Sep 11 21:33:48.587493 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.587486    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 11 21:33:48.587493 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.587562    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 11 21:33:48.587493 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.587682    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 11 21:33:48.587493 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.587763    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 11 21:33:48.588828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.588790    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 11 21:33:48.592903 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.592876    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 11 21:33:48.600836 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.600811    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8657f4855f-kp67p"]
Sep 11 21:33:48.643766 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.643735    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-telemeter-client-tls\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.643898 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.643780    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9btv\" (UniqueName: \"kubernetes.io/projected/0b858fe3-eb3f-4b31-b6d4-89261648db02-kube-api-access-w9btv\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.643898 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.643820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b858fe3-eb3f-4b31-b6d4-89261648db02-metrics-client-ca\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.643898 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.643843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b858fe3-eb3f-4b31-b6d4-89261648db02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.644034 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.643896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b858fe3-eb3f-4b31-b6d4-89261648db02-serving-certs-ca-bundle\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.644034 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.643942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-secret-telemeter-client\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.644034 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.643975    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.644143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.644045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-federate-client-tls\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.744404 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.744377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-telemeter-client-tls\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.744525 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.744405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9btv\" (UniqueName: \"kubernetes.io/projected/0b858fe3-eb3f-4b31-b6d4-89261648db02-kube-api-access-w9btv\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.744525 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.744429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b858fe3-eb3f-4b31-b6d4-89261648db02-metrics-client-ca\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.744525 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.744444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b858fe3-eb3f-4b31-b6d4-89261648db02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.744648 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.744582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b858fe3-eb3f-4b31-b6d4-89261648db02-serving-certs-ca-bundle\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.744648 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.744608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-secret-telemeter-client\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.744648 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.744633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.744795 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.744710    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-federate-client-tls\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.745388 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.745341    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b858fe3-eb3f-4b31-b6d4-89261648db02-serving-certs-ca-bundle\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.745388 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.745379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b858fe3-eb3f-4b31-b6d4-89261648db02-metrics-client-ca\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.745640 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.745618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0b858fe3-eb3f-4b31-b6d4-89261648db02-telemeter-trusted-ca-bundle\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.747233 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.747196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.747368 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.747350    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-secret-telemeter-client\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.747637 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.747621    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-federate-client-tls\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.747766 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.747749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0b858fe3-eb3f-4b31-b6d4-89261648db02-telemeter-client-tls\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.752363 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.752342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9btv\" (UniqueName: \"kubernetes.io/projected/0b858fe3-eb3f-4b31-b6d4-89261648db02-kube-api-access-w9btv\") pod \"telemeter-client-8657f4855f-kp67p\" (UID: \"0b858fe3-eb3f-4b31-b6d4-89261648db02\") " pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:48.892430 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:48.892366    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p"
Sep 11 21:33:49.170376 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:49.170350    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-8657f4855f-kp67p"]
Sep 11 21:33:49.171866 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:33:49.171839    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b858fe3_eb3f_4b31_b6d4_89261648db02.slice/crio-b7fe6f73ca551b90719045d76e885f1144af32f12b039e7c6f3bf1aed6d987bc WatchSource:0}: Error finding container b7fe6f73ca551b90719045d76e885f1144af32f12b039e7c6f3bf1aed6d987bc: Status 404 returned error can't find the container with id b7fe6f73ca551b90719045d76e885f1144af32f12b039e7c6f3bf1aed6d987bc
Sep 11 21:33:49.812019 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:49.811983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p" event={"ID":"0b858fe3-eb3f-4b31-b6d4-89261648db02","Type":"ContainerStarted","Data":"b7fe6f73ca551b90719045d76e885f1144af32f12b039e7c6f3bf1aed6d987bc"}
Sep 11 21:33:51.821966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:51.821930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p" event={"ID":"0b858fe3-eb3f-4b31-b6d4-89261648db02","Type":"ContainerStarted","Data":"87ab01629b0cb35ac25595e1207912532e9662e72e4e667423de701989c69ba9"}
Sep 11 21:33:51.822331 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:51.821981    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p" event={"ID":"0b858fe3-eb3f-4b31-b6d4-89261648db02","Type":"ContainerStarted","Data":"128377963cbc2302eead49972e294596ccbda0c47db2b35205ced1da4056fa82"}
Sep 11 21:33:51.822331 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:51.822001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p" event={"ID":"0b858fe3-eb3f-4b31-b6d4-89261648db02","Type":"ContainerStarted","Data":"fecc1289e161c9baccbca8f40cee748ae679ac10b90afa72bc12a0b352c4862a"}
Sep 11 21:33:51.846759 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:51.846711    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-8657f4855f-kp67p" podStartSLOduration=2.011125237 podStartE2EDuration="3.846696427s" totalImagesPullingTime="1.83557119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:33:51.844013264 +0000 UTC m=+186.501577050" watchObservedRunningTime="2026-09-11 21:33:51.846696427 +0000 UTC m=+186.504260191"
Sep 11 21:33:51.929677 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:51.929647    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bd9d67859-6tv46"]
Sep 11 21:33:51.932056 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:51.932034    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:51.945294 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:51.945272    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd9d67859-6tv46"]
Sep 11 21:33:52.074775 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.074700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-oauth-config\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.074775 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.074741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-console-config\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.074775 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.074768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-serving-cert\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.074977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.074846    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-service-ca\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.074977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.074876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckjk8\" (UniqueName: \"kubernetes.io/projected/46affb38-2e18-4941-9b74-6a523fdb5872-kube-api-access-ckjk8\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.074977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.074908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-trusted-ca-bundle\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.074977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.074925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-oauth-serving-cert\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.176169 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.176144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-oauth-config\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.176300 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.176186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-console-config\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.176300 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.176216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-serving-cert\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.176300 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.176251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-service-ca\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.176419 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.176382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckjk8\" (UniqueName: \"kubernetes.io/projected/46affb38-2e18-4941-9b74-6a523fdb5872-kube-api-access-ckjk8\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.176482 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.176431    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-trusted-ca-bundle\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.176532 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.176456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-oauth-serving-cert\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.177019 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.177000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-console-config\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.177264 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.177244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-service-ca\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.177313 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.177249    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-trusted-ca-bundle\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.177313 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.177248    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-oauth-serving-cert\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.178857 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.178828    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-oauth-config\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.179028 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.179006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-serving-cert\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.185008 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.184976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckjk8\" (UniqueName: \"kubernetes.io/projected/46affb38-2e18-4941-9b74-6a523fdb5872-kube-api-access-ckjk8\") pod \"console-7bd9d67859-6tv46\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") " pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.243193 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.243175    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:33:52.515812 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.515790    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bd9d67859-6tv46"]
Sep 11 21:33:52.518284 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:33:52.518259    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46affb38_2e18_4941_9b74_6a523fdb5872.slice/crio-b1c1be4081e1766299b3f33b5346bc9cc0ec7cd374e3c8b9a83c3fdfec5613fe WatchSource:0}: Error finding container b1c1be4081e1766299b3f33b5346bc9cc0ec7cd374e3c8b9a83c3fdfec5613fe: Status 404 returned error can't find the container with id b1c1be4081e1766299b3f33b5346bc9cc0ec7cd374e3c8b9a83c3fdfec5613fe
Sep 11 21:33:52.827750 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.827664    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd9d67859-6tv46" event={"ID":"46affb38-2e18-4941-9b74-6a523fdb5872","Type":"ContainerStarted","Data":"55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209"}
Sep 11 21:33:52.827750 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.827722    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd9d67859-6tv46" event={"ID":"46affb38-2e18-4941-9b74-6a523fdb5872","Type":"ContainerStarted","Data":"b1c1be4081e1766299b3f33b5346bc9cc0ec7cd374e3c8b9a83c3fdfec5613fe"}
Sep 11 21:33:52.846613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:33:52.846565    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bd9d67859-6tv46" podStartSLOduration=1.8465501949999998 podStartE2EDuration="1.846550195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:33:52.845498059 +0000 UTC m=+187.503061820" watchObservedRunningTime="2026-09-11 21:33:52.846550195 +0000 UTC m=+187.504113959"
Sep 11 21:34:02.243544 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:02.243515    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:34:02.244042 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:02.243737    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:34:02.248189 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:02.248169    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:34:02.872240 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:02.872210    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:34:02.917882 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:02.917857    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6944bb8b8b-rr5th"]
Sep 11 21:34:02.990902 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:02.990861    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c76dfb7bd-zpxhh"]
Sep 11 21:34:02.994286 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:02.994260    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.004807 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.004772    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c76dfb7bd-zpxhh"]
Sep 11 21:34:03.169419 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.169389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-config\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.169587 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.169430    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-serving-cert\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.169587 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.169456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-service-ca\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.169587 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.169564    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-oauth-config\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.169689 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.169588    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-oauth-serving-cert\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.169689 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.169604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgkmx\" (UniqueName: \"kubernetes.io/projected/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-kube-api-access-vgkmx\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.169689 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.169636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-trusted-ca-bundle\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.270731 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.270688    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-oauth-config\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.270731 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.270732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-oauth-serving-cert\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.271232 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.270758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgkmx\" (UniqueName: \"kubernetes.io/projected/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-kube-api-access-vgkmx\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.271232 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.270801    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-trusted-ca-bundle\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.271232 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.270848    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-config\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.271232 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.270977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-serving-cert\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.271232 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.271024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-service-ca\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.271641 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.271617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-config\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.271721 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.271617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-oauth-serving-cert\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.271721 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.271666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-service-ca\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.271721 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.271685    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-trusted-ca-bundle\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.273420 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.273394    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-oauth-config\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.273697 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.273677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-serving-cert\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.278776 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.278756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgkmx\" (UniqueName: \"kubernetes.io/projected/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-kube-api-access-vgkmx\") pod \"console-6c76dfb7bd-zpxhh\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") " pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.305656 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.305633    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:03.576636 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.576609    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c76dfb7bd-zpxhh"]
Sep 11 21:34:03.579272 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:34:03.579241    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8ef843a_e81e_4cde_9120_1cc4ae3d27b9.slice/crio-47818859ffa0e38cbcf26b7e0de5706e24e742f5cdeffbc6f532bc5d3fa5dabf WatchSource:0}: Error finding container 47818859ffa0e38cbcf26b7e0de5706e24e742f5cdeffbc6f532bc5d3fa5dabf: Status 404 returned error can't find the container with id 47818859ffa0e38cbcf26b7e0de5706e24e742f5cdeffbc6f532bc5d3fa5dabf
Sep 11 21:34:03.874566 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.874460    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c76dfb7bd-zpxhh" event={"ID":"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9","Type":"ContainerStarted","Data":"71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b"}
Sep 11 21:34:03.874566 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.874542    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c76dfb7bd-zpxhh" event={"ID":"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9","Type":"ContainerStarted","Data":"47818859ffa0e38cbcf26b7e0de5706e24e742f5cdeffbc6f532bc5d3fa5dabf"}
Sep 11 21:34:03.892004 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:03.891957    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c76dfb7bd-zpxhh" podStartSLOduration=1.8919421029999999 podStartE2EDuration="1.891942103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:34:03.891572184 +0000 UTC m=+198.549135950" watchObservedRunningTime="2026-09-11 21:34:03.891942103 +0000 UTC m=+198.549505866"
Sep 11 21:34:13.306400 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:13.306363    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:13.306789 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:13.306416    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:13.311000 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:13.310976    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:13.923852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:13.923826    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:34:13.967993 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:13.967963    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd9d67859-6tv46"]
Sep 11 21:34:27.938091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:27.938036    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6944bb8b8b-rr5th" podUID="a68d20a9-c308-4225-8292-64f41781ab99" containerName="console" containerID="cri-o://9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b" gracePeriod=15
Sep 11 21:34:28.172742 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.172721    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:34:28.263175 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263093    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-trusted-ca-bundle\") pod \"a68d20a9-c308-4225-8292-64f41781ab99\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") "
Sep 11 21:34:28.263175 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263131    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-serving-cert\") pod \"a68d20a9-c308-4225-8292-64f41781ab99\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") "
Sep 11 21:34:28.263175 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263172    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-service-ca\") pod \"a68d20a9-c308-4225-8292-64f41781ab99\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") "
Sep 11 21:34:28.263436 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263202    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-console-config\") pod \"a68d20a9-c308-4225-8292-64f41781ab99\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") "
Sep 11 21:34:28.263436 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263227    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rvcv\" (UniqueName: \"kubernetes.io/projected/a68d20a9-c308-4225-8292-64f41781ab99-kube-api-access-8rvcv\") pod \"a68d20a9-c308-4225-8292-64f41781ab99\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") "
Sep 11 21:34:28.263436 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263292    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-oauth-config\") pod \"a68d20a9-c308-4225-8292-64f41781ab99\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") "
Sep 11 21:34:28.263436 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263335    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-oauth-serving-cert\") pod \"a68d20a9-c308-4225-8292-64f41781ab99\" (UID: \"a68d20a9-c308-4225-8292-64f41781ab99\") "
Sep 11 21:34:28.263729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263538    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a68d20a9-c308-4225-8292-64f41781ab99" (UID: "a68d20a9-c308-4225-8292-64f41781ab99"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:28.263729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263661    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-service-ca" (OuterVolumeSpecName: "service-ca") pod "a68d20a9-c308-4225-8292-64f41781ab99" (UID: "a68d20a9-c308-4225-8292-64f41781ab99"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:28.263729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263671    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-trusted-ca-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:28.263729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263669    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-console-config" (OuterVolumeSpecName: "console-config") pod "a68d20a9-c308-4225-8292-64f41781ab99" (UID: "a68d20a9-c308-4225-8292-64f41781ab99"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:28.263932 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.263881    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a68d20a9-c308-4225-8292-64f41781ab99" (UID: "a68d20a9-c308-4225-8292-64f41781ab99"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:28.265487 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.265450    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a68d20a9-c308-4225-8292-64f41781ab99" (UID: "a68d20a9-c308-4225-8292-64f41781ab99"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:34:28.265617 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.265600    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a68d20a9-c308-4225-8292-64f41781ab99" (UID: "a68d20a9-c308-4225-8292-64f41781ab99"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:34:28.265739 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.265718    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a68d20a9-c308-4225-8292-64f41781ab99-kube-api-access-8rvcv" (OuterVolumeSpecName: "kube-api-access-8rvcv") pod "a68d20a9-c308-4225-8292-64f41781ab99" (UID: "a68d20a9-c308-4225-8292-64f41781ab99"). InnerVolumeSpecName "kube-api-access-8rvcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:28.364371 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.364344    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-serving-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:28.364371 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.364368    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:28.364371 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.364378    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-console-config\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:28.364592 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.364386    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rvcv\" (UniqueName: \"kubernetes.io/projected/a68d20a9-c308-4225-8292-64f41781ab99-kube-api-access-8rvcv\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:28.364592 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.364396    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a68d20a9-c308-4225-8292-64f41781ab99-console-oauth-config\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:28.364592 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.364405    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a68d20a9-c308-4225-8292-64f41781ab99-oauth-serving-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:28.976021 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.975990    2577 generic.go:356] "Generic (PLEG): container finished" podID="a68d20a9-c308-4225-8292-64f41781ab99" containerID="9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b" exitCode=0
Sep 11 21:34:28.976431 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.976072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6944bb8b8b-rr5th" event={"ID":"a68d20a9-c308-4225-8292-64f41781ab99","Type":"ContainerDied","Data":"9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b"}
Sep 11 21:34:28.976431 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.976085    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6944bb8b8b-rr5th"
Sep 11 21:34:28.976431 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.976106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6944bb8b8b-rr5th" event={"ID":"a68d20a9-c308-4225-8292-64f41781ab99","Type":"ContainerDied","Data":"b50398471c73abccf7c7a3c09c2bf1ca6bbe2a01e8908456d8b834b59f73da0b"}
Sep 11 21:34:28.976431 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.976125    2577 scope.go:117] "RemoveContainer" containerID="9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b"
Sep 11 21:34:28.985101 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.985079    2577 scope.go:117] "RemoveContainer" containerID="9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b"
Sep 11 21:34:28.985379 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:34:28.985360    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b\": container with ID starting with 9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b not found: ID does not exist" containerID="9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b"
Sep 11 21:34:28.985442 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.985387    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b"} err="failed to get container status \"9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b\": rpc error: code = NotFound desc = could not find container \"9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b\": container with ID starting with 9b3158818c3e00ee1ffb62954cd9e3d06e374aaa9685821c94056a8f68f02b4b not found: ID does not exist"
Sep 11 21:34:28.998273 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:28.998247    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6944bb8b8b-rr5th"]
Sep 11 21:34:29.007792 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:29.007097    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6944bb8b8b-rr5th"]
Sep 11 21:34:29.759099 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:29.759064    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a68d20a9-c308-4225-8292-64f41781ab99" path="/var/lib/kubelet/pods/a68d20a9-c308-4225-8292-64f41781ab99/volumes"
Sep 11 21:34:38.989084 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:38.989035    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bd9d67859-6tv46" podUID="46affb38-2e18-4941-9b74-6a523fdb5872" containerName="console" containerID="cri-o://55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209" gracePeriod=15
Sep 11 21:34:39.234430 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.234403    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:34:39.354071 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.353986    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-console-config\") pod \"46affb38-2e18-4941-9b74-6a523fdb5872\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") "
Sep 11 21:34:39.354071 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-oauth-config\") pod \"46affb38-2e18-4941-9b74-6a523fdb5872\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") "
Sep 11 21:34:39.354071 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354045    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-trusted-ca-bundle\") pod \"46affb38-2e18-4941-9b74-6a523fdb5872\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") "
Sep 11 21:34:39.354071 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354069    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-oauth-serving-cert\") pod \"46affb38-2e18-4941-9b74-6a523fdb5872\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") "
Sep 11 21:34:39.354338 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354144    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-service-ca\") pod \"46affb38-2e18-4941-9b74-6a523fdb5872\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") "
Sep 11 21:34:39.354338 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354174    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckjk8\" (UniqueName: \"kubernetes.io/projected/46affb38-2e18-4941-9b74-6a523fdb5872-kube-api-access-ckjk8\") pod \"46affb38-2e18-4941-9b74-6a523fdb5872\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") "
Sep 11 21:34:39.354338 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354230    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-serving-cert\") pod \"46affb38-2e18-4941-9b74-6a523fdb5872\" (UID: \"46affb38-2e18-4941-9b74-6a523fdb5872\") "
Sep 11 21:34:39.354535 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354509    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-console-config" (OuterVolumeSpecName: "console-config") pod "46affb38-2e18-4941-9b74-6a523fdb5872" (UID: "46affb38-2e18-4941-9b74-6a523fdb5872"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:39.354593 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354525    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "46affb38-2e18-4941-9b74-6a523fdb5872" (UID: "46affb38-2e18-4941-9b74-6a523fdb5872"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:39.354593 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354536    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-service-ca" (OuterVolumeSpecName: "service-ca") pod "46affb38-2e18-4941-9b74-6a523fdb5872" (UID: "46affb38-2e18-4941-9b74-6a523fdb5872"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:39.354593 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.354562    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "46affb38-2e18-4941-9b74-6a523fdb5872" (UID: "46affb38-2e18-4941-9b74-6a523fdb5872"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:34:39.356457 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.356429    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46affb38-2e18-4941-9b74-6a523fdb5872-kube-api-access-ckjk8" (OuterVolumeSpecName: "kube-api-access-ckjk8") pod "46affb38-2e18-4941-9b74-6a523fdb5872" (UID: "46affb38-2e18-4941-9b74-6a523fdb5872"). InnerVolumeSpecName "kube-api-access-ckjk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:34:39.356561 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.356492    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "46affb38-2e18-4941-9b74-6a523fdb5872" (UID: "46affb38-2e18-4941-9b74-6a523fdb5872"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:34:39.356561 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.356505    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "46affb38-2e18-4941-9b74-6a523fdb5872" (UID: "46affb38-2e18-4941-9b74-6a523fdb5872"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:34:39.455688 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.455656    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:39.455688 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.455684    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckjk8\" (UniqueName: \"kubernetes.io/projected/46affb38-2e18-4941-9b74-6a523fdb5872-kube-api-access-ckjk8\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:39.455688 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.455693    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-serving-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:39.455940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.455702    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-console-config\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:39.455940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.455711    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/46affb38-2e18-4941-9b74-6a523fdb5872-console-oauth-config\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:39.455940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.455718    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-trusted-ca-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:39.455940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:39.455728    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/46affb38-2e18-4941-9b74-6a523fdb5872-oauth-serving-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:34:40.036649 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:40.036567    2577 generic.go:356] "Generic (PLEG): container finished" podID="46affb38-2e18-4941-9b74-6a523fdb5872" containerID="55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209" exitCode=0
Sep 11 21:34:40.036649 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:40.036611    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bd9d67859-6tv46"
Sep 11 21:34:40.037125 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:40.036658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd9d67859-6tv46" event={"ID":"46affb38-2e18-4941-9b74-6a523fdb5872","Type":"ContainerDied","Data":"55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209"}
Sep 11 21:34:40.037125 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:40.036708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bd9d67859-6tv46" event={"ID":"46affb38-2e18-4941-9b74-6a523fdb5872","Type":"ContainerDied","Data":"b1c1be4081e1766299b3f33b5346bc9cc0ec7cd374e3c8b9a83c3fdfec5613fe"}
Sep 11 21:34:40.037125 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:40.036733    2577 scope.go:117] "RemoveContainer" containerID="55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209"
Sep 11 21:34:40.045114 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:40.045097    2577 scope.go:117] "RemoveContainer" containerID="55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209"
Sep 11 21:34:40.045389 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:34:40.045371    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209\": container with ID starting with 55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209 not found: ID does not exist" containerID="55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209"
Sep 11 21:34:40.045440 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:40.045399    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209"} err="failed to get container status \"55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209\": rpc error: code = NotFound desc = could not find container \"55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209\": container with ID starting with 55204362f2bdf7d3472704723392f06c5e914a9af471137ce866606355fcc209 not found: ID does not exist"
Sep 11 21:34:40.054015 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:40.053995    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bd9d67859-6tv46"]
Sep 11 21:34:40.057228 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:40.057206    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bd9d67859-6tv46"]
Sep 11 21:34:41.759120 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:41.759086    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46affb38-2e18-4941-9b74-6a523fdb5872" path="/var/lib/kubelet/pods/46affb38-2e18-4941-9b74-6a523fdb5872/volumes"
Sep 11 21:34:59.383602 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.383569    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"]
Sep 11 21:34:59.384051 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.383884    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a68d20a9-c308-4225-8292-64f41781ab99" containerName="console"
Sep 11 21:34:59.384051 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.383895    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a68d20a9-c308-4225-8292-64f41781ab99" containerName="console"
Sep 11 21:34:59.384051 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.383906    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46affb38-2e18-4941-9b74-6a523fdb5872" containerName="console"
Sep 11 21:34:59.384051 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.383911    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="46affb38-2e18-4941-9b74-6a523fdb5872" containerName="console"
Sep 11 21:34:59.384051 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.383981    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a68d20a9-c308-4225-8292-64f41781ab99" containerName="console"
Sep 11 21:34:59.384051 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.383990    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="46affb38-2e18-4941-9b74-6a523fdb5872" containerName="console"
Sep 11 21:34:59.388767 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.388745    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.391533 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.391508    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:34:59.392569 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.392552    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n8slz\""
Sep 11 21:34:59.392646 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.392552    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:34:59.395727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.395564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"]
Sep 11 21:34:59.517814 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.517787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.517993 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.517830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.517993 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.517850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5zck\" (UniqueName: \"kubernetes.io/projected/0079c8e5-ed72-4d89-bf18-c05556b41e9f-kube-api-access-w5zck\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.618349 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.618308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.618554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.618364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.618554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.618389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5zck\" (UniqueName: \"kubernetes.io/projected/0079c8e5-ed72-4d89-bf18-c05556b41e9f-kube-api-access-w5zck\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.618732 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.618713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.618790 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.618732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.627636 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.627614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5zck\" (UniqueName: \"kubernetes.io/projected/0079c8e5-ed72-4d89-bf18-c05556b41e9f-kube-api-access-w5zck\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.698418 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.698390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:34:59.967905 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:34:59.967840    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"]
Sep 11 21:34:59.970773 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:34:59.970744    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0079c8e5_ed72_4d89_bf18_c05556b41e9f.slice/crio-11ce27f6e3dcba024542e392ca6b9e0884dabb087926a3f75890adb9b8f24990 WatchSource:0}: Error finding container 11ce27f6e3dcba024542e392ca6b9e0884dabb087926a3f75890adb9b8f24990: Status 404 returned error can't find the container with id 11ce27f6e3dcba024542e392ca6b9e0884dabb087926a3f75890adb9b8f24990
Sep 11 21:35:00.117880 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:00.117845    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr" event={"ID":"0079c8e5-ed72-4d89-bf18-c05556b41e9f","Type":"ContainerStarted","Data":"11ce27f6e3dcba024542e392ca6b9e0884dabb087926a3f75890adb9b8f24990"}
Sep 11 21:35:07.151084 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:07.151046    2577 generic.go:356] "Generic (PLEG): container finished" podID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerID="8738bbca941b68421a395fbb6115480bb062c52eed71139c934c1df402b8f0e8" exitCode=0
Sep 11 21:35:07.151586 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:07.151140    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr" event={"ID":"0079c8e5-ed72-4d89-bf18-c05556b41e9f","Type":"ContainerDied","Data":"8738bbca941b68421a395fbb6115480bb062c52eed71139c934c1df402b8f0e8"}
Sep 11 21:35:10.166762 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:10.166728    2577 generic.go:356] "Generic (PLEG): container finished" podID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerID="fd2b1fbb3138931767b50ac5930f42e2595f41082f0544bf150a2b3cdc22841c" exitCode=0
Sep 11 21:35:10.167151 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:10.166817    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr" event={"ID":"0079c8e5-ed72-4d89-bf18-c05556b41e9f","Type":"ContainerDied","Data":"fd2b1fbb3138931767b50ac5930f42e2595f41082f0544bf150a2b3cdc22841c"}
Sep 11 21:35:17.200949 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:17.200906    2577 generic.go:356] "Generic (PLEG): container finished" podID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerID="b72006a093dbc9c9a51b4b186a557fe09aeb6aecd396e4a4921a3d713d003b4c" exitCode=0
Sep 11 21:35:17.201320 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:17.200953    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr" event={"ID":"0079c8e5-ed72-4d89-bf18-c05556b41e9f","Type":"ContainerDied","Data":"b72006a093dbc9c9a51b4b186a557fe09aeb6aecd396e4a4921a3d713d003b4c"}
Sep 11 21:35:18.330642 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.330618    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:35:18.361262 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.361237    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5zck\" (UniqueName: \"kubernetes.io/projected/0079c8e5-ed72-4d89-bf18-c05556b41e9f-kube-api-access-w5zck\") pod \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") "
Sep 11 21:35:18.361405 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.361282    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-bundle\") pod \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") "
Sep 11 21:35:18.361405 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.361332    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-util\") pod \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\" (UID: \"0079c8e5-ed72-4d89-bf18-c05556b41e9f\") "
Sep 11 21:35:18.361983 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.361958    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-bundle" (OuterVolumeSpecName: "bundle") pod "0079c8e5-ed72-4d89-bf18-c05556b41e9f" (UID: "0079c8e5-ed72-4d89-bf18-c05556b41e9f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:18.363639 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.363614    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0079c8e5-ed72-4d89-bf18-c05556b41e9f-kube-api-access-w5zck" (OuterVolumeSpecName: "kube-api-access-w5zck") pod "0079c8e5-ed72-4d89-bf18-c05556b41e9f" (UID: "0079c8e5-ed72-4d89-bf18-c05556b41e9f"). InnerVolumeSpecName "kube-api-access-w5zck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:18.365991 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.365967    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-util" (OuterVolumeSpecName: "util") pod "0079c8e5-ed72-4d89-bf18-c05556b41e9f" (UID: "0079c8e5-ed72-4d89-bf18-c05556b41e9f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:18.462102 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.462028    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-util\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:35:18.462102 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.462054    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5zck\" (UniqueName: \"kubernetes.io/projected/0079c8e5-ed72-4d89-bf18-c05556b41e9f-kube-api-access-w5zck\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:35:18.462102 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:18.462064    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0079c8e5-ed72-4d89-bf18-c05556b41e9f-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:35:19.210091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:19.210058    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr" event={"ID":"0079c8e5-ed72-4d89-bf18-c05556b41e9f","Type":"ContainerDied","Data":"11ce27f6e3dcba024542e392ca6b9e0884dabb087926a3f75890adb9b8f24990"}
Sep 11 21:35:19.210091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:19.210075    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405twfr"
Sep 11 21:35:19.210288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:19.210103    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11ce27f6e3dcba024542e392ca6b9e0884dabb087926a3f75890adb9b8f24990"
Sep 11 21:35:22.382913 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.382880    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"]
Sep 11 21:35:22.383253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.383178    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerName="extract"
Sep 11 21:35:22.383253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.383188    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerName="extract"
Sep 11 21:35:22.383253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.383205    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerName="util"
Sep 11 21:35:22.383253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.383211    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerName="util"
Sep 11 21:35:22.383253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.383218    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerName="pull"
Sep 11 21:35:22.383253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.383224    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerName="pull"
Sep 11 21:35:22.383490 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.383276    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0079c8e5-ed72-4d89-bf18-c05556b41e9f" containerName="extract"
Sep 11 21:35:22.386656 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.386627    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"
Sep 11 21:35:22.391134 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.391112    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-lgnp7\""
Sep 11 21:35:22.391561 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.391363    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 21:35:22.391695 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.391560    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 21:35:22.408136 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.408115    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"]
Sep 11 21:35:22.491887 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.491862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06dd65f0-2ecb-48db-8981-41d25f97ef3b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s2c4\" (UID: \"06dd65f0-2ecb-48db-8981-41d25f97ef3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"
Sep 11 21:35:22.492157 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.492135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6wmq\" (UniqueName: \"kubernetes.io/projected/06dd65f0-2ecb-48db-8981-41d25f97ef3b-kube-api-access-g6wmq\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s2c4\" (UID: \"06dd65f0-2ecb-48db-8981-41d25f97ef3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"
Sep 11 21:35:22.593011 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.592979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06dd65f0-2ecb-48db-8981-41d25f97ef3b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s2c4\" (UID: \"06dd65f0-2ecb-48db-8981-41d25f97ef3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"
Sep 11 21:35:22.593204 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.593060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6wmq\" (UniqueName: \"kubernetes.io/projected/06dd65f0-2ecb-48db-8981-41d25f97ef3b-kube-api-access-g6wmq\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s2c4\" (UID: \"06dd65f0-2ecb-48db-8981-41d25f97ef3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"
Sep 11 21:35:22.593367 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.593352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06dd65f0-2ecb-48db-8981-41d25f97ef3b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s2c4\" (UID: \"06dd65f0-2ecb-48db-8981-41d25f97ef3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"
Sep 11 21:35:22.602144 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.602118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6wmq\" (UniqueName: \"kubernetes.io/projected/06dd65f0-2ecb-48db-8981-41d25f97ef3b-kube-api-access-g6wmq\") pod \"cert-manager-operator-controller-manager-55c444bf86-6s2c4\" (UID: \"06dd65f0-2ecb-48db-8981-41d25f97ef3b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"
Sep 11 21:35:22.697933 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.697908    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"
Sep 11 21:35:22.977445 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:22.977419    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4"]
Sep 11 21:35:22.979242 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:35:22.979218    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06dd65f0_2ecb_48db_8981_41d25f97ef3b.slice/crio-f4a5d570c7d02026b1e1011323992431b8556d7846e8f10987cbde28adceb82b WatchSource:0}: Error finding container f4a5d570c7d02026b1e1011323992431b8556d7846e8f10987cbde28adceb82b: Status 404 returned error can't find the container with id f4a5d570c7d02026b1e1011323992431b8556d7846e8f10987cbde28adceb82b
Sep 11 21:35:23.228050 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:23.227970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4" event={"ID":"06dd65f0-2ecb-48db-8981-41d25f97ef3b","Type":"ContainerStarted","Data":"f4a5d570c7d02026b1e1011323992431b8556d7846e8f10987cbde28adceb82b"}
Sep 11 21:35:25.240191 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:25.240159    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4" event={"ID":"06dd65f0-2ecb-48db-8981-41d25f97ef3b","Type":"ContainerStarted","Data":"a5c5ff7958a6fc035fb723cf73a3330f88bfaea9cca4f6f2b778e1482a5f65a6"}
Sep 11 21:35:25.263712 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:25.263661    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6s2c4" podStartSLOduration=1.638870727 podStartE2EDuration="3.263646932s" totalImagesPullingTime="1.624776205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:25.261846269 +0000 UTC m=+279.919410034" watchObservedRunningTime="2026-09-11 21:35:25.263646932 +0000 UTC m=+279.921210695"
Sep 11 21:35:26.092272 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.092237    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zzzdm"]
Sep 11 21:35:26.095581 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.095562    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:26.098348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.098329    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 21:35:26.098944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.098925    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 21:35:26.099569 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.099554    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lj2hf\""
Sep 11 21:35:26.107849 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.107829    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zzzdm"]
Sep 11 21:35:26.118465 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.118440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmgpz\" (UniqueName: \"kubernetes.io/projected/7a65093b-c96e-4deb-8202-e9672e3d93f1-kube-api-access-gmgpz\") pod \"cert-manager-webhook-6486ffd997-zzzdm\" (UID: \"7a65093b-c96e-4deb-8202-e9672e3d93f1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:26.118560 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.118492    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a65093b-c96e-4deb-8202-e9672e3d93f1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zzzdm\" (UID: \"7a65093b-c96e-4deb-8202-e9672e3d93f1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:26.219481 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.219449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmgpz\" (UniqueName: \"kubernetes.io/projected/7a65093b-c96e-4deb-8202-e9672e3d93f1-kube-api-access-gmgpz\") pod \"cert-manager-webhook-6486ffd997-zzzdm\" (UID: \"7a65093b-c96e-4deb-8202-e9672e3d93f1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:26.219621 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.219515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a65093b-c96e-4deb-8202-e9672e3d93f1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zzzdm\" (UID: \"7a65093b-c96e-4deb-8202-e9672e3d93f1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:26.228122 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.228095    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7a65093b-c96e-4deb-8202-e9672e3d93f1-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-zzzdm\" (UID: \"7a65093b-c96e-4deb-8202-e9672e3d93f1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:26.228223 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.228184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmgpz\" (UniqueName: \"kubernetes.io/projected/7a65093b-c96e-4deb-8202-e9672e3d93f1-kube-api-access-gmgpz\") pod \"cert-manager-webhook-6486ffd997-zzzdm\" (UID: \"7a65093b-c96e-4deb-8202-e9672e3d93f1\") " pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:26.415598 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.415278    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:26.426696 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.426668    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"]
Sep 11 21:35:26.430362 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.430344    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.432820 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.432783    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:35:26.432927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.432831    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:35:26.432989 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.432928    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n8slz\""
Sep 11 21:35:26.439834 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.439812    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"]
Sep 11 21:35:26.520796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.520768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.520960 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.520829    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.520960 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.520900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4wr8\" (UniqueName: \"kubernetes.io/projected/131d944e-257e-4b7c-8e0a-041522cb2e02-kube-api-access-n4wr8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.621624 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.621593    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.621768 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.621639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.621768 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.621678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4wr8\" (UniqueName: \"kubernetes.io/projected/131d944e-257e-4b7c-8e0a-041522cb2e02-kube-api-access-n4wr8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.621964 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.621940    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.622030 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.621963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.630298 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.630278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4wr8\" (UniqueName: \"kubernetes.io/projected/131d944e-257e-4b7c-8e0a-041522cb2e02-kube-api-access-n4wr8\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:26.689925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.689718    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-zzzdm"]
Sep 11 21:35:26.692523 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:35:26.692492    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a65093b_c96e_4deb_8202_e9672e3d93f1.slice/crio-e329785c9a3df98d40bbaf35b634bbfcbde7005c29c839287de48beb6deff23d WatchSource:0}: Error finding container e329785c9a3df98d40bbaf35b634bbfcbde7005c29c839287de48beb6deff23d: Status 404 returned error can't find the container with id e329785c9a3df98d40bbaf35b634bbfcbde7005c29c839287de48beb6deff23d
Sep 11 21:35:26.750437 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:26.750403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:27.023099 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:27.023038    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"]
Sep 11 21:35:27.025555 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:35:27.025523    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131d944e_257e_4b7c_8e0a_041522cb2e02.slice/crio-f34ce8206b90803034c3d0cb10c25488637863438839ef7ac280bf6a7fd630a6 WatchSource:0}: Error finding container f34ce8206b90803034c3d0cb10c25488637863438839ef7ac280bf6a7fd630a6: Status 404 returned error can't find the container with id f34ce8206b90803034c3d0cb10c25488637863438839ef7ac280bf6a7fd630a6
Sep 11 21:35:27.250433 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:27.250397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm" event={"ID":"7a65093b-c96e-4deb-8202-e9672e3d93f1","Type":"ContainerStarted","Data":"e329785c9a3df98d40bbaf35b634bbfcbde7005c29c839287de48beb6deff23d"}
Sep 11 21:35:27.251935 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:27.251911    2577 generic.go:356] "Generic (PLEG): container finished" podID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerID="16799a91dda733f740036b2e3070ef0dd6cd2b954ee8997b033c29aabfcf0f3f" exitCode=0
Sep 11 21:35:27.252036 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:27.251982    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl" event={"ID":"131d944e-257e-4b7c-8e0a-041522cb2e02","Type":"ContainerDied","Data":"16799a91dda733f740036b2e3070ef0dd6cd2b954ee8997b033c29aabfcf0f3f"}
Sep 11 21:35:27.252076 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:27.252038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl" event={"ID":"131d944e-257e-4b7c-8e0a-041522cb2e02","Type":"ContainerStarted","Data":"f34ce8206b90803034c3d0cb10c25488637863438839ef7ac280bf6a7fd630a6"}
Sep 11 21:35:28.355240 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.354022    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"]
Sep 11 21:35:28.357727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.357674    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"
Sep 11 21:35:28.362491 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.362454    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-sdwhk\""
Sep 11 21:35:28.367912 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.367864    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"]
Sep 11 21:35:28.436655 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.436543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgddz\" (UniqueName: \"kubernetes.io/projected/45dd652b-7b80-4fde-ab26-6515236700cc-kube-api-access-hgddz\") pod \"cert-manager-cainjector-559cdd8c87-zs92m\" (UID: \"45dd652b-7b80-4fde-ab26-6515236700cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"
Sep 11 21:35:28.436655 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.436600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45dd652b-7b80-4fde-ab26-6515236700cc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zs92m\" (UID: \"45dd652b-7b80-4fde-ab26-6515236700cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"
Sep 11 21:35:28.537226 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.537186    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgddz\" (UniqueName: \"kubernetes.io/projected/45dd652b-7b80-4fde-ab26-6515236700cc-kube-api-access-hgddz\") pod \"cert-manager-cainjector-559cdd8c87-zs92m\" (UID: \"45dd652b-7b80-4fde-ab26-6515236700cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"
Sep 11 21:35:28.537422 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.537242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45dd652b-7b80-4fde-ab26-6515236700cc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zs92m\" (UID: \"45dd652b-7b80-4fde-ab26-6515236700cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"
Sep 11 21:35:28.547233 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.547199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgddz\" (UniqueName: \"kubernetes.io/projected/45dd652b-7b80-4fde-ab26-6515236700cc-kube-api-access-hgddz\") pod \"cert-manager-cainjector-559cdd8c87-zs92m\" (UID: \"45dd652b-7b80-4fde-ab26-6515236700cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"
Sep 11 21:35:28.547671 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.547649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/45dd652b-7b80-4fde-ab26-6515236700cc-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-zs92m\" (UID: \"45dd652b-7b80-4fde-ab26-6515236700cc\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"
Sep 11 21:35:28.671163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.671130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"
Sep 11 21:35:28.958049 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:28.957988    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-zs92m"]
Sep 11 21:35:29.453345 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:35:29.453314    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45dd652b_7b80_4fde_ab26_6515236700cc.slice/crio-39b7d7193424d065f79af8e5ae6571295599a9f1a161373ce7dc0e85f3e2aadf WatchSource:0}: Error finding container 39b7d7193424d065f79af8e5ae6571295599a9f1a161373ce7dc0e85f3e2aadf: Status 404 returned error can't find the container with id 39b7d7193424d065f79af8e5ae6571295599a9f1a161373ce7dc0e85f3e2aadf
Sep 11 21:35:30.271199 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:30.271158    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m" event={"ID":"45dd652b-7b80-4fde-ab26-6515236700cc","Type":"ContainerStarted","Data":"39b7d7193424d065f79af8e5ae6571295599a9f1a161373ce7dc0e85f3e2aadf"}
Sep 11 21:35:31.277390 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:31.277352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm" event={"ID":"7a65093b-c96e-4deb-8202-e9672e3d93f1","Type":"ContainerStarted","Data":"30cf8764ce85b2c7c461f64255390417877574ab3a21da4bd697c484fc85f58d"}
Sep 11 21:35:31.277809 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:31.277406    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:31.279210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:31.279186    2577 generic.go:356] "Generic (PLEG): container finished" podID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerID="1d22f5e7b204b4645b9af79634b8e0a2c356ca88362bf125b7ea08ea5f46fb65" exitCode=0
Sep 11 21:35:31.279311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:31.279263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl" event={"ID":"131d944e-257e-4b7c-8e0a-041522cb2e02","Type":"ContainerDied","Data":"1d22f5e7b204b4645b9af79634b8e0a2c356ca88362bf125b7ea08ea5f46fb65"}
Sep 11 21:35:31.280795 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:31.280772    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m" event={"ID":"45dd652b-7b80-4fde-ab26-6515236700cc","Type":"ContainerStarted","Data":"b48ad5ee66d9027ae59f550883350765f348ec534500e0ea65722cfd5113291d"}
Sep 11 21:35:31.300324 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:31.300286    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm" podStartSLOduration=1.523687567 podStartE2EDuration="5.300272549s" totalImagesPullingTime="3.776584982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:31.298553708 +0000 UTC m=+285.956117472" watchObservedRunningTime="2026-09-11 21:35:31.300272549 +0000 UTC m=+285.957836314"
Sep 11 21:35:31.345372 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:31.345333    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-zs92m" podStartSLOduration=2.326328949 podStartE2EDuration="3.345318528s" totalImagesPullingTime="1.018989579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:35:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:35:31.344522589 +0000 UTC m=+286.002086354" watchObservedRunningTime="2026-09-11 21:35:31.345318528 +0000 UTC m=+286.002882291"
Sep 11 21:35:32.287067 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:32.287030    2577 generic.go:356] "Generic (PLEG): container finished" podID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerID="5b3eb182a7f335fcd032e8c209dfb1185bbd84ef8c44ee2719aa4261b7a63607" exitCode=0
Sep 11 21:35:32.287498 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:32.287120    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl" event={"ID":"131d944e-257e-4b7c-8e0a-041522cb2e02","Type":"ContainerDied","Data":"5b3eb182a7f335fcd032e8c209dfb1185bbd84ef8c44ee2719aa4261b7a63607"}
Sep 11 21:35:33.415221 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.415198    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:33.480263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.480240    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-util\") pod \"131d944e-257e-4b7c-8e0a-041522cb2e02\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") "
Sep 11 21:35:33.480395 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.480273    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4wr8\" (UniqueName: \"kubernetes.io/projected/131d944e-257e-4b7c-8e0a-041522cb2e02-kube-api-access-n4wr8\") pod \"131d944e-257e-4b7c-8e0a-041522cb2e02\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") "
Sep 11 21:35:33.480395 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.480356    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-bundle\") pod \"131d944e-257e-4b7c-8e0a-041522cb2e02\" (UID: \"131d944e-257e-4b7c-8e0a-041522cb2e02\") "
Sep 11 21:35:33.480764 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.480742    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-bundle" (OuterVolumeSpecName: "bundle") pod "131d944e-257e-4b7c-8e0a-041522cb2e02" (UID: "131d944e-257e-4b7c-8e0a-041522cb2e02"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:33.482520 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.482495    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/131d944e-257e-4b7c-8e0a-041522cb2e02-kube-api-access-n4wr8" (OuterVolumeSpecName: "kube-api-access-n4wr8") pod "131d944e-257e-4b7c-8e0a-041522cb2e02" (UID: "131d944e-257e-4b7c-8e0a-041522cb2e02"). InnerVolumeSpecName "kube-api-access-n4wr8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:33.485020 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.484990    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-util" (OuterVolumeSpecName: "util") pod "131d944e-257e-4b7c-8e0a-041522cb2e02" (UID: "131d944e-257e-4b7c-8e0a-041522cb2e02"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:33.581618 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.581519    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4wr8\" (UniqueName: \"kubernetes.io/projected/131d944e-257e-4b7c-8e0a-041522cb2e02-kube-api-access-n4wr8\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:35:33.581618 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.581564    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:35:33.581618 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:33.581573    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/131d944e-257e-4b7c-8e0a-041522cb2e02-util\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:35:34.298228 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:34.298195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl" event={"ID":"131d944e-257e-4b7c-8e0a-041522cb2e02","Type":"ContainerDied","Data":"f34ce8206b90803034c3d0cb10c25488637863438839ef7ac280bf6a7fd630a6"}
Sep 11 21:35:34.298228 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:34.298216    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ffd2bl"
Sep 11 21:35:34.298460 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:34.298242    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f34ce8206b90803034c3d0cb10c25488637863438839ef7ac280bf6a7fd630a6"
Sep 11 21:35:37.289353 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:37.289322    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-zzzdm"
Sep 11 21:35:45.694091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:45.694064    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:35:45.694091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:45.694092    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:35:45.704894 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:45.704878    2577 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 21:35:46.241080 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.241047    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"]
Sep 11 21:35:46.243216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.241382    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerName="extract"
Sep 11 21:35:46.243216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.241397    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerName="extract"
Sep 11 21:35:46.243216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.241410    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerName="util"
Sep 11 21:35:46.243216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.241416    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerName="util"
Sep 11 21:35:46.243216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.241424    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerName="pull"
Sep 11 21:35:46.243216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.241429    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerName="pull"
Sep 11 21:35:46.243216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.241504    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="131d944e-257e-4b7c-8e0a-041522cb2e02" containerName="extract"
Sep 11 21:35:46.244501 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.244485    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.247218 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.247192    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:35:46.247343 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.247258    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:35:46.247401 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.247349    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n8slz\""
Sep 11 21:35:46.252939 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.252918    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"]
Sep 11 21:35:46.297683 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.297660    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.297822 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.297703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.297822 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.297751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh72d\" (UniqueName: \"kubernetes.io/projected/73843bde-5448-4193-b538-973bcf2bc29b-kube-api-access-wh72d\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.398926 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.398905    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.399054 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.398935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.399054 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.398962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh72d\" (UniqueName: \"kubernetes.io/projected/73843bde-5448-4193-b538-973bcf2bc29b-kube-api-access-wh72d\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.399270 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.399250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.399332 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.399281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.408483 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.408453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh72d\" (UniqueName: \"kubernetes.io/projected/73843bde-5448-4193-b538-973bcf2bc29b-kube-api-access-wh72d\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.554830 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.554772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:46.828017 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:46.827992    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"]
Sep 11 21:35:46.829830 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:35:46.829801    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73843bde_5448_4193_b538_973bcf2bc29b.slice/crio-ccd8170eb44045f3f571b141958ea320f45eca9a6c96c7123b4f9ce283a4e8c2 WatchSource:0}: Error finding container ccd8170eb44045f3f571b141958ea320f45eca9a6c96c7123b4f9ce283a4e8c2: Status 404 returned error can't find the container with id ccd8170eb44045f3f571b141958ea320f45eca9a6c96c7123b4f9ce283a4e8c2
Sep 11 21:35:47.358836 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:47.358801    2577 generic.go:356] "Generic (PLEG): container finished" podID="73843bde-5448-4193-b538-973bcf2bc29b" containerID="690dac6600f491305be32dd653c65718901d0d9028d5ecf8a49535c70be2f0ad" exitCode=0
Sep 11 21:35:47.359024 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:47.358895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq" event={"ID":"73843bde-5448-4193-b538-973bcf2bc29b","Type":"ContainerDied","Data":"690dac6600f491305be32dd653c65718901d0d9028d5ecf8a49535c70be2f0ad"}
Sep 11 21:35:47.359024 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:47.358945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq" event={"ID":"73843bde-5448-4193-b538-973bcf2bc29b","Type":"ContainerStarted","Data":"ccd8170eb44045f3f571b141958ea320f45eca9a6c96c7123b4f9ce283a4e8c2"}
Sep 11 21:35:47.359314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:47.359300    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:35:48.365210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:48.365131    2577 generic.go:356] "Generic (PLEG): container finished" podID="73843bde-5448-4193-b538-973bcf2bc29b" containerID="801e0a83e3589fc44d5be78e09c11e5114f614950508615dd0f528dd1fb1e51c" exitCode=0
Sep 11 21:35:48.365210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:48.365206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq" event={"ID":"73843bde-5448-4193-b538-973bcf2bc29b","Type":"ContainerDied","Data":"801e0a83e3589fc44d5be78e09c11e5114f614950508615dd0f528dd1fb1e51c"}
Sep 11 21:35:49.372452 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:49.372414    2577 generic.go:356] "Generic (PLEG): container finished" podID="73843bde-5448-4193-b538-973bcf2bc29b" containerID="08d6c71837b67868847d153b4e8b00b7e5b551f7d384a71684c91ff608c1ba22" exitCode=0
Sep 11 21:35:49.372850 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:49.372511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq" event={"ID":"73843bde-5448-4193-b538-973bcf2bc29b","Type":"ContainerDied","Data":"08d6c71837b67868847d153b4e8b00b7e5b551f7d384a71684c91ff608c1ba22"}
Sep 11 21:35:50.526325 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.526303    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:35:50.633278 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.633212    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh72d\" (UniqueName: \"kubernetes.io/projected/73843bde-5448-4193-b538-973bcf2bc29b-kube-api-access-wh72d\") pod \"73843bde-5448-4193-b538-973bcf2bc29b\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") "
Sep 11 21:35:50.633278 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.633255    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-util\") pod \"73843bde-5448-4193-b538-973bcf2bc29b\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") "
Sep 11 21:35:50.633441 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.633282    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-bundle\") pod \"73843bde-5448-4193-b538-973bcf2bc29b\" (UID: \"73843bde-5448-4193-b538-973bcf2bc29b\") "
Sep 11 21:35:50.633972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.633945    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-bundle" (OuterVolumeSpecName: "bundle") pod "73843bde-5448-4193-b538-973bcf2bc29b" (UID: "73843bde-5448-4193-b538-973bcf2bc29b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:50.635438 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.635412    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73843bde-5448-4193-b538-973bcf2bc29b-kube-api-access-wh72d" (OuterVolumeSpecName: "kube-api-access-wh72d") pod "73843bde-5448-4193-b538-973bcf2bc29b" (UID: "73843bde-5448-4193-b538-973bcf2bc29b"). InnerVolumeSpecName "kube-api-access-wh72d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:35:50.641384 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.641361    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-util" (OuterVolumeSpecName: "util") pod "73843bde-5448-4193-b538-973bcf2bc29b" (UID: "73843bde-5448-4193-b538-973bcf2bc29b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:35:50.734671 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.734645    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh72d\" (UniqueName: \"kubernetes.io/projected/73843bde-5448-4193-b538-973bcf2bc29b-kube-api-access-wh72d\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:35:50.734671 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.734668    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-util\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:35:50.734671 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:50.734679    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/73843bde-5448-4193-b538-973bcf2bc29b-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:35:51.383950 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:51.383908    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq" event={"ID":"73843bde-5448-4193-b538-973bcf2bc29b","Type":"ContainerDied","Data":"ccd8170eb44045f3f571b141958ea320f45eca9a6c96c7123b4f9ce283a4e8c2"}
Sep 11 21:35:51.384117 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:51.383964    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ccd8170eb44045f3f571b141958ea320f45eca9a6c96c7123b4f9ce283a4e8c2"
Sep 11 21:35:51.384117 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:35:51.383928    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwt9gq"
Sep 11 21:36:01.664090 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.664059    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"]
Sep 11 21:36:01.664643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.664514    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73843bde-5448-4193-b538-973bcf2bc29b" containerName="pull"
Sep 11 21:36:01.664643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.664530    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="73843bde-5448-4193-b538-973bcf2bc29b" containerName="pull"
Sep 11 21:36:01.664643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.664540    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73843bde-5448-4193-b538-973bcf2bc29b" containerName="util"
Sep 11 21:36:01.664643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.664545    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="73843bde-5448-4193-b538-973bcf2bc29b" containerName="util"
Sep 11 21:36:01.664643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.664560    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73843bde-5448-4193-b538-973bcf2bc29b" containerName="extract"
Sep 11 21:36:01.664643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.664566    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="73843bde-5448-4193-b538-973bcf2bc29b" containerName="extract"
Sep 11 21:36:01.664643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.664633    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="73843bde-5448-4193-b538-973bcf2bc29b" containerName="extract"
Sep 11 21:36:01.668911 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.668894    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.671705 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.671685    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n8slz\""
Sep 11 21:36:01.671821 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.671708    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:36:01.671821 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.671708    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:36:01.678268 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.678246    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"]
Sep 11 21:36:01.828572 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.828532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7vb2\" (UniqueName: \"kubernetes.io/projected/e353135a-4c4d-4101-9fe9-2a8a8a867689-kube-api-access-h7vb2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.828755 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.828584    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.828755 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.828679    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.930062 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.929977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7vb2\" (UniqueName: \"kubernetes.io/projected/e353135a-4c4d-4101-9fe9-2a8a8a867689-kube-api-access-h7vb2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.930062 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.930018    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.930243 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.930077    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.930510 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.930488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.930553 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.930507    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.944532 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.944505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7vb2\" (UniqueName: \"kubernetes.io/projected/e353135a-4c4d-4101-9fe9-2a8a8a867689-kube-api-access-h7vb2\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:01.978341 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:01.978317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:02.253699 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:02.253676    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"]
Sep 11 21:36:02.255395 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:36:02.255368    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode353135a_4c4d_4101_9fe9_2a8a8a867689.slice/crio-e467891f67b487d46fcb4595fe392313155e73a64653261a2b795ee4c488b3eb WatchSource:0}: Error finding container e467891f67b487d46fcb4595fe392313155e73a64653261a2b795ee4c488b3eb: Status 404 returned error can't find the container with id e467891f67b487d46fcb4595fe392313155e73a64653261a2b795ee4c488b3eb
Sep 11 21:36:02.437376 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:02.437350    2577 generic.go:356] "Generic (PLEG): container finished" podID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerID="57f6d02cf0bf7d8efb70d441825f3f64896f3a6ed20741f84d62bf6f858e1a33" exitCode=0
Sep 11 21:36:02.437506 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:02.437405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb" event={"ID":"e353135a-4c4d-4101-9fe9-2a8a8a867689","Type":"ContainerDied","Data":"57f6d02cf0bf7d8efb70d441825f3f64896f3a6ed20741f84d62bf6f858e1a33"}
Sep 11 21:36:02.437506 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:02.437453    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb" event={"ID":"e353135a-4c4d-4101-9fe9-2a8a8a867689","Type":"ContainerStarted","Data":"e467891f67b487d46fcb4595fe392313155e73a64653261a2b795ee4c488b3eb"}
Sep 11 21:36:03.106034 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.106007    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"]
Sep 11 21:36:03.109568 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.109548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.113397 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.113376    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 21:36:03.113503 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.113485    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vmt8t\""
Sep 11 21:36:03.113837 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.113818    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 21:36:03.114038 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.114022    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 21:36:03.121907 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.121891    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 21:36:03.130324 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.130300    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"]
Sep 11 21:36:03.240981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.240902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26cbeba0-0033-43cf-aebc-7527d6826403-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.240981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.240960    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26cbeba0-0033-43cf-aebc-7527d6826403-manifests\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.241176 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.240999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26cbeba0-0033-43cf-aebc-7527d6826403-tmp\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.241176 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.241073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26cbeba0-0033-43cf-aebc-7527d6826403-webhook-cert\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.241176 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.241113    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfxwr\" (UniqueName: \"kubernetes.io/projected/26cbeba0-0033-43cf-aebc-7527d6826403-kube-api-access-bfxwr\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.341634 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.341604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26cbeba0-0033-43cf-aebc-7527d6826403-manifests\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.341760 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.341639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26cbeba0-0033-43cf-aebc-7527d6826403-tmp\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.341760 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.341661    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26cbeba0-0033-43cf-aebc-7527d6826403-webhook-cert\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.341760 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.341689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxwr\" (UniqueName: \"kubernetes.io/projected/26cbeba0-0033-43cf-aebc-7527d6826403-kube-api-access-bfxwr\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.341760 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.341743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26cbeba0-0033-43cf-aebc-7527d6826403-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.342015 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.341994    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/26cbeba0-0033-43cf-aebc-7527d6826403-manifests\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.344084 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.344042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26cbeba0-0033-43cf-aebc-7527d6826403-tmp\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.344464 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.344443    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/26cbeba0-0033-43cf-aebc-7527d6826403-webhook-cert\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.344532 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.344443    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/26cbeba0-0033-43cf-aebc-7527d6826403-apiservice-cert\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.350778 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.350760    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfxwr\" (UniqueName: \"kubernetes.io/projected/26cbeba0-0033-43cf-aebc-7527d6826403-kube-api-access-bfxwr\") pod \"opendatahub-operator-controller-manager-595996979b-rgpjp\" (UID: \"26cbeba0-0033-43cf-aebc-7527d6826403\") " pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.449326 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.449292    2577 generic.go:356] "Generic (PLEG): container finished" podID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerID="33b5a615731bcd4a0cad4257bfa35a6d606908dfd3b3faf34b2d69e77055fa9b" exitCode=0
Sep 11 21:36:03.449516 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.449381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb" event={"ID":"e353135a-4c4d-4101-9fe9-2a8a8a867689","Type":"ContainerDied","Data":"33b5a615731bcd4a0cad4257bfa35a6d606908dfd3b3faf34b2d69e77055fa9b"}
Sep 11 21:36:03.467236 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.467215    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:03.747799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:03.747774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"]
Sep 11 21:36:03.749271 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:36:03.749248    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26cbeba0_0033_43cf_aebc_7527d6826403.slice/crio-68ff5e21be1b2cfa22034580af4d5797360ddb27e8c0ffbb32b418d1dd821770 WatchSource:0}: Error finding container 68ff5e21be1b2cfa22034580af4d5797360ddb27e8c0ffbb32b418d1dd821770: Status 404 returned error can't find the container with id 68ff5e21be1b2cfa22034580af4d5797360ddb27e8c0ffbb32b418d1dd821770
Sep 11 21:36:04.465668 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:04.465506    2577 generic.go:356] "Generic (PLEG): container finished" podID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerID="88edd0ee98ab6eac45e0991fb22bab4bbfdb502fbe838c202b040188749bc4bd" exitCode=0
Sep 11 21:36:04.465668 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:04.465604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb" event={"ID":"e353135a-4c4d-4101-9fe9-2a8a8a867689","Type":"ContainerDied","Data":"88edd0ee98ab6eac45e0991fb22bab4bbfdb502fbe838c202b040188749bc4bd"}
Sep 11 21:36:04.468332 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:04.468299    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp" event={"ID":"26cbeba0-0033-43cf-aebc-7527d6826403","Type":"ContainerStarted","Data":"68ff5e21be1b2cfa22034580af4d5797360ddb27e8c0ffbb32b418d1dd821770"}
Sep 11 21:36:06.748360 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.748339    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:06.872622 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.872595    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7vb2\" (UniqueName: \"kubernetes.io/projected/e353135a-4c4d-4101-9fe9-2a8a8a867689-kube-api-access-h7vb2\") pod \"e353135a-4c4d-4101-9fe9-2a8a8a867689\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") "
Sep 11 21:36:06.872744 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.872667    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-util\") pod \"e353135a-4c4d-4101-9fe9-2a8a8a867689\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") "
Sep 11 21:36:06.872744 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.872701    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-bundle\") pod \"e353135a-4c4d-4101-9fe9-2a8a8a867689\" (UID: \"e353135a-4c4d-4101-9fe9-2a8a8a867689\") "
Sep 11 21:36:06.873438 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.873401    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-bundle" (OuterVolumeSpecName: "bundle") pod "e353135a-4c4d-4101-9fe9-2a8a8a867689" (UID: "e353135a-4c4d-4101-9fe9-2a8a8a867689"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:36:06.874704 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.874684    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e353135a-4c4d-4101-9fe9-2a8a8a867689-kube-api-access-h7vb2" (OuterVolumeSpecName: "kube-api-access-h7vb2") pod "e353135a-4c4d-4101-9fe9-2a8a8a867689" (UID: "e353135a-4c4d-4101-9fe9-2a8a8a867689"). InnerVolumeSpecName "kube-api-access-h7vb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:36:06.877728 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.877707    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-util" (OuterVolumeSpecName: "util") pod "e353135a-4c4d-4101-9fe9-2a8a8a867689" (UID: "e353135a-4c4d-4101-9fe9-2a8a8a867689"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:36:06.973520 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.973492    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7vb2\" (UniqueName: \"kubernetes.io/projected/e353135a-4c4d-4101-9fe9-2a8a8a867689-kube-api-access-h7vb2\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:06.973520 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.973518    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-util\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:06.973669 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:06.973527    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e353135a-4c4d-4101-9fe9-2a8a8a867689-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:07.487057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:07.487019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb" event={"ID":"e353135a-4c4d-4101-9fe9-2a8a8a867689","Type":"ContainerDied","Data":"e467891f67b487d46fcb4595fe392313155e73a64653261a2b795ee4c488b3eb"}
Sep 11 21:36:07.487057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:07.487057    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0jn4xb"
Sep 11 21:36:07.487276 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:07.487083    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e467891f67b487d46fcb4595fe392313155e73a64653261a2b795ee4c488b3eb"
Sep 11 21:36:07.488609 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:07.488586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp" event={"ID":"26cbeba0-0033-43cf-aebc-7527d6826403","Type":"ContainerStarted","Data":"932a745ff85dfb214721725360d1db0982b0fe7248900b4e349cdaad1ee182fe"}
Sep 11 21:36:08.494835 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:08.494801    2577 generic.go:356] "Generic (PLEG): container finished" podID="26cbeba0-0033-43cf-aebc-7527d6826403" containerID="932a745ff85dfb214721725360d1db0982b0fe7248900b4e349cdaad1ee182fe" exitCode=0
Sep 11 21:36:08.495216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:08.494887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp" event={"ID":"26cbeba0-0033-43cf-aebc-7527d6826403","Type":"ContainerDied","Data":"932a745ff85dfb214721725360d1db0982b0fe7248900b4e349cdaad1ee182fe"}
Sep 11 21:36:09.501701 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:09.501668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp" event={"ID":"26cbeba0-0033-43cf-aebc-7527d6826403","Type":"ContainerStarted","Data":"5c69a46e5bd621d91c40985141bd9025f613bdd5a81333b4cff4f7c3d272e87d"}
Sep 11 21:36:09.502075 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:09.501792    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:09.529129 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:09.529080    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp" podStartSLOduration=2.010612397 podStartE2EDuration="6.529063252s" totalImagesPullingTime="3.344830016s" totalInitContainerRuntime="1.173620839s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:09.52726139 +0000 UTC m=+324.184825155" watchObservedRunningTime="2026-09-11 21:36:09.529063252 +0000 UTC m=+324.186627015"
Sep 11 21:36:20.509061 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:20.509035    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-595996979b-rgpjp"
Sep 11 21:36:22.972364 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.972331    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"]
Sep 11 21:36:22.972861 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.972840    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerName="extract"
Sep 11 21:36:22.972940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.972866    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerName="extract"
Sep 11 21:36:22.972940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.972895    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerName="pull"
Sep 11 21:36:22.972940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.972905    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerName="pull"
Sep 11 21:36:22.972940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.972916    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerName="util"
Sep 11 21:36:22.972940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.972924    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerName="util"
Sep 11 21:36:22.973170 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.973011    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e353135a-4c4d-4101-9fe9-2a8a8a867689" containerName="extract"
Sep 11 21:36:22.980970 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.980944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:22.986916 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.986889    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 21:36:22.986916 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.986905    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 21:36:22.987160 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.986944    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 21:36:22.987621 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.987598    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g89m4\""
Sep 11 21:36:22.987759 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.987742    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 21:36:22.993840 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:22.993815    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"]
Sep 11 21:36:23.001209 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.001186    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkrhv\" (UniqueName: \"kubernetes.io/projected/634570e3-f51b-472a-94c3-fe1319976d6c-kube-api-access-bkrhv\") pod \"kube-auth-proxy-57ddc9f5f6-m2j22\" (UID: \"634570e3-f51b-472a-94c3-fe1319976d6c\") " pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.001315 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.001231    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/634570e3-f51b-472a-94c3-fe1319976d6c-tls-certs\") pod \"kube-auth-proxy-57ddc9f5f6-m2j22\" (UID: \"634570e3-f51b-472a-94c3-fe1319976d6c\") " pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.001361 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.001329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634570e3-f51b-472a-94c3-fe1319976d6c-tmp\") pod \"kube-auth-proxy-57ddc9f5f6-m2j22\" (UID: \"634570e3-f51b-472a-94c3-fe1319976d6c\") " pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.102434 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.102403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634570e3-f51b-472a-94c3-fe1319976d6c-tmp\") pod \"kube-auth-proxy-57ddc9f5f6-m2j22\" (UID: \"634570e3-f51b-472a-94c3-fe1319976d6c\") " pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.102624 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.102492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkrhv\" (UniqueName: \"kubernetes.io/projected/634570e3-f51b-472a-94c3-fe1319976d6c-kube-api-access-bkrhv\") pod \"kube-auth-proxy-57ddc9f5f6-m2j22\" (UID: \"634570e3-f51b-472a-94c3-fe1319976d6c\") " pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.102624 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.102528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/634570e3-f51b-472a-94c3-fe1319976d6c-tls-certs\") pod \"kube-auth-proxy-57ddc9f5f6-m2j22\" (UID: \"634570e3-f51b-472a-94c3-fe1319976d6c\") " pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.105021 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.104993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/634570e3-f51b-472a-94c3-fe1319976d6c-tmp\") pod \"kube-auth-proxy-57ddc9f5f6-m2j22\" (UID: \"634570e3-f51b-472a-94c3-fe1319976d6c\") " pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.105308 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.105288    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/634570e3-f51b-472a-94c3-fe1319976d6c-tls-certs\") pod \"kube-auth-proxy-57ddc9f5f6-m2j22\" (UID: \"634570e3-f51b-472a-94c3-fe1319976d6c\") " pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.117107 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.117083    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkrhv\" (UniqueName: \"kubernetes.io/projected/634570e3-f51b-472a-94c3-fe1319976d6c-kube-api-access-bkrhv\") pod \"kube-auth-proxy-57ddc9f5f6-m2j22\" (UID: \"634570e3-f51b-472a-94c3-fe1319976d6c\") " pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.290676 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.290611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"
Sep 11 21:36:23.586392 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:23.586227    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22"]
Sep 11 21:36:23.589048 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:36:23.589020    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod634570e3_f51b_472a_94c3_fe1319976d6c.slice/crio-860ba625ed3426420eb1b10109e01993d91b846350e4f97bf28c01c5c3fc8f41 WatchSource:0}: Error finding container 860ba625ed3426420eb1b10109e01993d91b846350e4f97bf28c01c5c3fc8f41: Status 404 returned error can't find the container with id 860ba625ed3426420eb1b10109e01993d91b846350e4f97bf28c01c5c3fc8f41
Sep 11 21:36:24.592805 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:24.592713    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22" event={"ID":"634570e3-f51b-472a-94c3-fe1319976d6c","Type":"ContainerStarted","Data":"860ba625ed3426420eb1b10109e01993d91b846350e4f97bf28c01c5c3fc8f41"}
Sep 11 21:36:24.943496 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:24.943433    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"]
Sep 11 21:36:24.950581 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:24.950557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:24.955655 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:24.955455    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 21:36:24.955655 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:24.955512    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 21:36:24.955655 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:24.955572    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-k9928\""
Sep 11 21:36:24.955904 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:24.955879    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 21:36:24.956416 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:24.956037    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 21:36:24.964913 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:24.964885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"]
Sep 11 21:36:25.019447 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.019119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxclx\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-kube-api-access-pxclx\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.019447 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.019176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.019447 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.019253    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.019447 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.019273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.019447 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.019292    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.019447 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.019314    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.019447 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.019340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.120332 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.120297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.120576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.120360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.120576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.120398    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.120576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.120436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.120576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.120542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxclx\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-kube-api-access-pxclx\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.120576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.120573    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.120854 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.120608    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.121341 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.121315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.123418 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.123391    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.123740 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.123713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.124126 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.124104    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.124282 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.124262    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.135336 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.135290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.137382 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.137359    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxclx\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-kube-api-access-pxclx\") pod \"istiod-openshift-gateway-7b7995d5cd-mhpvb\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:25.264377 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:25.264300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:26.542116 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:26.542021    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"]
Sep 11 21:36:26.544233 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:36:26.544205    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a23d05_46e3_4815_8cb9_9ab5fd090e9e.slice/crio-3b83c65ad47f9b43e151427ae4b298e5742cbb3eb3766751c563f2c3341679b3 WatchSource:0}: Error finding container 3b83c65ad47f9b43e151427ae4b298e5742cbb3eb3766751c563f2c3341679b3: Status 404 returned error can't find the container with id 3b83c65ad47f9b43e151427ae4b298e5742cbb3eb3766751c563f2c3341679b3
Sep 11 21:36:26.603195 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:26.603162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22" event={"ID":"634570e3-f51b-472a-94c3-fe1319976d6c","Type":"ContainerStarted","Data":"87c4ef1fcbf59fecab49a6fe5e09922d2e3eb93ec1f9e2ed4b99ee15b730d81b"}
Sep 11 21:36:26.604435 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:26.604412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb" event={"ID":"43a23d05-46e3-4815-8cb9-9ab5fd090e9e","Type":"ContainerStarted","Data":"3b83c65ad47f9b43e151427ae4b298e5742cbb3eb3766751c563f2c3341679b3"}
Sep 11 21:36:26.623097 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:26.623055    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57ddc9f5f6-m2j22" podStartSLOduration=1.8729941509999999 podStartE2EDuration="4.62303956s" totalImagesPullingTime="2.750045409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:26.620395988 +0000 UTC m=+341.277959753" watchObservedRunningTime="2026-09-11 21:36:26.62303956 +0000 UTC m=+341.280603325"
Sep 11 21:36:29.096591 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:29.096544    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:36:29.096956 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:29.096634    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:36:29.625229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:29.624256    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb" event={"ID":"43a23d05-46e3-4815-8cb9-9ab5fd090e9e","Type":"ContainerStarted","Data":"c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010"}
Sep 11 21:36:29.625229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:29.625164    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:29.649372 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:29.649317    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb" podStartSLOduration=3.099336035 podStartE2EDuration="5.649303128s" totalImagesPullingTime="2.549967093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:29.648638524 +0000 UTC m=+344.306202289" watchObservedRunningTime="2026-09-11 21:36:29.649303128 +0000 UTC m=+344.306866892"
Sep 11 21:36:30.631150 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:30.631122    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:43.853168 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.853097    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xf759"]
Sep 11 21:36:43.861613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.861595    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:36:43.864619 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.864595    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 21:36:43.865113 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.865092    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-zbjws\""
Sep 11 21:36:43.865720 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.865697    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"]
Sep 11 21:36:43.869285 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.869267    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:36:43.872275 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.872254    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-fcxvk\""
Sep 11 21:36:43.872500 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.872461    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 21:36:43.874248 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.874228    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xf759"]
Sep 11 21:36:43.881446 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:43.881429    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"]
Sep 11 21:36:44.002053 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.002026    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s4cj\" (UniqueName: \"kubernetes.io/projected/670ac9d9-a874-4259-8bf3-170a220c1d8f-kube-api-access-6s4cj\") pod \"kserve-controller-manager-d6f4b65b8-xf759\" (UID: \"670ac9d9-a874-4259-8bf3-170a220c1d8f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:36:44.002208 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.002071    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5d6b4da-6c4b-49a2-867e-fea920943fe6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-25cqj\" (UID: \"d5d6b4da-6c4b-49a2-867e-fea920943fe6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:36:44.002208 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.002141    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/670ac9d9-a874-4259-8bf3-170a220c1d8f-cert\") pod \"kserve-controller-manager-d6f4b65b8-xf759\" (UID: \"670ac9d9-a874-4259-8bf3-170a220c1d8f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:36:44.002208 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.002158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q78l\" (UniqueName: \"kubernetes.io/projected/d5d6b4da-6c4b-49a2-867e-fea920943fe6-kube-api-access-4q78l\") pod \"llmisvc-controller-manager-777c6bd7d5-25cqj\" (UID: \"d5d6b4da-6c4b-49a2-867e-fea920943fe6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:36:44.103025 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.102993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/670ac9d9-a874-4259-8bf3-170a220c1d8f-cert\") pod \"kserve-controller-manager-d6f4b65b8-xf759\" (UID: \"670ac9d9-a874-4259-8bf3-170a220c1d8f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:36:44.103025 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.103027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q78l\" (UniqueName: \"kubernetes.io/projected/d5d6b4da-6c4b-49a2-867e-fea920943fe6-kube-api-access-4q78l\") pod \"llmisvc-controller-manager-777c6bd7d5-25cqj\" (UID: \"d5d6b4da-6c4b-49a2-867e-fea920943fe6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:36:44.103275 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.103055    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s4cj\" (UniqueName: \"kubernetes.io/projected/670ac9d9-a874-4259-8bf3-170a220c1d8f-kube-api-access-6s4cj\") pod \"kserve-controller-manager-d6f4b65b8-xf759\" (UID: \"670ac9d9-a874-4259-8bf3-170a220c1d8f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:36:44.103275 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.103085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5d6b4da-6c4b-49a2-867e-fea920943fe6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-25cqj\" (UID: \"d5d6b4da-6c4b-49a2-867e-fea920943fe6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:36:44.105662 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.105640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/670ac9d9-a874-4259-8bf3-170a220c1d8f-cert\") pod \"kserve-controller-manager-d6f4b65b8-xf759\" (UID: \"670ac9d9-a874-4259-8bf3-170a220c1d8f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:36:44.105781 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.105761    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d5d6b4da-6c4b-49a2-867e-fea920943fe6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-25cqj\" (UID: \"d5d6b4da-6c4b-49a2-867e-fea920943fe6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:36:44.128775 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.128701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s4cj\" (UniqueName: \"kubernetes.io/projected/670ac9d9-a874-4259-8bf3-170a220c1d8f-kube-api-access-6s4cj\") pod \"kserve-controller-manager-d6f4b65b8-xf759\" (UID: \"670ac9d9-a874-4259-8bf3-170a220c1d8f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:36:44.130301 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.130281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q78l\" (UniqueName: \"kubernetes.io/projected/d5d6b4da-6c4b-49a2-867e-fea920943fe6-kube-api-access-4q78l\") pod \"llmisvc-controller-manager-777c6bd7d5-25cqj\" (UID: \"d5d6b4da-6c4b-49a2-867e-fea920943fe6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:36:44.173156 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.173126    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:36:44.181446 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.181427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:36:44.461194 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.461170    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xf759"]
Sep 11 21:36:44.463260 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:36:44.463226    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod670ac9d9_a874_4259_8bf3_170a220c1d8f.slice/crio-e5cf651f0e3dd196e8fa681fa6f13341ca25f011d53ab44f2ad16fde51bfb92a WatchSource:0}: Error finding container e5cf651f0e3dd196e8fa681fa6f13341ca25f011d53ab44f2ad16fde51bfb92a: Status 404 returned error can't find the container with id e5cf651f0e3dd196e8fa681fa6f13341ca25f011d53ab44f2ad16fde51bfb92a
Sep 11 21:36:44.486590 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.486566    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"]
Sep 11 21:36:44.487650 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:36:44.487626    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd5d6b4da_6c4b_49a2_867e_fea920943fe6.slice/crio-04b401cac495426e189196dc28106758957a597189560b2580ab200e7c34c172 WatchSource:0}: Error finding container 04b401cac495426e189196dc28106758957a597189560b2580ab200e7c34c172: Status 404 returned error can't find the container with id 04b401cac495426e189196dc28106758957a597189560b2580ab200e7c34c172
Sep 11 21:36:44.709260 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.709225    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj" event={"ID":"d5d6b4da-6c4b-49a2-867e-fea920943fe6","Type":"ContainerStarted","Data":"04b401cac495426e189196dc28106758957a597189560b2580ab200e7c34c172"}
Sep 11 21:36:44.710550 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:44.710494    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759" event={"ID":"670ac9d9-a874-4259-8bf3-170a220c1d8f","Type":"ContainerStarted","Data":"e5cf651f0e3dd196e8fa681fa6f13341ca25f011d53ab44f2ad16fde51bfb92a"}
Sep 11 21:36:47.730105 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:47.730066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj" event={"ID":"d5d6b4da-6c4b-49a2-867e-fea920943fe6","Type":"ContainerStarted","Data":"9ad646ab665ed3d0c7dcd42b2294e311a1ef8ffde77a1db3ab9a19df85b67b18"}
Sep 11 21:36:47.730582 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:47.730170    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:36:47.731736 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:47.731714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759" event={"ID":"670ac9d9-a874-4259-8bf3-170a220c1d8f","Type":"ContainerStarted","Data":"dd750269c589e726fe420c6ccb657c57922f2cd500b9b12e44455179853cd9cc"}
Sep 11 21:36:47.731836 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:47.731755    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:36:47.753025 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:47.752980    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj" podStartSLOduration=1.952733486 podStartE2EDuration="4.75296648s" totalImagesPullingTime="2.800232994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:47.752064481 +0000 UTC m=+362.409628248" watchObservedRunningTime="2026-09-11 21:36:47.75296648 +0000 UTC m=+362.410530243"
Sep 11 21:36:47.771914 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:47.771866    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759" podStartSLOduration=1.9971597970000001 podStartE2EDuration="4.77185037s" totalImagesPullingTime="2.774690573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:36:47.771734017 +0000 UTC m=+362.429297781" watchObservedRunningTime="2026-09-11 21:36:47.77185037 +0000 UTC m=+362.429414135"
Sep 11 21:36:50.272836 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.272794    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"]
Sep 11 21:36:50.273224 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.272992    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb" podUID="43a23d05-46e3-4815-8cb9-9ab5fd090e9e" containerName="discovery" containerID="cri-o://c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010" gracePeriod=30
Sep 11 21:36:50.512082 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.512057    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:50.669674 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.669647    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxclx\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-kube-api-access-pxclx\") pod \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") "
Sep 11 21:36:50.669828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.669679    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-token\") pod \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") "
Sep 11 21:36:50.669828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.669718    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-ca-configmap\") pod \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") "
Sep 11 21:36:50.669927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.669840    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-dns-cert\") pod \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") "
Sep 11 21:36:50.669927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.669905    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-cacerts\") pod \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") "
Sep 11 21:36:50.670034 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.669933    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-kubeconfig\") pod \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") "
Sep 11 21:36:50.670034 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.669951    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-local-certs\") pod \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\" (UID: \"43a23d05-46e3-4815-8cb9-9ab5fd090e9e\") "
Sep 11 21:36:50.670145 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.670105    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "43a23d05-46e3-4815-8cb9-9ab5fd090e9e" (UID: "43a23d05-46e3-4815-8cb9-9ab5fd090e9e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:36:50.670310 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.670273    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-ca-configmap\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:50.672547 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.672511    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "43a23d05-46e3-4815-8cb9-9ab5fd090e9e" (UID: "43a23d05-46e3-4815-8cb9-9ab5fd090e9e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:36:50.672653 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.672549    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-local-certs" (OuterVolumeSpecName: "local-certs") pod "43a23d05-46e3-4815-8cb9-9ab5fd090e9e" (UID: "43a23d05-46e3-4815-8cb9-9ab5fd090e9e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:36:50.672653 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.672583    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-token" (OuterVolumeSpecName: "istio-token") pod "43a23d05-46e3-4815-8cb9-9ab5fd090e9e" (UID: "43a23d05-46e3-4815-8cb9-9ab5fd090e9e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:36:50.672653 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.672605    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-cacerts" (OuterVolumeSpecName: "cacerts") pod "43a23d05-46e3-4815-8cb9-9ab5fd090e9e" (UID: "43a23d05-46e3-4815-8cb9-9ab5fd090e9e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:36:50.672653 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.672636    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "43a23d05-46e3-4815-8cb9-9ab5fd090e9e" (UID: "43a23d05-46e3-4815-8cb9-9ab5fd090e9e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:36:50.672795 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.672674    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-kube-api-access-pxclx" (OuterVolumeSpecName: "kube-api-access-pxclx") pod "43a23d05-46e3-4815-8cb9-9ab5fd090e9e" (UID: "43a23d05-46e3-4815-8cb9-9ab5fd090e9e"). InnerVolumeSpecName "kube-api-access-pxclx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:36:50.748452 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.748422    2577 generic.go:356] "Generic (PLEG): container finished" podID="43a23d05-46e3-4815-8cb9-9ab5fd090e9e" containerID="c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010" exitCode=0
Sep 11 21:36:50.748577 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.748489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb" event={"ID":"43a23d05-46e3-4815-8cb9-9ab5fd090e9e","Type":"ContainerDied","Data":"c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010"}
Sep 11 21:36:50.748577 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.748493    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"
Sep 11 21:36:50.748577 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.748550    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb" event={"ID":"43a23d05-46e3-4815-8cb9-9ab5fd090e9e","Type":"ContainerDied","Data":"3b83c65ad47f9b43e151427ae4b298e5742cbb3eb3766751c563f2c3341679b3"}
Sep 11 21:36:50.748577 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.748569    2577 scope.go:117] "RemoveContainer" containerID="c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010"
Sep 11 21:36:50.757295 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.757277    2577 scope.go:117] "RemoveContainer" containerID="c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010"
Sep 11 21:36:50.757577 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:36:50.757550    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010\": container with ID starting with c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010 not found: ID does not exist" containerID="c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010"
Sep 11 21:36:50.757644 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.757589    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010"} err="failed to get container status \"c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010\": rpc error: code = NotFound desc = could not find container \"c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010\": container with ID starting with c27696a524a7e97a528af257c4e507e7603e27d0d21c1a86832212fcae597010 not found: ID does not exist"
Sep 11 21:36:50.770217 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.770196    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"]
Sep 11 21:36:50.771509 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.771489    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-csr-dns-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:50.771562 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.771515    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-cacerts\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:50.771562 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.771529    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-kubeconfig\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:50.771562 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.771538    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-local-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:50.771562 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.771546    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxclx\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-kube-api-access-pxclx\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:50.771562 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.771554    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a23d05-46e3-4815-8cb9-9ab5fd090e9e-istio-token\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:36:50.774694 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:50.774673    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-mhpvb"]
Sep 11 21:36:51.759986 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:36:51.759955    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43a23d05-46e3-4815-8cb9-9ab5fd090e9e" path="/var/lib/kubelet/pods/43a23d05-46e3-4815-8cb9-9ab5fd090e9e/volumes"
Sep 11 21:37:12.597513 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.597481    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c5bbc9d79-jt78h"]
Sep 11 21:37:12.597954 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.597850    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a23d05-46e3-4815-8cb9-9ab5fd090e9e" containerName="discovery"
Sep 11 21:37:12.597954 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.597862    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a23d05-46e3-4815-8cb9-9ab5fd090e9e" containerName="discovery"
Sep 11 21:37:12.597954 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.597921    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a23d05-46e3-4815-8cb9-9ab5fd090e9e" containerName="discovery"
Sep 11 21:37:12.599872 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.599854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.615144 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.615120    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5bbc9d79-jt78h"]
Sep 11 21:37:12.646417 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.646389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-oauth-serving-cert\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.646559 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.646493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-console-oauth-config\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.646559 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.646521    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lc4h\" (UniqueName: \"kubernetes.io/projected/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-kube-api-access-2lc4h\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.646641 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.646571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-console-config\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.646641 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.646601    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-service-ca\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.646714 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.646641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-console-serving-cert\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.646714 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.646658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-trusted-ca-bundle\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.747255 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.747229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-service-ca\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.747376 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.747262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-console-serving-cert\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.747376 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.747278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-trusted-ca-bundle\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.747453 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.747402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-oauth-serving-cert\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.747541 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.747525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-console-oauth-config\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.747583 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.747555    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lc4h\" (UniqueName: \"kubernetes.io/projected/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-kube-api-access-2lc4h\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.747635 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.747599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-console-config\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.748089 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.748064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-service-ca\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.748588 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.748149    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-oauth-serving-cert\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.748588 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.748210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-trusted-ca-bundle\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.748588 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.748217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-console-config\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.749898 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.749880    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-console-serving-cert\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.750082 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.750063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-console-oauth-config\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.755843 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.755823    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lc4h\" (UniqueName: \"kubernetes.io/projected/0d48d188-b2aa-4a3f-9fde-4ca3034f819a-kube-api-access-2lc4h\") pod \"console-5c5bbc9d79-jt78h\" (UID: \"0d48d188-b2aa-4a3f-9fde-4ca3034f819a\") " pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:12.910699 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:12.910614    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:13.181828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:13.181807    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c5bbc9d79-jt78h"]
Sep 11 21:37:13.184139 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:37:13.184112    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d48d188_b2aa_4a3f_9fde_4ca3034f819a.slice/crio-03d8677006ae7826aadb48f900747d545a094d7dfb0dcfbb182c924e0803807f WatchSource:0}: Error finding container 03d8677006ae7826aadb48f900747d545a094d7dfb0dcfbb182c924e0803807f: Status 404 returned error can't find the container with id 03d8677006ae7826aadb48f900747d545a094d7dfb0dcfbb182c924e0803807f
Sep 11 21:37:13.862715 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:13.862679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5bbc9d79-jt78h" event={"ID":"0d48d188-b2aa-4a3f-9fde-4ca3034f819a","Type":"ContainerStarted","Data":"8464a6c3ffbb5dee7e6b33ac1604508372d3fc23e31983891c9403f15742ec20"}
Sep 11 21:37:13.863108 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:13.862738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c5bbc9d79-jt78h" event={"ID":"0d48d188-b2aa-4a3f-9fde-4ca3034f819a","Type":"ContainerStarted","Data":"03d8677006ae7826aadb48f900747d545a094d7dfb0dcfbb182c924e0803807f"}
Sep 11 21:37:13.884203 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:13.884144    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c5bbc9d79-jt78h" podStartSLOduration=1.884129482 podStartE2EDuration="1.884129482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:37:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:37:13.881200431 +0000 UTC m=+388.538764199" watchObservedRunningTime="2026-09-11 21:37:13.884129482 +0000 UTC m=+388.541693246"
Sep 11 21:37:18.739190 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:18.739159    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-25cqj"
Sep 11 21:37:18.741880 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:18.741856    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xf759"
Sep 11 21:37:22.911554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:22.911525    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:22.911971 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:22.911584    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:22.916377 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:22.916352    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:23.913992 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:23.913962    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c5bbc9d79-jt78h"
Sep 11 21:37:23.961656 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:23.961619    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c76dfb7bd-zpxhh"]
Sep 11 21:37:39.353591 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.353559    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"]
Sep 11 21:37:39.356314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.356291    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.358956 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.358933    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-n8slz\""
Sep 11 21:37:39.359063 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.358938    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 21:37:39.360419 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.360398    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 21:37:39.370390 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.370368    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"]
Sep 11 21:37:39.457651 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.457621    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"]
Sep 11 21:37:39.460143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.460128    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.472750 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.472720    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"]
Sep 11 21:37:39.475685 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.475664    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.475795 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.475696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjmvr\" (UniqueName: \"kubernetes.io/projected/adc42a98-4a86-4964-85e3-42b00c42294f-kube-api-access-gjmvr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.475795 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.475789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.561293 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.561256    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"]
Sep 11 21:37:39.563806 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.563787    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.573739 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.573714    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"]
Sep 11 21:37:39.576798 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.576775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xxs4\" (UniqueName: \"kubernetes.io/projected/d8b00386-1bd7-434b-9e04-70cee872df99-kube-api-access-2xxs4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.576925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.576819    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.576925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.576838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjmvr\" (UniqueName: \"kubernetes.io/projected/adc42a98-4a86-4964-85e3-42b00c42294f-kube-api-access-gjmvr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.576925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.576870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.576925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.576908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.576925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.576926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.577254 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.577236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.577309 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.577236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.586045 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.586011    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjmvr\" (UniqueName: \"kubernetes.io/projected/adc42a98-4a86-4964-85e3-42b00c42294f-kube-api-access-gjmvr\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.663492 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.663406    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"]
Sep 11 21:37:39.666250 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.666230    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.669251 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.669231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:39.677856 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.677823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.677972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.677895    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.677972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.677948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2plnc\" (UniqueName: \"kubernetes.io/projected/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-kube-api-access-2plnc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.678151 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.678005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xxs4\" (UniqueName: \"kubernetes.io/projected/d8b00386-1bd7-434b-9e04-70cee872df99-kube-api-access-2xxs4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.678151 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.678031    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.678151 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.678087    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.678313 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.678212    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.678417 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.678397    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.680368 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.680306    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"]
Sep 11 21:37:39.690305 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.690284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xxs4\" (UniqueName: \"kubernetes.io/projected/d8b00386-1bd7-434b-9e04-70cee872df99-kube-api-access-2xxs4\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.768772 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.768739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:39.778835 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.778808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.779551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.779009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6gvj\" (UniqueName: \"kubernetes.io/projected/4d5e2858-4971-4421-9646-51e05644735c-kube-api-access-z6gvj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.779551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.779101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.779551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.779147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2plnc\" (UniqueName: \"kubernetes.io/projected/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-kube-api-access-2plnc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.779551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.779184    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.779551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.779190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.779551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.779278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.779919 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.779584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.789814 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.789789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2plnc\" (UniqueName: \"kubernetes.io/projected/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-kube-api-access-2plnc\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.872834 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.872800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:37:39.879840 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.879815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6gvj\" (UniqueName: \"kubernetes.io/projected/4d5e2858-4971-4421-9646-51e05644735c-kube-api-access-z6gvj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.879940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.879889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.879979 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.879936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.880301 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.880282    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.880337 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.880289    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.889201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.889180    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6gvj\" (UniqueName: \"kubernetes.io/projected/4d5e2858-4971-4421-9646-51e05644735c-kube-api-access-z6gvj\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.952038 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.951917    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"]
Sep 11 21:37:39.954816 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:37:39.954776    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc42a98_4a86_4964_85e3_42b00c42294f.slice/crio-30bcc7bc759c8f0598218b6393602e691666dc87f4080cc430ee447d241cec4d WatchSource:0}: Error finding container 30bcc7bc759c8f0598218b6393602e691666dc87f4080cc430ee447d241cec4d: Status 404 returned error can't find the container with id 30bcc7bc759c8f0598218b6393602e691666dc87f4080cc430ee447d241cec4d
Sep 11 21:37:39.975866 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.975846    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:39.992318 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:39.992291    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn" event={"ID":"adc42a98-4a86-4964-85e3-42b00c42294f","Type":"ContainerStarted","Data":"30bcc7bc759c8f0598218b6393602e691666dc87f4080cc430ee447d241cec4d"}
Sep 11 21:37:40.061901 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:40.061873    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"]
Sep 11 21:37:40.064679 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:37:40.064649    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8b00386_1bd7_434b_9e04_70cee872df99.slice/crio-4be33ebc6f773c3d7b47dbf880d6023eb88f28d0f214a2f020732ce905abd15b WatchSource:0}: Error finding container 4be33ebc6f773c3d7b47dbf880d6023eb88f28d0f214a2f020732ce905abd15b: Status 404 returned error can't find the container with id 4be33ebc6f773c3d7b47dbf880d6023eb88f28d0f214a2f020732ce905abd15b
Sep 11 21:37:40.149974 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:40.149950    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"]
Sep 11 21:37:40.150676 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:37:40.150652    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf37f9f_9a51_485a_b9b5_37037d75e3a6.slice/crio-39b9835f0ebc6f456a34312c40c4de7d46b6a3ddee5364fa682deb0397ca88a6 WatchSource:0}: Error finding container 39b9835f0ebc6f456a34312c40c4de7d46b6a3ddee5364fa682deb0397ca88a6: Status 404 returned error can't find the container with id 39b9835f0ebc6f456a34312c40c4de7d46b6a3ddee5364fa682deb0397ca88a6
Sep 11 21:37:40.257302 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:40.257276    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"]
Sep 11 21:37:40.298266 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:37:40.298233    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5e2858_4971_4421_9646_51e05644735c.slice/crio-a56376cfdbcee24cb9d31a7a3a09b7d9ab37144dda6e67b2a7970bad44fe8c16 WatchSource:0}: Error finding container a56376cfdbcee24cb9d31a7a3a09b7d9ab37144dda6e67b2a7970bad44fe8c16: Status 404 returned error can't find the container with id a56376cfdbcee24cb9d31a7a3a09b7d9ab37144dda6e67b2a7970bad44fe8c16
Sep 11 21:37:41.001738 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.001706    2577 generic.go:356] "Generic (PLEG): container finished" podID="adc42a98-4a86-4964-85e3-42b00c42294f" containerID="6086999f96b94ad03f3b4c7d8d24901de84d1b63d751f9ee94415e4dfa59de6d" exitCode=0
Sep 11 21:37:41.002114 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.001792    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn" event={"ID":"adc42a98-4a86-4964-85e3-42b00c42294f","Type":"ContainerDied","Data":"6086999f96b94ad03f3b4c7d8d24901de84d1b63d751f9ee94415e4dfa59de6d"}
Sep 11 21:37:41.003355 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.003337    2577 generic.go:356] "Generic (PLEG): container finished" podID="4d5e2858-4971-4421-9646-51e05644735c" containerID="4b0f832cea0a5a1203f9a4a2de1092a1c1a240149aad3bfadbe1d60fd7c73c36" exitCode=0
Sep 11 21:37:41.003436 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.003364    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl" event={"ID":"4d5e2858-4971-4421-9646-51e05644735c","Type":"ContainerDied","Data":"4b0f832cea0a5a1203f9a4a2de1092a1c1a240149aad3bfadbe1d60fd7c73c36"}
Sep 11 21:37:41.003436 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.003408    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl" event={"ID":"4d5e2858-4971-4421-9646-51e05644735c","Type":"ContainerStarted","Data":"a56376cfdbcee24cb9d31a7a3a09b7d9ab37144dda6e67b2a7970bad44fe8c16"}
Sep 11 21:37:41.005120 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.005100    2577 generic.go:356] "Generic (PLEG): container finished" podID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerID="9819893fb4f0f880996cb327dceaca5c193073534430a302dd335937466d404a" exitCode=0
Sep 11 21:37:41.005291 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.005161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9" event={"ID":"fbf37f9f-9a51-485a-b9b5-37037d75e3a6","Type":"ContainerDied","Data":"9819893fb4f0f880996cb327dceaca5c193073534430a302dd335937466d404a"}
Sep 11 21:37:41.005291 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.005193    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9" event={"ID":"fbf37f9f-9a51-485a-b9b5-37037d75e3a6","Type":"ContainerStarted","Data":"39b9835f0ebc6f456a34312c40c4de7d46b6a3ddee5364fa682deb0397ca88a6"}
Sep 11 21:37:41.006876 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.006851    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8b00386-1bd7-434b-9e04-70cee872df99" containerID="cba2455e4a45d6caf8e7920c2a2b7f7768e2ff535694113b5d2104414d235761" exitCode=0
Sep 11 21:37:41.006971 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.006913    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw" event={"ID":"d8b00386-1bd7-434b-9e04-70cee872df99","Type":"ContainerDied","Data":"cba2455e4a45d6caf8e7920c2a2b7f7768e2ff535694113b5d2104414d235761"}
Sep 11 21:37:41.006971 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:41.006948    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw" event={"ID":"d8b00386-1bd7-434b-9e04-70cee872df99","Type":"ContainerStarted","Data":"4be33ebc6f773c3d7b47dbf880d6023eb88f28d0f214a2f020732ce905abd15b"}
Sep 11 21:37:42.014371 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:42.014332    2577 generic.go:356] "Generic (PLEG): container finished" podID="adc42a98-4a86-4964-85e3-42b00c42294f" containerID="189b7235aa63a205b0b50893580821ba019040d636693fdb9c62f453876dc2d9" exitCode=0
Sep 11 21:37:42.014845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:42.014406    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn" event={"ID":"adc42a98-4a86-4964-85e3-42b00c42294f","Type":"ContainerDied","Data":"189b7235aa63a205b0b50893580821ba019040d636693fdb9c62f453876dc2d9"}
Sep 11 21:37:42.016422 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:42.016400    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8b00386-1bd7-434b-9e04-70cee872df99" containerID="ccd65d482ed7af5505654d69e7d94a37e9aef687886699af50a8b323d098c28b" exitCode=0
Sep 11 21:37:42.016521 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:42.016445    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw" event={"ID":"d8b00386-1bd7-434b-9e04-70cee872df99","Type":"ContainerDied","Data":"ccd65d482ed7af5505654d69e7d94a37e9aef687886699af50a8b323d098c28b"}
Sep 11 21:37:43.024388 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:43.024308    2577 generic.go:356] "Generic (PLEG): container finished" podID="adc42a98-4a86-4964-85e3-42b00c42294f" containerID="5cfc858716aab11a5c2f3e60cb52ce512258baf8acab4dad08f18c02b36eec2c" exitCode=0
Sep 11 21:37:43.024789 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:43.024391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn" event={"ID":"adc42a98-4a86-4964-85e3-42b00c42294f","Type":"ContainerDied","Data":"5cfc858716aab11a5c2f3e60cb52ce512258baf8acab4dad08f18c02b36eec2c"}
Sep 11 21:37:43.026425 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:43.026405    2577 generic.go:356] "Generic (PLEG): container finished" podID="4d5e2858-4971-4421-9646-51e05644735c" containerID="a3075611817b9d82b60c8eda52d6bec72fe3ec7f144659772dedd824a53a271d" exitCode=0
Sep 11 21:37:43.026582 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:43.026498    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl" event={"ID":"4d5e2858-4971-4421-9646-51e05644735c","Type":"ContainerDied","Data":"a3075611817b9d82b60c8eda52d6bec72fe3ec7f144659772dedd824a53a271d"}
Sep 11 21:37:43.029018 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:43.028992    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8b00386-1bd7-434b-9e04-70cee872df99" containerID="7f3e85db3e1689ac2558c7925080929cacd51f0d40856bf71d60625ff3e48a6e" exitCode=0
Sep 11 21:37:43.029128 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:43.029094    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw" event={"ID":"d8b00386-1bd7-434b-9e04-70cee872df99","Type":"ContainerDied","Data":"7f3e85db3e1689ac2558c7925080929cacd51f0d40856bf71d60625ff3e48a6e"}
Sep 11 21:37:44.037222 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.037185    2577 generic.go:356] "Generic (PLEG): container finished" podID="4d5e2858-4971-4421-9646-51e05644735c" containerID="36dfc1a69c01a482fcf665f12b6162ef6ff816d6fc4c189f8626d95728413272" exitCode=0
Sep 11 21:37:44.037773 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.037274    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl" event={"ID":"4d5e2858-4971-4421-9646-51e05644735c","Type":"ContainerDied","Data":"36dfc1a69c01a482fcf665f12b6162ef6ff816d6fc4c189f8626d95728413272"}
Sep 11 21:37:44.166279 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.166254    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:44.193107 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.193086    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:44.318516 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.318416    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjmvr\" (UniqueName: \"kubernetes.io/projected/adc42a98-4a86-4964-85e3-42b00c42294f-kube-api-access-gjmvr\") pod \"adc42a98-4a86-4964-85e3-42b00c42294f\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") "
Sep 11 21:37:44.318516 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.318507    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-util\") pod \"adc42a98-4a86-4964-85e3-42b00c42294f\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") "
Sep 11 21:37:44.318699 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.318541    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-bundle\") pod \"adc42a98-4a86-4964-85e3-42b00c42294f\" (UID: \"adc42a98-4a86-4964-85e3-42b00c42294f\") "
Sep 11 21:37:44.318699 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.318580    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-util\") pod \"d8b00386-1bd7-434b-9e04-70cee872df99\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") "
Sep 11 21:37:44.318699 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.318609    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-bundle\") pod \"d8b00386-1bd7-434b-9e04-70cee872df99\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") "
Sep 11 21:37:44.318699 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.318674    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xxs4\" (UniqueName: \"kubernetes.io/projected/d8b00386-1bd7-434b-9e04-70cee872df99-kube-api-access-2xxs4\") pod \"d8b00386-1bd7-434b-9e04-70cee872df99\" (UID: \"d8b00386-1bd7-434b-9e04-70cee872df99\") "
Sep 11 21:37:44.319323 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.319247    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-bundle" (OuterVolumeSpecName: "bundle") pod "adc42a98-4a86-4964-85e3-42b00c42294f" (UID: "adc42a98-4a86-4964-85e3-42b00c42294f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:37:44.319408 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.319366    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-bundle" (OuterVolumeSpecName: "bundle") pod "d8b00386-1bd7-434b-9e04-70cee872df99" (UID: "d8b00386-1bd7-434b-9e04-70cee872df99"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:37:44.320829 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.320803    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc42a98-4a86-4964-85e3-42b00c42294f-kube-api-access-gjmvr" (OuterVolumeSpecName: "kube-api-access-gjmvr") pod "adc42a98-4a86-4964-85e3-42b00c42294f" (UID: "adc42a98-4a86-4964-85e3-42b00c42294f"). InnerVolumeSpecName "kube-api-access-gjmvr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:37:44.320931 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.320873    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8b00386-1bd7-434b-9e04-70cee872df99-kube-api-access-2xxs4" (OuterVolumeSpecName: "kube-api-access-2xxs4") pod "d8b00386-1bd7-434b-9e04-70cee872df99" (UID: "d8b00386-1bd7-434b-9e04-70cee872df99"). InnerVolumeSpecName "kube-api-access-2xxs4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:37:44.323638 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.323616    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-util" (OuterVolumeSpecName: "util") pod "d8b00386-1bd7-434b-9e04-70cee872df99" (UID: "d8b00386-1bd7-434b-9e04-70cee872df99"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:37:44.326542 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.326519    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-util" (OuterVolumeSpecName: "util") pod "adc42a98-4a86-4964-85e3-42b00c42294f" (UID: "adc42a98-4a86-4964-85e3-42b00c42294f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:37:44.420341 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.420315    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xxs4\" (UniqueName: \"kubernetes.io/projected/d8b00386-1bd7-434b-9e04-70cee872df99-kube-api-access-2xxs4\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:44.420341 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.420343    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjmvr\" (UniqueName: \"kubernetes.io/projected/adc42a98-4a86-4964-85e3-42b00c42294f-kube-api-access-gjmvr\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:44.420540 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.420356    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-util\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:44.420540 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.420369    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/adc42a98-4a86-4964-85e3-42b00c42294f-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:44.420540 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.420378    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-util\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:44.420540 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:44.420385    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8b00386-1bd7-434b-9e04-70cee872df99-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:45.044830 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.044804    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn"
Sep 11 21:37:45.045288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.044799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cchjqn" event={"ID":"adc42a98-4a86-4964-85e3-42b00c42294f","Type":"ContainerDied","Data":"30bcc7bc759c8f0598218b6393602e691666dc87f4080cc430ee447d241cec4d"}
Sep 11 21:37:45.045288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.044953    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="30bcc7bc759c8f0598218b6393602e691666dc87f4080cc430ee447d241cec4d"
Sep 11 21:37:45.046834 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.046807    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw" event={"ID":"d8b00386-1bd7-434b-9e04-70cee872df99","Type":"ContainerDied","Data":"4be33ebc6f773c3d7b47dbf880d6023eb88f28d0f214a2f020732ce905abd15b"}
Sep 11 21:37:45.046976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.046845    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8kdtw"
Sep 11 21:37:45.046976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.046848    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4be33ebc6f773c3d7b47dbf880d6023eb88f28d0f214a2f020732ce905abd15b"
Sep 11 21:37:45.185610 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.185585    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:45.328650 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.328576    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-util\") pod \"4d5e2858-4971-4421-9646-51e05644735c\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") "
Sep 11 21:37:45.328650 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.328636    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6gvj\" (UniqueName: \"kubernetes.io/projected/4d5e2858-4971-4421-9646-51e05644735c-kube-api-access-z6gvj\") pod \"4d5e2858-4971-4421-9646-51e05644735c\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") "
Sep 11 21:37:45.328844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.328692    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-bundle\") pod \"4d5e2858-4971-4421-9646-51e05644735c\" (UID: \"4d5e2858-4971-4421-9646-51e05644735c\") "
Sep 11 21:37:45.329182 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.329155    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-bundle" (OuterVolumeSpecName: "bundle") pod "4d5e2858-4971-4421-9646-51e05644735c" (UID: "4d5e2858-4971-4421-9646-51e05644735c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:37:45.330819 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.330795    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d5e2858-4971-4421-9646-51e05644735c-kube-api-access-z6gvj" (OuterVolumeSpecName: "kube-api-access-z6gvj") pod "4d5e2858-4971-4421-9646-51e05644735c" (UID: "4d5e2858-4971-4421-9646-51e05644735c"). InnerVolumeSpecName "kube-api-access-z6gvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:37:45.334100 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.334067    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-util" (OuterVolumeSpecName: "util") pod "4d5e2858-4971-4421-9646-51e05644735c" (UID: "4d5e2858-4971-4421-9646-51e05644735c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:37:45.429783 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.429747    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:45.429783 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.429779    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d5e2858-4971-4421-9646-51e05644735c-util\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:45.429783 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:45.429788    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6gvj\" (UniqueName: \"kubernetes.io/projected/4d5e2858-4971-4421-9646-51e05644735c-kube-api-access-z6gvj\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:46.054285 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:46.054206    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl"
Sep 11 21:37:46.054285 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:46.054230    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6sphxl" event={"ID":"4d5e2858-4971-4421-9646-51e05644735c","Type":"ContainerDied","Data":"a56376cfdbcee24cb9d31a7a3a09b7d9ab37144dda6e67b2a7970bad44fe8c16"}
Sep 11 21:37:46.054285 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:46.054284    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a56376cfdbcee24cb9d31a7a3a09b7d9ab37144dda6e67b2a7970bad44fe8c16"
Sep 11 21:37:48.983360 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:48.983295    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c76dfb7bd-zpxhh" podUID="b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" containerName="console" containerID="cri-o://71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b" gracePeriod=15
Sep 11 21:37:49.219704 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.219683    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:37:49.365428 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365331    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-service-ca\") pod \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") "
Sep 11 21:37:49.365428 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365407    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-config\") pod \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") "
Sep 11 21:37:49.365710 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365437    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-oauth-config\") pod \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") "
Sep 11 21:37:49.365710 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365496    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-trusted-ca-bundle\") pod \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") "
Sep 11 21:37:49.365710 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365556    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-serving-cert\") pod \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") "
Sep 11 21:37:49.365710 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365600    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-oauth-serving-cert\") pod \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") "
Sep 11 21:37:49.365710 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365636    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgkmx\" (UniqueName: \"kubernetes.io/projected/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-kube-api-access-vgkmx\") pod \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\" (UID: \"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9\") "
Sep 11 21:37:49.365934 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365866    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-config" (OuterVolumeSpecName: "console-config") pod "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" (UID: "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:37:49.365934 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365782    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-service-ca" (OuterVolumeSpecName: "service-ca") pod "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" (UID: "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:37:49.366050 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.365984    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" (UID: "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:37:49.366156 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.366135    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" (UID: "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:37:49.367809 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.367785    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" (UID: "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:37:49.367905 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.367834    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" (UID: "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:37:49.367905 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.367858    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-kube-api-access-vgkmx" (OuterVolumeSpecName: "kube-api-access-vgkmx") pod "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" (UID: "b8ef843a-e81e-4cde-9120-1cc4ae3d27b9"). InnerVolumeSpecName "kube-api-access-vgkmx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:37:49.467242 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.467218    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:49.467242 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.467237    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-config\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:49.467242 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.467246    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-oauth-config\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:49.467413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.467254    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-trusted-ca-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:49.467413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.467263    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-console-serving-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:49.467413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.467271    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-oauth-serving-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:49.467413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:49.467281    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgkmx\" (UniqueName: \"kubernetes.io/projected/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9-kube-api-access-vgkmx\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:37:50.076572 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:50.076484    2577 generic.go:356] "Generic (PLEG): container finished" podID="b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" containerID="71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b" exitCode=0
Sep 11 21:37:50.076572 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:50.076528    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c76dfb7bd-zpxhh"
Sep 11 21:37:50.076984 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:50.076573    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c76dfb7bd-zpxhh" event={"ID":"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9","Type":"ContainerDied","Data":"71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b"}
Sep 11 21:37:50.076984 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:50.076631    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c76dfb7bd-zpxhh" event={"ID":"b8ef843a-e81e-4cde-9120-1cc4ae3d27b9","Type":"ContainerDied","Data":"47818859ffa0e38cbcf26b7e0de5706e24e742f5cdeffbc6f532bc5d3fa5dabf"}
Sep 11 21:37:50.076984 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:50.076657    2577 scope.go:117] "RemoveContainer" containerID="71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b"
Sep 11 21:37:50.085602 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:50.085571    2577 scope.go:117] "RemoveContainer" containerID="71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b"
Sep 11 21:37:50.085873 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:37:50.085855    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b\": container with ID starting with 71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b not found: ID does not exist" containerID="71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b"
Sep 11 21:37:50.085927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:50.085882    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b"} err="failed to get container status \"71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b\": rpc error: code = NotFound desc = could not find container \"71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b\": container with ID starting with 71901892248ab4f038f8081adaebc76de0902a3c34948f4367fdd7e27108339b not found: ID does not exist"
Sep 11 21:37:50.094209 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:50.094187    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c76dfb7bd-zpxhh"]
Sep 11 21:37:50.098671 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:50.098652    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c76dfb7bd-zpxhh"]
Sep 11 21:37:51.761628 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:51.761594    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" path="/var/lib/kubelet/pods/b8ef843a-e81e-4cde-9120-1cc4ae3d27b9/volumes"
Sep 11 21:37:59.124702 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:59.124669    2577 generic.go:356] "Generic (PLEG): container finished" podID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerID="79b18af4858d66fb81ef2dea0670d3e2cfffefbb023ffb5ed9e41e831a6d4367" exitCode=0
Sep 11 21:37:59.125135 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:37:59.124720    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9" event={"ID":"fbf37f9f-9a51-485a-b9b5-37037d75e3a6","Type":"ContainerDied","Data":"79b18af4858d66fb81ef2dea0670d3e2cfffefbb023ffb5ed9e41e831a6d4367"}
Sep 11 21:38:00.132331 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:00.132298    2577 generic.go:356] "Generic (PLEG): container finished" podID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerID="b9d3e9ef7ebb85508fe50dd4c2513358b15771249366c8cb1e871793cef9eab6" exitCode=0
Sep 11 21:38:00.132733 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:00.132389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9" event={"ID":"fbf37f9f-9a51-485a-b9b5-37037d75e3a6","Type":"ContainerDied","Data":"b9d3e9ef7ebb85508fe50dd4c2513358b15771249366c8cb1e871793cef9eab6"}
Sep 11 21:38:01.265622 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.265600    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:38:01.372834 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.372808    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2plnc\" (UniqueName: \"kubernetes.io/projected/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-kube-api-access-2plnc\") pod \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") "
Sep 11 21:38:01.372978 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.372921    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-bundle\") pod \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") "
Sep 11 21:38:01.372978 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.372944    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-util\") pod \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\" (UID: \"fbf37f9f-9a51-485a-b9b5-37037d75e3a6\") "
Sep 11 21:38:01.373407 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.373383    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-bundle" (OuterVolumeSpecName: "bundle") pod "fbf37f9f-9a51-485a-b9b5-37037d75e3a6" (UID: "fbf37f9f-9a51-485a-b9b5-37037d75e3a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:01.374989 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.374968    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-kube-api-access-2plnc" (OuterVolumeSpecName: "kube-api-access-2plnc") pod "fbf37f9f-9a51-485a-b9b5-37037d75e3a6" (UID: "fbf37f9f-9a51-485a-b9b5-37037d75e3a6"). InnerVolumeSpecName "kube-api-access-2plnc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:01.377361 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.377334    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-util" (OuterVolumeSpecName: "util") pod "fbf37f9f-9a51-485a-b9b5-37037d75e3a6" (UID: "fbf37f9f-9a51-485a-b9b5-37037d75e3a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:01.474124 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.474098    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-bundle\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:01.474124 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.474123    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-util\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:01.474279 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:01.474136    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2plnc\" (UniqueName: \"kubernetes.io/projected/fbf37f9f-9a51-485a-b9b5-37037d75e3a6-kube-api-access-2plnc\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:02.145100 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:02.145023    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9"
Sep 11 21:38:02.145100 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:02.145058    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7cc9v9" event={"ID":"fbf37f9f-9a51-485a-b9b5-37037d75e3a6","Type":"ContainerDied","Data":"39b9835f0ebc6f456a34312c40c4de7d46b6a3ddee5364fa682deb0397ca88a6"}
Sep 11 21:38:02.145316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:02.145108    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="39b9835f0ebc6f456a34312c40c4de7d46b6a3ddee5364fa682deb0397ca88a6"
Sep 11 21:38:10.887846 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.887775    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-k26vd"]
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888114    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc42a98-4a86-4964-85e3-42b00c42294f" containerName="util"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888125    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc42a98-4a86-4964-85e3-42b00c42294f" containerName="util"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888137    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerName="util"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888143    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerName="util"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888153    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" containerName="console"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888159    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" containerName="console"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888165    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d5e2858-4971-4421-9646-51e05644735c" containerName="pull"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888169    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d5e2858-4971-4421-9646-51e05644735c" containerName="pull"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888176    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d5e2858-4971-4421-9646-51e05644735c" containerName="extract"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888181    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d5e2858-4971-4421-9646-51e05644735c" containerName="extract"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888191    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc42a98-4a86-4964-85e3-42b00c42294f" containerName="pull"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888195    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc42a98-4a86-4964-85e3-42b00c42294f" containerName="pull"
Sep 11 21:38:10.888198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888203    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b00386-1bd7-434b-9e04-70cee872df99" containerName="extract"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888208    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b00386-1bd7-434b-9e04-70cee872df99" containerName="extract"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888215    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerName="extract"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888219    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerName="extract"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888226    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b00386-1bd7-434b-9e04-70cee872df99" containerName="util"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888230    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b00386-1bd7-434b-9e04-70cee872df99" containerName="util"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888236    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d5e2858-4971-4421-9646-51e05644735c" containerName="util"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888241    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d5e2858-4971-4421-9646-51e05644735c" containerName="util"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888246    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8b00386-1bd7-434b-9e04-70cee872df99" containerName="pull"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888251    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8b00386-1bd7-434b-9e04-70cee872df99" containerName="pull"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888258    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc42a98-4a86-4964-85e3-42b00c42294f" containerName="extract"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888262    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc42a98-4a86-4964-85e3-42b00c42294f" containerName="extract"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888268    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerName="pull"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888272    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerName="pull"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888327    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbf37f9f-9a51-485a-b9b5-37037d75e3a6" containerName="extract"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888336    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d5e2858-4971-4421-9646-51e05644735c" containerName="extract"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888342    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc42a98-4a86-4964-85e3-42b00c42294f" containerName="extract"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888348    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8ef843a-e81e-4cde-9120-1cc4ae3d27b9" containerName="console"
Sep 11 21:38:10.888612 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.888356    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8b00386-1bd7-434b-9e04-70cee872df99" containerName="extract"
Sep 11 21:38:10.891297 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.891275    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-k26vd"
Sep 11 21:38:10.894880 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.894854    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 21:38:10.895019 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.894899    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-m86k9\""
Sep 11 21:38:10.895859 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.895842    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 21:38:10.919911 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.919887    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-k26vd"]
Sep 11 21:38:10.955585 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:10.955556    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttgl5\" (UniqueName: \"kubernetes.io/projected/416925e6-86ac-4eff-9e55-5269696f6b1d-kube-api-access-ttgl5\") pod \"authorino-operator-76b478bd78-k26vd\" (UID: \"416925e6-86ac-4eff-9e55-5269696f6b1d\") " pod="kuadrant-system/authorino-operator-76b478bd78-k26vd"
Sep 11 21:38:11.056911 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:11.056882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttgl5\" (UniqueName: \"kubernetes.io/projected/416925e6-86ac-4eff-9e55-5269696f6b1d-kube-api-access-ttgl5\") pod \"authorino-operator-76b478bd78-k26vd\" (UID: \"416925e6-86ac-4eff-9e55-5269696f6b1d\") " pod="kuadrant-system/authorino-operator-76b478bd78-k26vd"
Sep 11 21:38:11.065941 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:11.065915    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttgl5\" (UniqueName: \"kubernetes.io/projected/416925e6-86ac-4eff-9e55-5269696f6b1d-kube-api-access-ttgl5\") pod \"authorino-operator-76b478bd78-k26vd\" (UID: \"416925e6-86ac-4eff-9e55-5269696f6b1d\") " pod="kuadrant-system/authorino-operator-76b478bd78-k26vd"
Sep 11 21:38:11.201415 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:11.201386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-k26vd"
Sep 11 21:38:11.501076 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:11.501054    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-k26vd"]
Sep 11 21:38:11.503419 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:38:11.503392    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416925e6_86ac_4eff_9e55_5269696f6b1d.slice/crio-76b570743d07d2a169c0c5b7b91dc355db0cde3987e3ecc882f811c20856b6e5 WatchSource:0}: Error finding container 76b570743d07d2a169c0c5b7b91dc355db0cde3987e3ecc882f811c20856b6e5: Status 404 returned error can't find the container with id 76b570743d07d2a169c0c5b7b91dc355db0cde3987e3ecc882f811c20856b6e5
Sep 11 21:38:12.207842 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:12.207775    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-k26vd" event={"ID":"416925e6-86ac-4eff-9e55-5269696f6b1d","Type":"ContainerStarted","Data":"76b570743d07d2a169c0c5b7b91dc355db0cde3987e3ecc882f811c20856b6e5"}
Sep 11 21:38:12.868176 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:12.868139    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"]
Sep 11 21:38:12.875119 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:12.875093    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"
Sep 11 21:38:12.878814 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:12.878793    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 21:38:12.878957 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:12.878826    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zls8w\""
Sep 11 21:38:12.883887 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:12.883865    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"]
Sep 11 21:38:12.976199 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:12.976163    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgfcq\" (UniqueName: \"kubernetes.io/projected/d757936c-2efc-416f-8cbe-7a3dc60e99a4-kube-api-access-cgfcq\") pod \"dns-operator-controller-manager-7b84cd7c9c-7sv7f\" (UID: \"d757936c-2efc-416f-8cbe-7a3dc60e99a4\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"
Sep 11 21:38:13.077670 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:13.077633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgfcq\" (UniqueName: \"kubernetes.io/projected/d757936c-2efc-416f-8cbe-7a3dc60e99a4-kube-api-access-cgfcq\") pod \"dns-operator-controller-manager-7b84cd7c9c-7sv7f\" (UID: \"d757936c-2efc-416f-8cbe-7a3dc60e99a4\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"
Sep 11 21:38:13.095725 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:13.095699    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgfcq\" (UniqueName: \"kubernetes.io/projected/d757936c-2efc-416f-8cbe-7a3dc60e99a4-kube-api-access-cgfcq\") pod \"dns-operator-controller-manager-7b84cd7c9c-7sv7f\" (UID: \"d757936c-2efc-416f-8cbe-7a3dc60e99a4\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"
Sep 11 21:38:13.188681 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:13.188648    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"
Sep 11 21:38:14.071442 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:14.071418    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"]
Sep 11 21:38:14.072335 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:38:14.072311    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd757936c_2efc_416f_8cbe_7a3dc60e99a4.slice/crio-f41b467765fd40a62bf36429cdbe95c99069943eaa93a7086fa4ccbac40e4eb1 WatchSource:0}: Error finding container f41b467765fd40a62bf36429cdbe95c99069943eaa93a7086fa4ccbac40e4eb1: Status 404 returned error can't find the container with id f41b467765fd40a62bf36429cdbe95c99069943eaa93a7086fa4ccbac40e4eb1
Sep 11 21:38:14.222495 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:14.222447    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-k26vd" event={"ID":"416925e6-86ac-4eff-9e55-5269696f6b1d","Type":"ContainerStarted","Data":"232944502eeff8eaf6b4c63f0439d537b569f3c9310dca5f46cd1cb8838c3a5e"}
Sep 11 21:38:14.222674 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:14.222531    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-k26vd"
Sep 11 21:38:14.223987 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:14.223963    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f" event={"ID":"d757936c-2efc-416f-8cbe-7a3dc60e99a4","Type":"ContainerStarted","Data":"f41b467765fd40a62bf36429cdbe95c99069943eaa93a7086fa4ccbac40e4eb1"}
Sep 11 21:38:14.247772 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:14.247726    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-k26vd" podStartSLOduration=1.884201382 podStartE2EDuration="4.247712021s" totalImagesPullingTime="2.363510639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:14.24523305 +0000 UTC m=+448.902796810" watchObservedRunningTime="2026-09-11 21:38:14.247712021 +0000 UTC m=+448.905275784"
Sep 11 21:38:15.533200 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:15.533167    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"]
Sep 11 21:38:15.537565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:15.537535    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:15.540213 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:15.540191    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-w24rv\""
Sep 11 21:38:15.552363 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:15.552340    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"]
Sep 11 21:38:15.600825 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:15.600789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhxzb\" (UniqueName: \"kubernetes.io/projected/0f52e428-f1f5-4836-afd0-a824cf6412fd-kube-api-access-xhxzb\") pod \"limitador-operator-controller-manager-74495c69f8-nbxfz\" (UID: \"0f52e428-f1f5-4836-afd0-a824cf6412fd\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:15.702046 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:15.702013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhxzb\" (UniqueName: \"kubernetes.io/projected/0f52e428-f1f5-4836-afd0-a824cf6412fd-kube-api-access-xhxzb\") pod \"limitador-operator-controller-manager-74495c69f8-nbxfz\" (UID: \"0f52e428-f1f5-4836-afd0-a824cf6412fd\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:15.715801 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:15.715769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhxzb\" (UniqueName: \"kubernetes.io/projected/0f52e428-f1f5-4836-afd0-a824cf6412fd-kube-api-access-xhxzb\") pod \"limitador-operator-controller-manager-74495c69f8-nbxfz\" (UID: \"0f52e428-f1f5-4836-afd0-a824cf6412fd\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:15.848165 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:15.848078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:16.127098 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:16.127073    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"]
Sep 11 21:38:16.128287 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:38:16.128263    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f52e428_f1f5_4836_afd0_a824cf6412fd.slice/crio-a22e675aaf69e8172fcccb0232bee52b265449167cb2af6b3b365798ffcc8ab3 WatchSource:0}: Error finding container a22e675aaf69e8172fcccb0232bee52b265449167cb2af6b3b365798ffcc8ab3: Status 404 returned error can't find the container with id a22e675aaf69e8172fcccb0232bee52b265449167cb2af6b3b365798ffcc8ab3
Sep 11 21:38:16.236937 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:16.236897    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f" event={"ID":"d757936c-2efc-416f-8cbe-7a3dc60e99a4","Type":"ContainerStarted","Data":"7bd4d806d783de2781f1e9b29e3b55d783a1c7051eeb28ecb6924025fbde335a"}
Sep 11 21:38:16.237120 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:16.236965    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"
Sep 11 21:38:16.238354 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:16.238330    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz" event={"ID":"0f52e428-f1f5-4836-afd0-a824cf6412fd","Type":"ContainerStarted","Data":"a22e675aaf69e8172fcccb0232bee52b265449167cb2af6b3b365798ffcc8ab3"}
Sep 11 21:38:16.259525 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:16.259462    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f" podStartSLOduration=2.754433459 podStartE2EDuration="4.259446022s" totalImagesPullingTime="1.505012563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:16.255905277 +0000 UTC m=+450.913469035" watchObservedRunningTime="2026-09-11 21:38:16.259446022 +0000 UTC m=+450.917009787"
Sep 11 21:38:18.252065 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:18.252025    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz" event={"ID":"0f52e428-f1f5-4836-afd0-a824cf6412fd","Type":"ContainerStarted","Data":"468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff"}
Sep 11 21:38:18.252427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:18.252110    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:18.271545 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:18.271458    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz" podStartSLOduration=1.710375859 podStartE2EDuration="3.271442328s" totalImagesPullingTime="1.561066469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:18.270043291 +0000 UTC m=+452.927607057" watchObservedRunningTime="2026-09-11 21:38:18.271442328 +0000 UTC m=+452.929006092"
Sep 11 21:38:19.456396 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.456362    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"]
Sep 11 21:38:19.460233 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.460211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:19.465228 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.465210    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9sjbw\""
Sep 11 21:38:19.480134 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.480113    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"]
Sep 11 21:38:19.541519 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.541457    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shbbc\" (UniqueName: \"kubernetes.io/projected/22f3f62e-2f88-4697-9d95-15b948e23373-kube-api-access-shbbc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" (UID: \"22f3f62e-2f88-4697-9d95-15b948e23373\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:19.541519 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.541524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f3f62e-2f88-4697-9d95-15b948e23373-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" (UID: \"22f3f62e-2f88-4697-9d95-15b948e23373\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:19.642551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.642515    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shbbc\" (UniqueName: \"kubernetes.io/projected/22f3f62e-2f88-4697-9d95-15b948e23373-kube-api-access-shbbc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" (UID: \"22f3f62e-2f88-4697-9d95-15b948e23373\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:19.642551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.642549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f3f62e-2f88-4697-9d95-15b948e23373-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" (UID: \"22f3f62e-2f88-4697-9d95-15b948e23373\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:19.642862 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.642848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f3f62e-2f88-4697-9d95-15b948e23373-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" (UID: \"22f3f62e-2f88-4697-9d95-15b948e23373\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:19.664496 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.664436    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shbbc\" (UniqueName: \"kubernetes.io/projected/22f3f62e-2f88-4697-9d95-15b948e23373-kube-api-access-shbbc\") pod \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" (UID: \"22f3f62e-2f88-4697-9d95-15b948e23373\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:19.771505 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:19.771404    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:20.050698 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:20.050674    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"]
Sep 11 21:38:20.053383 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:38:20.053355    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f3f62e_2f88_4697_9d95_15b948e23373.slice/crio-b0dff17944b8d6574c413005a725c33cb28acf0b7d09d1f1a6eaa2e3d062f0f3 WatchSource:0}: Error finding container b0dff17944b8d6574c413005a725c33cb28acf0b7d09d1f1a6eaa2e3d062f0f3: Status 404 returned error can't find the container with id b0dff17944b8d6574c413005a725c33cb28acf0b7d09d1f1a6eaa2e3d062f0f3
Sep 11 21:38:20.264305 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:20.264266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd" event={"ID":"22f3f62e-2f88-4697-9d95-15b948e23373","Type":"ContainerStarted","Data":"b0dff17944b8d6574c413005a725c33cb28acf0b7d09d1f1a6eaa2e3d062f0f3"}
Sep 11 21:38:24.293546 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:24.293511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd" event={"ID":"22f3f62e-2f88-4697-9d95-15b948e23373","Type":"ContainerStarted","Data":"39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859"}
Sep 11 21:38:24.293905 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:24.293681    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:24.315235 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:24.315181    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd" podStartSLOduration=1.237303607 podStartE2EDuration="5.315162528s" totalImagesPullingTime="4.077858921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:24.313964462 +0000 UTC m=+458.971528227" watchObservedRunningTime="2026-09-11 21:38:24.315162528 +0000 UTC m=+458.972726292"
Sep 11 21:38:25.232256 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:25.232228    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-k26vd"
Sep 11 21:38:26.994797 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:26.994765    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"]
Sep 11 21:38:26.998421 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:26.998400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.006256 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.006230    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 21:38:27.007291 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.007271    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g6m4z\""
Sep 11 21:38:27.008642 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.008627    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 21:38:27.018314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.018294    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"]
Sep 11 21:38:27.111645 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.111614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8qhr\" (UniqueName: \"kubernetes.io/projected/c60d121d-a891-4ff2-8caf-e9bbdd005f17-kube-api-access-k8qhr\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.111796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.111739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c60d121d-a891-4ff2-8caf-e9bbdd005f17-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.111796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.111768    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c60d121d-a891-4ff2-8caf-e9bbdd005f17-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.212275 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.212246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c60d121d-a891-4ff2-8caf-e9bbdd005f17-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.212425 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.212279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c60d121d-a891-4ff2-8caf-e9bbdd005f17-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.212425 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.212317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8qhr\" (UniqueName: \"kubernetes.io/projected/c60d121d-a891-4ff2-8caf-e9bbdd005f17-kube-api-access-k8qhr\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.212425 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:27.212392    2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 11 21:38:27.212573 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:27.212461    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c60d121d-a891-4ff2-8caf-e9bbdd005f17-plugin-serving-cert podName:c60d121d-a891-4ff2-8caf-e9bbdd005f17 nodeName:}" failed. No retries permitted until 2026-09-11 21:38:27.712441143 +0000 UTC m=+462.370004892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/c60d121d-a891-4ff2-8caf-e9bbdd005f17-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-p7sc6" (UID: "c60d121d-a891-4ff2-8caf-e9bbdd005f17") : secret "plugin-serving-cert" not found
Sep 11 21:38:27.212875 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.212855    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c60d121d-a891-4ff2-8caf-e9bbdd005f17-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.222443 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.222421    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8qhr\" (UniqueName: \"kubernetes.io/projected/c60d121d-a891-4ff2-8caf-e9bbdd005f17-kube-api-access-k8qhr\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.247225 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.247169    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-7sv7f"
Sep 11 21:38:27.715404 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.715371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c60d121d-a891-4ff2-8caf-e9bbdd005f17-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.717865 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.717844    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c60d121d-a891-4ff2-8caf-e9bbdd005f17-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-p7sc6\" (UID: \"c60d121d-a891-4ff2-8caf-e9bbdd005f17\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:27.908964 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:27.908928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"
Sep 11 21:38:28.205775 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:28.205752    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6"]
Sep 11 21:38:28.207365 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:38:28.207339    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc60d121d_a891_4ff2_8caf_e9bbdd005f17.slice/crio-78710c2d9cede9ae5a85331ee8f6171adeff103b281efee5b2cbeda019d41425 WatchSource:0}: Error finding container 78710c2d9cede9ae5a85331ee8f6171adeff103b281efee5b2cbeda019d41425: Status 404 returned error can't find the container with id 78710c2d9cede9ae5a85331ee8f6171adeff103b281efee5b2cbeda019d41425
Sep 11 21:38:28.318664 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:28.318629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6" event={"ID":"c60d121d-a891-4ff2-8caf-e9bbdd005f17","Type":"ContainerStarted","Data":"78710c2d9cede9ae5a85331ee8f6171adeff103b281efee5b2cbeda019d41425"}
Sep 11 21:38:29.260463 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:29.260418    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:33.355845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:33.355754    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6" event={"ID":"c60d121d-a891-4ff2-8caf-e9bbdd005f17","Type":"ContainerStarted","Data":"55d943cc48762c9e8c5ce3f415f7c7f2987ac13c7f8a05d171c03c146ab80455"}
Sep 11 21:38:33.376973 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:33.376920    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-p7sc6" podStartSLOduration=2.58774523 podStartE2EDuration="7.376903448s" totalImagesPullingTime="4.789158218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:33.376049107 +0000 UTC m=+468.033612870" watchObservedRunningTime="2026-09-11 21:38:33.376903448 +0000 UTC m=+468.034467211"
Sep 11 21:38:35.302714 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:35.302679    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:36.938634 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:36.938601    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"]
Sep 11 21:38:36.942384 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:36.942367    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:36.959030 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:36.959011    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"]
Sep 11 21:38:37.013605 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.013572    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f27848a-a038-431d-be10-ad85708f4d9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-qsvrb\" (UID: \"6f27848a-a038-431d-be10-ad85708f4d9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:37.013605 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.013608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwswg\" (UniqueName: \"kubernetes.io/projected/6f27848a-a038-431d-be10-ad85708f4d9c-kube-api-access-bwswg\") pod \"kuadrant-operator-controller-manager-5f685c496f-qsvrb\" (UID: \"6f27848a-a038-431d-be10-ad85708f4d9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:37.052255 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.052229    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"]
Sep 11 21:38:37.052530 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.052512    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-bwswg], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb" podUID="6f27848a-a038-431d-be10-ad85708f4d9c"
Sep 11 21:38:37.106641 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.106613    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"]
Sep 11 21:38:37.109996 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.109981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:37.114243 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.114213    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpl55\" (UniqueName: \"kubernetes.io/projected/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-kube-api-access-jpl55\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-48b5n\" (UID: \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:37.114335 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.114246    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f27848a-a038-431d-be10-ad85708f4d9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-qsvrb\" (UID: \"6f27848a-a038-431d-be10-ad85708f4d9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:37.114335 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.114276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwswg\" (UniqueName: \"kubernetes.io/projected/6f27848a-a038-431d-be10-ad85708f4d9c-kube-api-access-bwswg\") pod \"kuadrant-operator-controller-manager-5f685c496f-qsvrb\" (UID: \"6f27848a-a038-431d-be10-ad85708f4d9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:37.114335 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.114306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-48b5n\" (UID: \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:37.114578 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.114563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f27848a-a038-431d-be10-ad85708f4d9c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-qsvrb\" (UID: \"6f27848a-a038-431d-be10-ad85708f4d9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:37.133568 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.133542    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwswg\" (UniqueName: \"kubernetes.io/projected/6f27848a-a038-431d-be10-ad85708f4d9c-kube-api-access-bwswg\") pod \"kuadrant-operator-controller-manager-5f685c496f-qsvrb\" (UID: \"6f27848a-a038-431d-be10-ad85708f4d9c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:37.148712 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.148690    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"]
Sep 11 21:38:37.215687 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.215624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-48b5n\" (UID: \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:37.215790 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.215706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpl55\" (UniqueName: \"kubernetes.io/projected/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-kube-api-access-jpl55\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-48b5n\" (UID: \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:37.215982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.215963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-48b5n\" (UID: \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:37.230878 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.230852    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpl55\" (UniqueName: \"kubernetes.io/projected/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-kube-api-access-jpl55\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-48b5n\" (UID: \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:37.380149 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.380125    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:37.387655 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.387636    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:37.417218 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.417200    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f27848a-a038-431d-be10-ad85708f4d9c-extensions-socket-volume\") pod \"6f27848a-a038-431d-be10-ad85708f4d9c\" (UID: \"6f27848a-a038-431d-be10-ad85708f4d9c\") "
Sep 11 21:38:37.417316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.417236    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwswg\" (UniqueName: \"kubernetes.io/projected/6f27848a-a038-431d-be10-ad85708f4d9c-kube-api-access-bwswg\") pod \"6f27848a-a038-431d-be10-ad85708f4d9c\" (UID: \"6f27848a-a038-431d-be10-ad85708f4d9c\") "
Sep 11 21:38:37.417514 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.417464    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f27848a-a038-431d-be10-ad85708f4d9c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6f27848a-a038-431d-be10-ad85708f4d9c" (UID: "6f27848a-a038-431d-be10-ad85708f4d9c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:37.419407 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.419376    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f27848a-a038-431d-be10-ad85708f4d9c-kube-api-access-bwswg" (OuterVolumeSpecName: "kube-api-access-bwswg") pod "6f27848a-a038-431d-be10-ad85708f4d9c" (UID: "6f27848a-a038-431d-be10-ad85708f4d9c"). InnerVolumeSpecName "kube-api-access-bwswg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:37.419407 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.419390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:37.518635 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.518595    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6f27848a-a038-431d-be10-ad85708f4d9c-extensions-socket-volume\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:37.518635 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.518635    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwswg\" (UniqueName: \"kubernetes.io/projected/6f27848a-a038-431d-be10-ad85708f4d9c-kube-api-access-bwswg\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:37.534428 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.534400    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"]
Sep 11 21:38:37.538341 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.538310    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"]
Sep 11 21:38:37.551822 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.551799    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"]
Sep 11 21:38:37.552021 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.551998    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd" podUID="22f3f62e-2f88-4697-9d95-15b948e23373" containerName="manager" containerID="cri-o://39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859" gracePeriod=2
Sep 11 21:38:37.572670 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.572647    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"]
Sep 11 21:38:37.584748 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.584711    2577 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"22f3f62e-2f88-4697-9d95-15b948e23373\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\": pods \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:37.589352 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.589323    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"]
Sep 11 21:38:37.589976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.589933    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f3f62e-2f88-4697-9d95-15b948e23373" containerName="manager"
Sep 11 21:38:37.589976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.589953    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f3f62e-2f88-4697-9d95-15b948e23373" containerName="manager"
Sep 11 21:38:37.590154 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.590118    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="22f3f62e-2f88-4697-9d95-15b948e23373" containerName="manager"
Sep 11 21:38:37.593666 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.593648    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"]
Sep 11 21:38:37.593822 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.593800    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:37.599655 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.599628    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="22f3f62e-2f88-4697-9d95-15b948e23373" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:37.600925 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.600906    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"]
Sep 11 21:38:37.619896 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.619871    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gn5j\" (UniqueName: \"kubernetes.io/projected/9a94d943-07fd-4fe1-b7c0-52715a684177-kube-api-access-2gn5j\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2qjf9\" (UID: \"9a94d943-07fd-4fe1-b7c0-52715a684177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:37.620006 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.619909    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a94d943-07fd-4fe1-b7c0-52715a684177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2qjf9\" (UID: \"9a94d943-07fd-4fe1-b7c0-52715a684177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:37.626368 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.626332    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"]
Sep 11 21:38:37.626668 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.626644    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz" podUID="0f52e428-f1f5-4836-afd0-a824cf6412fd" containerName="manager" containerID="cri-o://468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff" gracePeriod=2
Sep 11 21:38:37.629625 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.629602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"]
Sep 11 21:38:37.655118 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.655024    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"]
Sep 11 21:38:37.658274 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.658243    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-nbxfz\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="0f52e428-f1f5-4836-afd0-a824cf6412fd" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:37.658458 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.658427    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"]
Sep 11 21:38:37.659011 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.658996    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f52e428-f1f5-4836-afd0-a824cf6412fd" containerName="manager"
Sep 11 21:38:37.659064 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.659014    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f52e428-f1f5-4836-afd0-a824cf6412fd" containerName="manager"
Sep 11 21:38:37.659139 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.659128    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f52e428-f1f5-4836-afd0-a824cf6412fd" containerName="manager"
Sep 11 21:38:37.661808 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.661777    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="22f3f62e-2f88-4697-9d95-15b948e23373" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:37.662568 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.662553    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:37.665022 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.664997    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-nbxfz\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="0f52e428-f1f5-4836-afd0-a824cf6412fd" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:37.667256 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.667232    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="22f3f62e-2f88-4697-9d95-15b948e23373" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:37.681292 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.681265    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"]
Sep 11 21:38:37.689558 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.689422    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"]
Sep 11 21:38:37.697771 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.697535    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"
Sep 11 21:38:37.706348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.706320    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"]
Sep 11 21:38:37.720821 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.720760    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdmhc\" (UniqueName: \"kubernetes.io/projected/36b564aa-2543-4c29-a12b-2bea76763aaf-kube-api-access-rdmhc\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-msj6b\" (UID: \"36b564aa-2543-4c29-a12b-2bea76763aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:37.720950 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.720840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gn5j\" (UniqueName: \"kubernetes.io/projected/9a94d943-07fd-4fe1-b7c0-52715a684177-kube-api-access-2gn5j\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2qjf9\" (UID: \"9a94d943-07fd-4fe1-b7c0-52715a684177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:37.720950 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.720870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a94d943-07fd-4fe1-b7c0-52715a684177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2qjf9\" (UID: \"9a94d943-07fd-4fe1-b7c0-52715a684177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:37.720950 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.720911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7mrz\" (UniqueName: \"kubernetes.io/projected/cb5dff64-39d2-4956-a720-a26e17cfdbff-kube-api-access-l7mrz\") pod \"limitador-operator-controller-manager-74495c69f8-5wpdd\" (UID: \"cb5dff64-39d2-4956-a720-a26e17cfdbff\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"
Sep 11 21:38:37.721131 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.720949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b564aa-2543-4c29-a12b-2bea76763aaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-msj6b\" (UID: \"36b564aa-2543-4c29-a12b-2bea76763aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:37.721311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.721292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a94d943-07fd-4fe1-b7c0-52715a684177-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2qjf9\" (UID: \"9a94d943-07fd-4fe1-b7c0-52715a684177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:37.738919 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.738885    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-nbxfz\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="0f52e428-f1f5-4836-afd0-a824cf6412fd" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:37.741678 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.741659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gn5j\" (UniqueName: \"kubernetes.io/projected/9a94d943-07fd-4fe1-b7c0-52715a684177-kube-api-access-2gn5j\") pod \"kuadrant-operator-controller-manager-76f8f686bf-2qjf9\" (UID: \"9a94d943-07fd-4fe1-b7c0-52715a684177\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:37.742638 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.742599    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-zcjtd\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="22f3f62e-2f88-4697-9d95-15b948e23373" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:37.761343 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.761227    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f27848a-a038-431d-be10-ad85708f4d9c" path="/var/lib/kubelet/pods/6f27848a-a038-431d-be10-ad85708f4d9c/volumes"
Sep 11 21:38:37.822054 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.822025    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7mrz\" (UniqueName: \"kubernetes.io/projected/cb5dff64-39d2-4956-a720-a26e17cfdbff-kube-api-access-l7mrz\") pod \"limitador-operator-controller-manager-74495c69f8-5wpdd\" (UID: \"cb5dff64-39d2-4956-a720-a26e17cfdbff\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"
Sep 11 21:38:37.822177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.822079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b564aa-2543-4c29-a12b-2bea76763aaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-msj6b\" (UID: \"36b564aa-2543-4c29-a12b-2bea76763aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:37.822177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.822125    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdmhc\" (UniqueName: \"kubernetes.io/projected/36b564aa-2543-4c29-a12b-2bea76763aaf-kube-api-access-rdmhc\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-msj6b\" (UID: \"36b564aa-2543-4c29-a12b-2bea76763aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:37.822737 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.822712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b564aa-2543-4c29-a12b-2bea76763aaf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-msj6b\" (UID: \"36b564aa-2543-4c29-a12b-2bea76763aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:37.831693 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.831656    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7mrz\" (UniqueName: \"kubernetes.io/projected/cb5dff64-39d2-4956-a720-a26e17cfdbff-kube-api-access-l7mrz\") pod \"limitador-operator-controller-manager-74495c69f8-5wpdd\" (UID: \"cb5dff64-39d2-4956-a720-a26e17cfdbff\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"
Sep 11 21:38:37.833462 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.833414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdmhc\" (UniqueName: \"kubernetes.io/projected/36b564aa-2543-4c29-a12b-2bea76763aaf-kube-api-access-rdmhc\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-msj6b\" (UID: \"36b564aa-2543-4c29-a12b-2bea76763aaf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:37.847174 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.847142    2577 log.go:32] "RunPodSandbox from runtime service failed" err=<
Sep 11 21:38:37.847174 ip-10-0-137-44 kubenswrapper[2577]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-48b5n_kuadrant-system_7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3_0(8f040519c115d9a2c390e30248a22bda253c701a530b60fa85481fd7fb20b970): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-48b5n to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"8f040519c115d9a2c390e30248a22bda253c701a530b60fa85481fd7fb20b970" Netns:"/var/run/netns/5cdb5b4d-b437-494b-85a7-3a24f5cda8e3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-48b5n;K8S_POD_INFRA_CONTAINER_ID=8f040519c115d9a2c390e30248a22bda253c701a530b60fa85481fd7fb20b970;K8S_POD_UID=7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n 8f040519c115d9a2c390e30248a22bda253c701a530b60fa85481fd7fb20b970 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:31 [10.134.0.49/23]
Sep 11 21:38:37.847174 ip-10-0-137-44 kubenswrapper[2577]:         '
Sep 11 21:38:37.847174 ip-10-0-137-44 kubenswrapper[2577]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 11 21:38:37.847174 ip-10-0-137-44 kubenswrapper[2577]:  >
Sep 11 21:38:37.847362 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:37.847214    2577 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Sep 11 21:38:37.847362 ip-10-0-137-44 kubenswrapper[2577]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-7978cbdfbc-48b5n_kuadrant-system_7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3_0(8f040519c115d9a2c390e30248a22bda253c701a530b60fa85481fd7fb20b970): error adding pod kuadrant-system_kuadrant-operator-controller-manager-7978cbdfbc-48b5n to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"8f040519c115d9a2c390e30248a22bda253c701a530b60fa85481fd7fb20b970" Netns:"/var/run/netns/5cdb5b4d-b437-494b-85a7-3a24f5cda8e3" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-7978cbdfbc-48b5n;K8S_POD_INFRA_CONTAINER_ID=8f040519c115d9a2c390e30248a22bda253c701a530b60fa85481fd7fb20b970;K8S_POD_UID=7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n] networking: [kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n 8f040519c115d9a2c390e30248a22bda253c701a530b60fa85481fd7fb20b970 network default NAD default NAD key default] failed to configure pod interface: pod deleted waiting for OVS port binding for 0a:58:0a:86:00:31 [10.134.0.49/23]
Sep 11 21:38:37.847362 ip-10-0-137-44 kubenswrapper[2577]:         '
Sep 11 21:38:37.847362 ip-10-0-137-44 kubenswrapper[2577]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Sep 11 21:38:37.847362 ip-10-0-137-44 kubenswrapper[2577]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:37.868662 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.868645    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:37.872943 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.872927    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:37.923201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.923175    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f3f62e-2f88-4697-9d95-15b948e23373-extensions-socket-volume\") pod \"22f3f62e-2f88-4697-9d95-15b948e23373\" (UID: \"22f3f62e-2f88-4697-9d95-15b948e23373\") "
Sep 11 21:38:37.923302 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.923242    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shbbc\" (UniqueName: \"kubernetes.io/projected/22f3f62e-2f88-4697-9d95-15b948e23373-kube-api-access-shbbc\") pod \"22f3f62e-2f88-4697-9d95-15b948e23373\" (UID: \"22f3f62e-2f88-4697-9d95-15b948e23373\") "
Sep 11 21:38:37.923372 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.923317    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhxzb\" (UniqueName: \"kubernetes.io/projected/0f52e428-f1f5-4836-afd0-a824cf6412fd-kube-api-access-xhxzb\") pod \"0f52e428-f1f5-4836-afd0-a824cf6412fd\" (UID: \"0f52e428-f1f5-4836-afd0-a824cf6412fd\") "
Sep 11 21:38:37.923717 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.923687    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22f3f62e-2f88-4697-9d95-15b948e23373-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "22f3f62e-2f88-4697-9d95-15b948e23373" (UID: "22f3f62e-2f88-4697-9d95-15b948e23373"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:37.925543 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.925515    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f3f62e-2f88-4697-9d95-15b948e23373-kube-api-access-shbbc" (OuterVolumeSpecName: "kube-api-access-shbbc") pod "22f3f62e-2f88-4697-9d95-15b948e23373" (UID: "22f3f62e-2f88-4697-9d95-15b948e23373"). InnerVolumeSpecName "kube-api-access-shbbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:37.925615 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.925574    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f52e428-f1f5-4836-afd0-a824cf6412fd-kube-api-access-xhxzb" (OuterVolumeSpecName: "kube-api-access-xhxzb") pod "0f52e428-f1f5-4836-afd0-a824cf6412fd" (UID: "0f52e428-f1f5-4836-afd0-a824cf6412fd"). InnerVolumeSpecName "kube-api-access-xhxzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:37.997656 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:37.997591    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:38.010136 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.010109    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:38.016825 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.016801    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"
Sep 11 21:38:38.024276 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.024246    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhxzb\" (UniqueName: \"kubernetes.io/projected/0f52e428-f1f5-4836-afd0-a824cf6412fd-kube-api-access-xhxzb\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:38.024276 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.024273    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/22f3f62e-2f88-4697-9d95-15b948e23373-extensions-socket-volume\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:38.024393 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.024286    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shbbc\" (UniqueName: \"kubernetes.io/projected/22f3f62e-2f88-4697-9d95-15b948e23373-kube-api-access-shbbc\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:38.287047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.287018    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"]
Sep 11 21:38:38.287351 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:38:38.287329    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a94d943_07fd_4fe1_b7c0_52715a684177.slice/crio-83fa87b721544856607f2fc56c6d863763e3f9fe23d89954d415fdffa6506df0 WatchSource:0}: Error finding container 83fa87b721544856607f2fc56c6d863763e3f9fe23d89954d415fdffa6506df0: Status 404 returned error can't find the container with id 83fa87b721544856607f2fc56c6d863763e3f9fe23d89954d415fdffa6506df0
Sep 11 21:38:38.310831 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.310757    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"]
Sep 11 21:38:38.311354 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:38:38.311309    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36b564aa_2543_4c29_a12b_2bea76763aaf.slice/crio-2ad9349691dc4af47df212889be84b8ceb5c18cd0b6cd5a353b6cd25e1fdff95 WatchSource:0}: Error finding container 2ad9349691dc4af47df212889be84b8ceb5c18cd0b6cd5a353b6cd25e1fdff95: Status 404 returned error can't find the container with id 2ad9349691dc4af47df212889be84b8ceb5c18cd0b6cd5a353b6cd25e1fdff95
Sep 11 21:38:38.314712 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.314688    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"]
Sep 11 21:38:38.316560 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:38:38.316538    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5dff64_39d2_4956_a720_a26e17cfdbff.slice/crio-0b5dbc7cb8317e4ecca154d69d027536216f1339414223a346e10dabcf4adc8b WatchSource:0}: Error finding container 0b5dbc7cb8317e4ecca154d69d027536216f1339414223a346e10dabcf4adc8b: Status 404 returned error can't find the container with id 0b5dbc7cb8317e4ecca154d69d027536216f1339414223a346e10dabcf4adc8b
Sep 11 21:38:38.388996 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.388969    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd" event={"ID":"cb5dff64-39d2-4956-a720-a26e17cfdbff","Type":"ContainerStarted","Data":"06fafa5046fca515014da46a816c00bb4030dcc91d93bc198c1aa4c0ab8b0096"}
Sep 11 21:38:38.389108 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.389022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd" event={"ID":"cb5dff64-39d2-4956-a720-a26e17cfdbff","Type":"ContainerStarted","Data":"0b5dbc7cb8317e4ecca154d69d027536216f1339414223a346e10dabcf4adc8b"}
Sep 11 21:38:38.389108 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.389048    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"
Sep 11 21:38:38.390327 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.390307    2577 generic.go:356] "Generic (PLEG): container finished" podID="0f52e428-f1f5-4836-afd0-a824cf6412fd" containerID="468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff" exitCode=0
Sep 11 21:38:38.390438 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.390353    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-nbxfz"
Sep 11 21:38:38.390438 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.390385    2577 scope.go:117] "RemoveContainer" containerID="468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff"
Sep 11 21:38:38.392391 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.392367    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9" event={"ID":"9a94d943-07fd-4fe1-b7c0-52715a684177","Type":"ContainerStarted","Data":"5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4"}
Sep 11 21:38:38.392533 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.392410    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9" event={"ID":"9a94d943-07fd-4fe1-b7c0-52715a684177","Type":"ContainerStarted","Data":"83fa87b721544856607f2fc56c6d863763e3f9fe23d89954d415fdffa6506df0"}
Sep 11 21:38:38.392804 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.392786    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:38.394812 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.394791    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b" event={"ID":"36b564aa-2543-4c29-a12b-2bea76763aaf","Type":"ContainerStarted","Data":"26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2"}
Sep 11 21:38:38.394919 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.394835    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:38.394919 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.394858    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b" event={"ID":"36b564aa-2543-4c29-a12b-2bea76763aaf","Type":"ContainerStarted","Data":"2ad9349691dc4af47df212889be84b8ceb5c18cd0b6cd5a353b6cd25e1fdff95"}
Sep 11 21:38:38.396388 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.396366    2577 generic.go:356] "Generic (PLEG): container finished" podID="22f3f62e-2f88-4697-9d95-15b948e23373" containerID="39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859" exitCode=0
Sep 11 21:38:38.396488 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.396401    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-zcjtd"
Sep 11 21:38:38.396579 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.396567    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:38.396704 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.396688    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-qsvrb"
Sep 11 21:38:38.401842 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.401753    2577 scope.go:117] "RemoveContainer" containerID="468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff"
Sep 11 21:38:38.402058 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:38.402039    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff\": container with ID starting with 468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff not found: ID does not exist" containerID="468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff"
Sep 11 21:38:38.402135 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.402070    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff"} err="failed to get container status \"468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff\": rpc error: code = NotFound desc = could not find container \"468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff\": container with ID starting with 468d98a713194ac334419210a7598ec2d47f0257c068b75ae187f10bbf3d5fff not found: ID does not exist"
Sep 11 21:38:38.402135 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.402092    2577 scope.go:117] "RemoveContainer" containerID="39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859"
Sep 11 21:38:38.408102 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.408079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:38.412395 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.412379    2577 scope.go:117] "RemoveContainer" containerID="39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859"
Sep 11 21:38:38.412808 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:38.412788    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859\": container with ID starting with 39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859 not found: ID does not exist" containerID="39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859"
Sep 11 21:38:38.412909 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.412815    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859"} err="failed to get container status \"39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859\": rpc error: code = NotFound desc = could not find container \"39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859\": container with ID starting with 39418e750b33792ca856873f8c26bb5e1409e8eeacdac3e887997b6d760f2859 not found: ID does not exist"
Sep 11 21:38:38.417881 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.417516    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd" podStartSLOduration=1.417503226 podStartE2EDuration="1.417503226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:38.416264399 +0000 UTC m=+473.073828164" watchObservedRunningTime="2026-09-11 21:38:38.417503226 +0000 UTC m=+473.075066990"
Sep 11 21:38:38.418963 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:38.418919    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-48b5n\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:38.427648 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.427629    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-extensions-socket-volume\") pod \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\" (UID: \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\") "
Sep 11 21:38:38.427727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.427691    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpl55\" (UniqueName: \"kubernetes.io/projected/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-kube-api-access-jpl55\") pod \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\" (UID: \"7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3\") "
Sep 11 21:38:38.427919 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.427883    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3" (UID: "7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:38.429811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.429792    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-kube-api-access-jpl55" (OuterVolumeSpecName: "kube-api-access-jpl55") pod "7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3" (UID: "7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3"). InnerVolumeSpecName "kube-api-access-jpl55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:38.451690 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.451649    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b" podStartSLOduration=1.451635279 podStartE2EDuration="1.451635279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:38.449130536 +0000 UTC m=+473.106694300" watchObservedRunningTime="2026-09-11 21:38:38.451635279 +0000 UTC m=+473.109199043"
Sep 11 21:38:38.479154 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.479114    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9" podStartSLOduration=1.479100528 podStartE2EDuration="1.479100528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:38.476613206 +0000 UTC m=+473.134176970" watchObservedRunningTime="2026-09-11 21:38:38.479100528 +0000 UTC m=+473.136664291"
Sep 11 21:38:38.528348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.528318    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-extensions-socket-volume\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:38.528348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:38.528348    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpl55\" (UniqueName: \"kubernetes.io/projected/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3-kube-api-access-jpl55\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:39.407610 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:39.407526    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:39.410228 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:39.410191    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-48b5n\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:39.417604 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:39.417580    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-48b5n\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-48b5n"
Sep 11 21:38:39.760958 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:39.760923    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f52e428-f1f5-4836-afd0-a824cf6412fd" path="/var/lib/kubelet/pods/0f52e428-f1f5-4836-afd0-a824cf6412fd/volumes"
Sep 11 21:38:39.761323 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:39.761309    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f3f62e-2f88-4697-9d95-15b948e23373" path="/var/lib/kubelet/pods/22f3f62e-2f88-4697-9d95-15b948e23373/volumes"
Sep 11 21:38:39.761697 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:39.761684    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3" path="/var/lib/kubelet/pods/7b9cbce9-bfe8-4488-adfd-e1c9e674b8a3/volumes"
Sep 11 21:38:49.409911 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.409878    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-5wpdd"
Sep 11 21:38:49.410411 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.409957    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:38:49.482547 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.482518    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"]
Sep 11 21:38:49.482737 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.482711    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9" podUID="9a94d943-07fd-4fe1-b7c0-52715a684177" containerName="manager" containerID="cri-o://5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4" gracePeriod=10
Sep 11 21:38:49.484626 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.484599    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:49.735167 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.735138    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"]
Sep 11 21:38:49.738514 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.738464    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:38:49.749619 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.749517    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:49.752683 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.752660    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"]
Sep 11 21:38:49.826527 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.826494    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a94d943-07fd-4fe1-b7c0-52715a684177-extensions-socket-volume\") pod \"9a94d943-07fd-4fe1-b7c0-52715a684177\" (UID: \"9a94d943-07fd-4fe1-b7c0-52715a684177\") "
Sep 11 21:38:49.826701 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.826548    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gn5j\" (UniqueName: \"kubernetes.io/projected/9a94d943-07fd-4fe1-b7c0-52715a684177-kube-api-access-2gn5j\") pod \"9a94d943-07fd-4fe1-b7c0-52715a684177\" (UID: \"9a94d943-07fd-4fe1-b7c0-52715a684177\") "
Sep 11 21:38:49.826806 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.826789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j55td\" (UniqueName: \"kubernetes.io/projected/4597f207-acb0-4742-a559-4c0eccc3c236-kube-api-access-j55td\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xwtvm\" (UID: \"4597f207-acb0-4742-a559-4c0eccc3c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:38:49.826806 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.826792    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a94d943-07fd-4fe1-b7c0-52715a684177-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9a94d943-07fd-4fe1-b7c0-52715a684177" (UID: "9a94d943-07fd-4fe1-b7c0-52715a684177"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:38:49.826930 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.826861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4597f207-acb0-4742-a559-4c0eccc3c236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xwtvm\" (UID: \"4597f207-acb0-4742-a559-4c0eccc3c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:38:49.826982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.826937    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a94d943-07fd-4fe1-b7c0-52715a684177-extensions-socket-volume\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:49.828541 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.828517    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a94d943-07fd-4fe1-b7c0-52715a684177-kube-api-access-2gn5j" (OuterVolumeSpecName: "kube-api-access-2gn5j") pod "9a94d943-07fd-4fe1-b7c0-52715a684177" (UID: "9a94d943-07fd-4fe1-b7c0-52715a684177"). InnerVolumeSpecName "kube-api-access-2gn5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:38:49.927787 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.927709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j55td\" (UniqueName: \"kubernetes.io/projected/4597f207-acb0-4742-a559-4c0eccc3c236-kube-api-access-j55td\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xwtvm\" (UID: \"4597f207-acb0-4742-a559-4c0eccc3c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:38:49.927787 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.927754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4597f207-acb0-4742-a559-4c0eccc3c236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xwtvm\" (UID: \"4597f207-acb0-4742-a559-4c0eccc3c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:38:49.927787 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.927788    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gn5j\" (UniqueName: \"kubernetes.io/projected/9a94d943-07fd-4fe1-b7c0-52715a684177-kube-api-access-2gn5j\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:38:49.928062 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.928048    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4597f207-acb0-4742-a559-4c0eccc3c236-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xwtvm\" (UID: \"4597f207-acb0-4742-a559-4c0eccc3c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:38:49.941763 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:49.941738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j55td\" (UniqueName: \"kubernetes.io/projected/4597f207-acb0-4742-a559-4c0eccc3c236-kube-api-access-j55td\") pod \"kuadrant-operator-controller-manager-5769f99d9f-xwtvm\" (UID: \"4597f207-acb0-4742-a559-4c0eccc3c236\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:38:50.057118 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.057084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:38:50.333591 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.333559    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"]
Sep 11 21:38:50.335851 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:38:50.335825    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4597f207_acb0_4742_a559_4c0eccc3c236.slice/crio-4012e76d54501e25f2d1526ef509335148322782edc497ca2254e1fadc1f1fff WatchSource:0}: Error finding container 4012e76d54501e25f2d1526ef509335148322782edc497ca2254e1fadc1f1fff: Status 404 returned error can't find the container with id 4012e76d54501e25f2d1526ef509335148322782edc497ca2254e1fadc1f1fff
Sep 11 21:38:50.478391 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.478355    2577 generic.go:356] "Generic (PLEG): container finished" podID="9a94d943-07fd-4fe1-b7c0-52715a684177" containerID="5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4" exitCode=0
Sep 11 21:38:50.478796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.478415    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"
Sep 11 21:38:50.478796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.478438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9" event={"ID":"9a94d943-07fd-4fe1-b7c0-52715a684177","Type":"ContainerDied","Data":"5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4"}
Sep 11 21:38:50.478796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.478524    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9" event={"ID":"9a94d943-07fd-4fe1-b7c0-52715a684177","Type":"ContainerDied","Data":"83fa87b721544856607f2fc56c6d863763e3f9fe23d89954d415fdffa6506df0"}
Sep 11 21:38:50.478796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.478563    2577 scope.go:117] "RemoveContainer" containerID="5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4"
Sep 11 21:38:50.480411 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.480388    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm" event={"ID":"4597f207-acb0-4742-a559-4c0eccc3c236","Type":"ContainerStarted","Data":"89a17f1a29dcf8d8be17ffc1b20633e9785363fea088be4908a523633dbb5f57"}
Sep 11 21:38:50.480552 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.480436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm" event={"ID":"4597f207-acb0-4742-a559-4c0eccc3c236","Type":"ContainerStarted","Data":"4012e76d54501e25f2d1526ef509335148322782edc497ca2254e1fadc1f1fff"}
Sep 11 21:38:50.480552 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.480464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:38:50.488127 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.487976    2577 scope.go:117] "RemoveContainer" containerID="5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4"
Sep 11 21:38:50.488285 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:38:50.488263    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4\": container with ID starting with 5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4 not found: ID does not exist" containerID="5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4"
Sep 11 21:38:50.488327 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.488298    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4"} err="failed to get container status \"5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4\": rpc error: code = NotFound desc = could not find container \"5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4\": container with ID starting with 5d0f5d0a7c4cd1bfbbabb720bcaaafcc8e3ea273aa3d9fd94f2db7e56e56f7d4 not found: ID does not exist"
Sep 11 21:38:50.505193 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.505157    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm" podStartSLOduration=1.505143387 podStartE2EDuration="1.505143387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:38:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:38:50.503297021 +0000 UTC m=+485.160860816" watchObservedRunningTime="2026-09-11 21:38:50.505143387 +0000 UTC m=+485.162707151"
Sep 11 21:38:50.522757 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.522736    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"]
Sep 11 21:38:50.531938 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:50.531916    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-2qjf9"]
Sep 11 21:38:51.760564 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:38:51.760537    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a94d943-07fd-4fe1-b7c0-52715a684177" path="/var/lib/kubelet/pods/9a94d943-07fd-4fe1-b7c0-52715a684177/volumes"
Sep 11 21:39:01.490327 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:01.490299    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:39:01.590794 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:01.590759    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"]
Sep 11 21:39:01.591093 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:01.591065    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b" podUID="36b564aa-2543-4c29-a12b-2bea76763aaf" containerName="manager" containerID="cri-o://26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2" gracePeriod=10
Sep 11 21:39:01.850146 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:01.850114    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:39:01.929779 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:01.929742    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdmhc\" (UniqueName: \"kubernetes.io/projected/36b564aa-2543-4c29-a12b-2bea76763aaf-kube-api-access-rdmhc\") pod \"36b564aa-2543-4c29-a12b-2bea76763aaf\" (UID: \"36b564aa-2543-4c29-a12b-2bea76763aaf\") "
Sep 11 21:39:01.929996 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:01.929790    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b564aa-2543-4c29-a12b-2bea76763aaf-extensions-socket-volume\") pod \"36b564aa-2543-4c29-a12b-2bea76763aaf\" (UID: \"36b564aa-2543-4c29-a12b-2bea76763aaf\") "
Sep 11 21:39:01.930227 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:01.930197    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b564aa-2543-4c29-a12b-2bea76763aaf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "36b564aa-2543-4c29-a12b-2bea76763aaf" (UID: "36b564aa-2543-4c29-a12b-2bea76763aaf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:39:01.932051 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:01.932031    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b564aa-2543-4c29-a12b-2bea76763aaf-kube-api-access-rdmhc" (OuterVolumeSpecName: "kube-api-access-rdmhc") pod "36b564aa-2543-4c29-a12b-2bea76763aaf" (UID: "36b564aa-2543-4c29-a12b-2bea76763aaf"). InnerVolumeSpecName "kube-api-access-rdmhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:39:02.031354 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.031282    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdmhc\" (UniqueName: \"kubernetes.io/projected/36b564aa-2543-4c29-a12b-2bea76763aaf-kube-api-access-rdmhc\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:39:02.031354 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.031311    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/36b564aa-2543-4c29-a12b-2bea76763aaf-extensions-socket-volume\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:39:02.554397 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.554361    2577 generic.go:356] "Generic (PLEG): container finished" podID="36b564aa-2543-4c29-a12b-2bea76763aaf" containerID="26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2" exitCode=0
Sep 11 21:39:02.554870 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.554410    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"
Sep 11 21:39:02.554870 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.554413    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b" event={"ID":"36b564aa-2543-4c29-a12b-2bea76763aaf","Type":"ContainerDied","Data":"26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2"}
Sep 11 21:39:02.554870 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.554544    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b" event={"ID":"36b564aa-2543-4c29-a12b-2bea76763aaf","Type":"ContainerDied","Data":"2ad9349691dc4af47df212889be84b8ceb5c18cd0b6cd5a353b6cd25e1fdff95"}
Sep 11 21:39:02.554870 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.554575    2577 scope.go:117] "RemoveContainer" containerID="26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2"
Sep 11 21:39:02.566435 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.566419    2577 scope.go:117] "RemoveContainer" containerID="26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2"
Sep 11 21:39:02.566716 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:39:02.566699    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2\": container with ID starting with 26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2 not found: ID does not exist" containerID="26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2"
Sep 11 21:39:02.566769 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.566724    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2"} err="failed to get container status \"26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2\": rpc error: code = NotFound desc = could not find container \"26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2\": container with ID starting with 26565e2482a0596f57e3d83bdf1cfcd1e2136221845a2e1aa681c2bf4878bcc2 not found: ID does not exist"
Sep 11 21:39:02.579498 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.579457    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"]
Sep 11 21:39:02.586401 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:02.586381    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-msj6b"]
Sep 11 21:39:03.760158 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:03.760126    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b564aa-2543-4c29-a12b-2bea76763aaf" path="/var/lib/kubelet/pods/36b564aa-2543-4c29-a12b-2bea76763aaf/volumes"
Sep 11 21:39:05.859694 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.859666    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"]
Sep 11 21:39:05.860113 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.860097    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b564aa-2543-4c29-a12b-2bea76763aaf" containerName="manager"
Sep 11 21:39:05.860177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.860118    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b564aa-2543-4c29-a12b-2bea76763aaf" containerName="manager"
Sep 11 21:39:05.860177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.860137    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a94d943-07fd-4fe1-b7c0-52715a684177" containerName="manager"
Sep 11 21:39:05.860177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.860145    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a94d943-07fd-4fe1-b7c0-52715a684177" containerName="manager"
Sep 11 21:39:05.860325 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.860237    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b564aa-2543-4c29-a12b-2bea76763aaf" containerName="manager"
Sep 11 21:39:05.860325 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.860250    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a94d943-07fd-4fe1-b7c0-52715a684177" containerName="manager"
Sep 11 21:39:05.874779 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.874756    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:05.878643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.878626    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8692f\""
Sep 11 21:39:05.880074 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.880055    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 21:39:05.899591 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.899568    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"]
Sep 11 21:39:05.963815 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.963786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:05.963919 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.963820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj6wv\" (UniqueName: \"kubernetes.io/projected/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-kube-api-access-cj6wv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:05.963919 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.963839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:05.963919 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.963854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:05.964083 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.963951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:05.964083 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.964014    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:05.964083 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.964047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:05.964237 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.964090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:05.964237 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:05.964142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065230 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj6wv\" (UniqueName: \"kubernetes.io/projected/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-kube-api-access-cj6wv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065654 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065389    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065654 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065654 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065821 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065747    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065821 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065792    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.065919 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.065800    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.066057 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.066041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.066217 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.066196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.067729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.067711    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.067876 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.067860    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.073543 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.073520    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.073625 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.073587    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj6wv\" (UniqueName: \"kubernetes.io/projected/e5fd29eb-c039-4b76-bd5e-c958a68dd71c-kube-api-access-cj6wv\") pod \"maas-default-gateway-openshift-default-78bb78ff78-t5pnb\" (UID: \"e5fd29eb-c039-4b76-bd5e-c958a68dd71c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.185106 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.185081    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:06.460033 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.460010    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"]
Sep 11 21:39:06.461328 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:39:06.461295    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fd29eb_c039_4b76_bd5e_c958a68dd71c.slice/crio-169ec602c92e591f0925fdebfaca7ed0efc6cdebe5778f9c827f75da5684aeb2 WatchSource:0}: Error finding container 169ec602c92e591f0925fdebfaca7ed0efc6cdebe5778f9c827f75da5684aeb2: Status 404 returned error can't find the container with id 169ec602c92e591f0925fdebfaca7ed0efc6cdebe5778f9c827f75da5684aeb2
Sep 11 21:39:06.578193 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:06.578157    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" event={"ID":"e5fd29eb-c039-4b76-bd5e-c958a68dd71c","Type":"ContainerStarted","Data":"169ec602c92e591f0925fdebfaca7ed0efc6cdebe5778f9c827f75da5684aeb2"}
Sep 11 21:39:09.245571 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:09.245535    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:39:09.245837 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:09.245611    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:39:09.245837 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:09.245641    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:39:09.604676 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:09.604575    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" event={"ID":"e5fd29eb-c039-4b76-bd5e-c958a68dd71c","Type":"ContainerStarted","Data":"e599b50e8cb2c8b653e853050f17cadb7e25bf18358cfee67642d153ba83881f"}
Sep 11 21:39:09.626306 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:09.626260    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" podStartSLOduration=1.844528129 podStartE2EDuration="4.626246066s" totalImagesPullingTime="2.781717937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:39:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:39:09.625998873 +0000 UTC m=+504.283562629" watchObservedRunningTime="2026-09-11 21:39:09.626246066 +0000 UTC m=+504.283809830"
Sep 11 21:39:10.185573 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:10.185535    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:10.190078 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:10.190053    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:10.611397 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:10.611313    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:10.612158 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:10.612143    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:39:17.357890 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.357853    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9kwj7"]
Sep 11 21:39:17.361544 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.361528    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:17.364755 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.364733    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 21:39:17.371535 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.371512    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9kwj7"]
Sep 11 21:39:17.453272 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.453240    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9kwj7"]
Sep 11 21:39:17.472158 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.472125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf5fc\" (UniqueName: \"kubernetes.io/projected/c024d64d-e154-470e-a6f8-ba9d5540f2fc-kube-api-access-lf5fc\") pod \"limitador-limitador-8588749977-9kwj7\" (UID: \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\") " pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:17.472296 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.472162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c024d64d-e154-470e-a6f8-ba9d5540f2fc-config-file\") pod \"limitador-limitador-8588749977-9kwj7\" (UID: \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\") " pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:17.572783 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.572751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf5fc\" (UniqueName: \"kubernetes.io/projected/c024d64d-e154-470e-a6f8-ba9d5540f2fc-kube-api-access-lf5fc\") pod \"limitador-limitador-8588749977-9kwj7\" (UID: \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\") " pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:17.572973 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.572792    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c024d64d-e154-470e-a6f8-ba9d5540f2fc-config-file\") pod \"limitador-limitador-8588749977-9kwj7\" (UID: \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\") " pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:17.573349 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.573332    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c024d64d-e154-470e-a6f8-ba9d5540f2fc-config-file\") pod \"limitador-limitador-8588749977-9kwj7\" (UID: \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\") " pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:17.581801 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.581773    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf5fc\" (UniqueName: \"kubernetes.io/projected/c024d64d-e154-470e-a6f8-ba9d5540f2fc-kube-api-access-lf5fc\") pod \"limitador-limitador-8588749977-9kwj7\" (UID: \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\") " pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:17.672427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.672402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:17.943129 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:17.943105    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9kwj7"]
Sep 11 21:39:17.944964 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:39:17.944937    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc024d64d_e154_470e_a6f8_ba9d5540f2fc.slice/crio-26d518af0d02b56c11924c9c7fe4e7b9d28518f8d46f1240e2deaca04f39e1ce WatchSource:0}: Error finding container 26d518af0d02b56c11924c9c7fe4e7b9d28518f8d46f1240e2deaca04f39e1ce: Status 404 returned error can't find the container with id 26d518af0d02b56c11924c9c7fe4e7b9d28518f8d46f1240e2deaca04f39e1ce
Sep 11 21:39:18.658824 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:18.658788    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7" event={"ID":"c024d64d-e154-470e-a6f8-ba9d5540f2fc","Type":"ContainerStarted","Data":"26d518af0d02b56c11924c9c7fe4e7b9d28518f8d46f1240e2deaca04f39e1ce"}
Sep 11 21:39:20.681792 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:20.681756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7" event={"ID":"c024d64d-e154-470e-a6f8-ba9d5540f2fc","Type":"ContainerStarted","Data":"966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695"}
Sep 11 21:39:20.682227 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:20.681852    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:20.700300 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:20.700256    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7" podStartSLOduration=1.918835782 podStartE2EDuration="3.700240408s" totalImagesPullingTime="1.781404626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:39:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:39:20.697947943 +0000 UTC m=+515.355511718" watchObservedRunningTime="2026-09-11 21:39:20.700240408 +0000 UTC m=+515.357804172"
Sep 11 21:39:31.688613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:31.688581    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:31.935420 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:31.935379    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9kwj7"]
Sep 11 21:39:31.935687 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:31.935628    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7" podUID="c024d64d-e154-470e-a6f8-ba9d5540f2fc" containerName="limitador" containerID="cri-o://966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695" gracePeriod=30
Sep 11 21:39:32.486235 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.486208    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:32.501834 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.501645    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf5fc\" (UniqueName: \"kubernetes.io/projected/c024d64d-e154-470e-a6f8-ba9d5540f2fc-kube-api-access-lf5fc\") pod \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\" (UID: \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\") "
Sep 11 21:39:32.501834 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.501724    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c024d64d-e154-470e-a6f8-ba9d5540f2fc-config-file\") pod \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\" (UID: \"c024d64d-e154-470e-a6f8-ba9d5540f2fc\") "
Sep 11 21:39:32.502367 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.502303    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c024d64d-e154-470e-a6f8-ba9d5540f2fc-config-file" (OuterVolumeSpecName: "config-file") pod "c024d64d-e154-470e-a6f8-ba9d5540f2fc" (UID: "c024d64d-e154-470e-a6f8-ba9d5540f2fc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:39:32.504848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.504812    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c024d64d-e154-470e-a6f8-ba9d5540f2fc-kube-api-access-lf5fc" (OuterVolumeSpecName: "kube-api-access-lf5fc") pod "c024d64d-e154-470e-a6f8-ba9d5540f2fc" (UID: "c024d64d-e154-470e-a6f8-ba9d5540f2fc"). InnerVolumeSpecName "kube-api-access-lf5fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:39:32.603100 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.603073    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf5fc\" (UniqueName: \"kubernetes.io/projected/c024d64d-e154-470e-a6f8-ba9d5540f2fc-kube-api-access-lf5fc\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:39:32.603100 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.603096    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c024d64d-e154-470e-a6f8-ba9d5540f2fc-config-file\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:39:32.752521 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.752422    2577 generic.go:356] "Generic (PLEG): container finished" podID="c024d64d-e154-470e-a6f8-ba9d5540f2fc" containerID="966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695" exitCode=0
Sep 11 21:39:32.752521 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.752498    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7"
Sep 11 21:39:32.752974 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.752517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7" event={"ID":"c024d64d-e154-470e-a6f8-ba9d5540f2fc","Type":"ContainerDied","Data":"966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695"}
Sep 11 21:39:32.752974 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.752574    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-9kwj7" event={"ID":"c024d64d-e154-470e-a6f8-ba9d5540f2fc","Type":"ContainerDied","Data":"26d518af0d02b56c11924c9c7fe4e7b9d28518f8d46f1240e2deaca04f39e1ce"}
Sep 11 21:39:32.752974 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.752601    2577 scope.go:117] "RemoveContainer" containerID="966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695"
Sep 11 21:39:32.762236 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.762222    2577 scope.go:117] "RemoveContainer" containerID="966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695"
Sep 11 21:39:32.762530 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:39:32.762508    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695\": container with ID starting with 966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695 not found: ID does not exist" containerID="966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695"
Sep 11 21:39:32.762638 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.762541    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695"} err="failed to get container status \"966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695\": rpc error: code = NotFound desc = could not find container \"966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695\": container with ID starting with 966f918195ce1da9c2a23a5910ba11008a6f8c0350d32bb47cd5c921d8438695 not found: ID does not exist"
Sep 11 21:39:32.774686 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.774663    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9kwj7"]
Sep 11 21:39:32.778289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:32.778268    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-9kwj7"]
Sep 11 21:39:33.760720 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:33.760688    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c024d64d-e154-470e-a6f8-ba9d5540f2fc" path="/var/lib/kubelet/pods/c024d64d-e154-470e-a6f8-ba9d5540f2fc/volumes"
Sep 11 21:39:37.480258 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.480169    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"]
Sep 11 21:39:37.480831 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.480628    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c024d64d-e154-470e-a6f8-ba9d5540f2fc" containerName="limitador"
Sep 11 21:39:37.480831 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.480644    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c024d64d-e154-470e-a6f8-ba9d5540f2fc" containerName="limitador"
Sep 11 21:39:37.480831 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.480720    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c024d64d-e154-470e-a6f8-ba9d5540f2fc" containerName="limitador"
Sep 11 21:39:37.484992 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.484972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:37.487899 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.487865    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 21:39:37.487899 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.487891    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 11 21:39:37.488044 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.487996    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 21:39:37.489090 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.489073    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-p4988\""
Sep 11 21:39:37.495163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.495140    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"]
Sep 11 21:39:37.546618 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.546595    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scd7w\" (UniqueName: \"kubernetes.io/projected/1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9-kube-api-access-scd7w\") pod \"postgres-69fb4594cf-7s8jh\" (UID: \"1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:37.546741 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.546641    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9-data\") pod \"postgres-69fb4594cf-7s8jh\" (UID: \"1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:37.648059 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.648036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scd7w\" (UniqueName: \"kubernetes.io/projected/1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9-kube-api-access-scd7w\") pod \"postgres-69fb4594cf-7s8jh\" (UID: \"1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:37.648171 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.648078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9-data\") pod \"postgres-69fb4594cf-7s8jh\" (UID: \"1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:37.648454 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.648438    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9-data\") pod \"postgres-69fb4594cf-7s8jh\" (UID: \"1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:37.663800 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.663777    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scd7w\" (UniqueName: \"kubernetes.io/projected/1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9-kube-api-access-scd7w\") pod \"postgres-69fb4594cf-7s8jh\" (UID: \"1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:37.796455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:37.796359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:38.066963 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:38.066926    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"]
Sep 11 21:39:38.068196 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:39:38.068169    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc2f9b9_a8d2_410c_9bd3_047baa1d15f9.slice/crio-5807fa5aeb1831b681bb1b056fdc116b197e87e52635b5bc1e2d38d810797d0e WatchSource:0}: Error finding container 5807fa5aeb1831b681bb1b056fdc116b197e87e52635b5bc1e2d38d810797d0e: Status 404 returned error can't find the container with id 5807fa5aeb1831b681bb1b056fdc116b197e87e52635b5bc1e2d38d810797d0e
Sep 11 21:39:38.789541 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:38.789506    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh" event={"ID":"1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9","Type":"ContainerStarted","Data":"5807fa5aeb1831b681bb1b056fdc116b197e87e52635b5bc1e2d38d810797d0e"}
Sep 11 21:39:40.807208 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:40.807173    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh" event={"ID":"1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9","Type":"ContainerStarted","Data":"5850338b64bd847e2641319d0dfd622a179c9dfc564f89d4a2943f94398012f3"}
Sep 11 21:39:40.807655 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:40.807236    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:40.828439 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:40.828391    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh" podStartSLOduration=1.607813323 podStartE2EDuration="3.828373214s" totalImagesPullingTime="2.220559891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:39:40.826956301 +0000 UTC m=+535.484520058" watchObservedRunningTime="2026-09-11 21:39:40.828373214 +0000 UTC m=+535.485936970"
Sep 11 21:39:46.842002 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:46.841973    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-7s8jh"
Sep 11 21:39:54.541596 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.541564    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6c76df795b-vmztp"]
Sep 11 21:39:54.547542 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.547521    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.550567 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.550541    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 21:39:54.550672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.550598    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 21:39:54.550728 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.550550    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wcldp\""
Sep 11 21:39:54.550792 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.550545    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 21:39:54.557827 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.557807    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c76df795b-vmztp"]
Sep 11 21:39:54.705978 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.705936    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-webhook-cert\") pod \"maas-controller-6c76df795b-vmztp\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") " pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.706229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.706063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrlnn\" (UniqueName: \"kubernetes.io/projected/f1dce0c3-318a-436f-8878-27e8d4c57d56-kube-api-access-hrlnn\") pod \"maas-controller-6c76df795b-vmztp\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") " pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.706229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.706099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-metrics-certs\") pod \"maas-controller-6c76df795b-vmztp\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") " pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.706511 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.706489    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f59564f6b-mdlk2"]
Sep 11 21:39:54.710543 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.710525    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:54.719788 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.719767    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-mdlk2"]
Sep 11 21:39:54.806939 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.806870    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-webhook-cert\") pod \"maas-controller-6c76df795b-vmztp\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") " pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.806939 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.806919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xwb\" (UniqueName: \"kubernetes.io/projected/6de2186e-f915-494d-9510-49123ef054a4-kube-api-access-m6xwb\") pod \"maas-controller-5f59564f6b-mdlk2\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") " pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:54.807130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.806967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrlnn\" (UniqueName: \"kubernetes.io/projected/f1dce0c3-318a-436f-8878-27e8d4c57d56-kube-api-access-hrlnn\") pod \"maas-controller-6c76df795b-vmztp\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") " pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.807130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.806995    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-metrics-certs\") pod \"maas-controller-5f59564f6b-mdlk2\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") " pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:54.807130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.807022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-metrics-certs\") pod \"maas-controller-6c76df795b-vmztp\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") " pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.807130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.807102    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-webhook-cert\") pod \"maas-controller-5f59564f6b-mdlk2\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") " pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:54.809672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.809649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-metrics-certs\") pod \"maas-controller-6c76df795b-vmztp\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") " pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.809672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.809661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-webhook-cert\") pod \"maas-controller-6c76df795b-vmztp\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") " pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.815381 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.815352    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrlnn\" (UniqueName: \"kubernetes.io/projected/f1dce0c3-318a-436f-8878-27e8d4c57d56-kube-api-access-hrlnn\") pod \"maas-controller-6c76df795b-vmztp\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") " pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.859103 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.859075    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:54.908003 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.907967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-webhook-cert\") pod \"maas-controller-5f59564f6b-mdlk2\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") " pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:54.908597 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.908571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xwb\" (UniqueName: \"kubernetes.io/projected/6de2186e-f915-494d-9510-49123ef054a4-kube-api-access-m6xwb\") pod \"maas-controller-5f59564f6b-mdlk2\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") " pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:54.908783 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.908766    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-metrics-certs\") pod \"maas-controller-5f59564f6b-mdlk2\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") " pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:54.912796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.912311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-webhook-cert\") pod \"maas-controller-5f59564f6b-mdlk2\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") " pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:54.912796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.912392    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-metrics-certs\") pod \"maas-controller-5f59564f6b-mdlk2\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") " pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:54.917688 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:54.917661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xwb\" (UniqueName: \"kubernetes.io/projected/6de2186e-f915-494d-9510-49123ef054a4-kube-api-access-m6xwb\") pod \"maas-controller-5f59564f6b-mdlk2\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") " pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:55.021613 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:55.021572    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:55.131661 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:55.131636    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6c76df795b-vmztp"]
Sep 11 21:39:55.133094 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:39:55.133070    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1dce0c3_318a_436f_8878_27e8d4c57d56.slice/crio-6c1886e39f6f82ca6abc37b62cb7bf5bfca7d73a70676bbd1942f5573dea2c7e WatchSource:0}: Error finding container 6c1886e39f6f82ca6abc37b62cb7bf5bfca7d73a70676bbd1942f5573dea2c7e: Status 404 returned error can't find the container with id 6c1886e39f6f82ca6abc37b62cb7bf5bfca7d73a70676bbd1942f5573dea2c7e
Sep 11 21:39:55.304777 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:55.304752    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-mdlk2"]
Sep 11 21:39:55.306404 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:39:55.306379    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de2186e_f915_494d_9510_49123ef054a4.slice/crio-198b861ce6f47179d0ff9a0baaa492bc1c4c546cf3f6ba986ad2c4db6d1af139 WatchSource:0}: Error finding container 198b861ce6f47179d0ff9a0baaa492bc1c4c546cf3f6ba986ad2c4db6d1af139: Status 404 returned error can't find the container with id 198b861ce6f47179d0ff9a0baaa492bc1c4c546cf3f6ba986ad2c4db6d1af139
Sep 11 21:39:55.899838 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:55.899799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c76df795b-vmztp" event={"ID":"f1dce0c3-318a-436f-8878-27e8d4c57d56","Type":"ContainerStarted","Data":"6c1886e39f6f82ca6abc37b62cb7bf5bfca7d73a70676bbd1942f5573dea2c7e"}
Sep 11 21:39:55.901749 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:55.901715    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f59564f6b-mdlk2" event={"ID":"6de2186e-f915-494d-9510-49123ef054a4","Type":"ContainerStarted","Data":"198b861ce6f47179d0ff9a0baaa492bc1c4c546cf3f6ba986ad2c4db6d1af139"}
Sep 11 21:39:57.920017 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:57.919973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f59564f6b-mdlk2" event={"ID":"6de2186e-f915-494d-9510-49123ef054a4","Type":"ContainerStarted","Data":"4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3"}
Sep 11 21:39:57.920417 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:57.920048    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:39:57.921648 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:57.921625    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c76df795b-vmztp" event={"ID":"f1dce0c3-318a-436f-8878-27e8d4c57d56","Type":"ContainerStarted","Data":"8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279"}
Sep 11 21:39:57.921743 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:57.921682    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:39:57.941791 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:57.941747    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f59564f6b-mdlk2" podStartSLOduration=1.474837697 podStartE2EDuration="3.941734884s" totalImagesPullingTime="2.466897187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:39:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:39:57.938187779 +0000 UTC m=+552.595751561" watchObservedRunningTime="2026-09-11 21:39:57.941734884 +0000 UTC m=+552.599298645"
Sep 11 21:39:57.972220 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:39:57.972169    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6c76df795b-vmztp" podStartSLOduration=1.3210382090000001 podStartE2EDuration="3.972152489s" totalImagesPullingTime="2.65111428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:39:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:39:57.968084258 +0000 UTC m=+552.625648046" watchObservedRunningTime="2026-09-11 21:39:57.972152489 +0000 UTC m=+552.629716252"
Sep 11 21:40:08.929526 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:08.929494    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 21:40:08.929989 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:08.929669    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:40:08.996614 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:08.996583    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c76df795b-vmztp"]
Sep 11 21:40:08.996858 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:08.996821    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-6c76df795b-vmztp" podUID="f1dce0c3-318a-436f-8878-27e8d4c57d56" containerName="manager" containerID="cri-o://8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279" gracePeriod=30
Sep 11 21:40:09.255132 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.255105    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:40:09.336743 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.336710    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrlnn\" (UniqueName: \"kubernetes.io/projected/f1dce0c3-318a-436f-8878-27e8d4c57d56-kube-api-access-hrlnn\") pod \"f1dce0c3-318a-436f-8878-27e8d4c57d56\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") "
Sep 11 21:40:09.336906 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.336758    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-metrics-certs\") pod \"f1dce0c3-318a-436f-8878-27e8d4c57d56\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") "
Sep 11 21:40:09.336906 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.336836    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-webhook-cert\") pod \"f1dce0c3-318a-436f-8878-27e8d4c57d56\" (UID: \"f1dce0c3-318a-436f-8878-27e8d4c57d56\") "
Sep 11 21:40:09.339119 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.339081    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "f1dce0c3-318a-436f-8878-27e8d4c57d56" (UID: "f1dce0c3-318a-436f-8878-27e8d4c57d56"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:40:09.339119 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.339095    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f1dce0c3-318a-436f-8878-27e8d4c57d56" (UID: "f1dce0c3-318a-436f-8878-27e8d4c57d56"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:40:09.339265 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.339202    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1dce0c3-318a-436f-8878-27e8d4c57d56-kube-api-access-hrlnn" (OuterVolumeSpecName: "kube-api-access-hrlnn") pod "f1dce0c3-318a-436f-8878-27e8d4c57d56" (UID: "f1dce0c3-318a-436f-8878-27e8d4c57d56"). InnerVolumeSpecName "kube-api-access-hrlnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:40:09.437784 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.437756    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrlnn\" (UniqueName: \"kubernetes.io/projected/f1dce0c3-318a-436f-8878-27e8d4c57d56-kube-api-access-hrlnn\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:40:09.437784 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.437779    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:40:09.437938 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.437789    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f1dce0c3-318a-436f-8878-27e8d4c57d56-webhook-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:40:09.991841 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.991800    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1dce0c3-318a-436f-8878-27e8d4c57d56" containerID="8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279" exitCode=0
Sep 11 21:40:09.992299 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.991852    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6c76df795b-vmztp"
Sep 11 21:40:09.992299 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.991839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c76df795b-vmztp" event={"ID":"f1dce0c3-318a-436f-8878-27e8d4c57d56","Type":"ContainerDied","Data":"8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279"}
Sep 11 21:40:09.992299 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.991988    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6c76df795b-vmztp" event={"ID":"f1dce0c3-318a-436f-8878-27e8d4c57d56","Type":"ContainerDied","Data":"6c1886e39f6f82ca6abc37b62cb7bf5bfca7d73a70676bbd1942f5573dea2c7e"}
Sep 11 21:40:09.992299 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:09.992022    2577 scope.go:117] "RemoveContainer" containerID="8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279"
Sep 11 21:40:10.001377 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:10.001199    2577 scope.go:117] "RemoveContainer" containerID="8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279"
Sep 11 21:40:10.001488 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:40:10.001454    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279\": container with ID starting with 8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279 not found: ID does not exist" containerID="8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279"
Sep 11 21:40:10.001551 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:10.001499    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279"} err="failed to get container status \"8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279\": rpc error: code = NotFound desc = could not find container \"8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279\": container with ID starting with 8ee05a69d2513471ad2e7acc4842efbb5a97fb34f89dd1e46ceb2e03fa445279 not found: ID does not exist"
Sep 11 21:40:10.008767 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:10.008746    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6c76df795b-vmztp"]
Sep 11 21:40:10.012518 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:10.012499    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6c76df795b-vmztp"]
Sep 11 21:40:11.760847 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:11.760812    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1dce0c3-318a-436f-8878-27e8d4c57d56" path="/var/lib/kubelet/pods/f1dce0c3-318a-436f-8878-27e8d4c57d56/volumes"
Sep 11 21:40:32.316944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.316909    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"]
Sep 11 21:40:32.317360 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.317346    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1dce0c3-318a-436f-8878-27e8d4c57d56" containerName="manager"
Sep 11 21:40:32.317405 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.317362    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1dce0c3-318a-436f-8878-27e8d4c57d56" containerName="manager"
Sep 11 21:40:32.317440 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.317433    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1dce0c3-318a-436f-8878-27e8d4c57d56" containerName="manager"
Sep 11 21:40:32.326893 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.326864    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.332195 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.332165    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-2kttz\""
Sep 11 21:40:32.332342 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.332203    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 21:40:32.332342 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.332162    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 21:40:32.332636 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.332616    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"]
Sep 11 21:40:32.438823 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.438779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1672317-e74e-4735-9039-0167625ad4c6-openshift-service-ca\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.438823 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.438828    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfzp5\" (UniqueName: \"kubernetes.io/projected/f1672317-e74e-4735-9039-0167625ad4c6-kube-api-access-gfzp5\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.439030 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.438954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-metrics-certs\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.439030 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.439020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-maas-api-tls\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.540190 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.540157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-maas-api-tls\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.540348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.540223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1672317-e74e-4735-9039-0167625ad4c6-openshift-service-ca\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.540348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.540250    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfzp5\" (UniqueName: \"kubernetes.io/projected/f1672317-e74e-4735-9039-0167625ad4c6-kube-api-access-gfzp5\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.540348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.540330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-metrics-certs\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.541028 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.540934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1672317-e74e-4735-9039-0167625ad4c6-openshift-service-ca\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.543159 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.543131    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-maas-api-tls\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.543269 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.543236    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-metrics-certs\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.549399 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.549376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfzp5\" (UniqueName: \"kubernetes.io/projected/f1672317-e74e-4735-9039-0167625ad4c6-kube-api-access-gfzp5\") pod \"maas-api-85cff974b6-dnqjg\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") " pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.640087 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.640012    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:32.816170 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.816131    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"]
Sep 11 21:40:32.822076 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.822053    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:32.825243 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.825112    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 11 21:40:32.829201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.829177    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"]
Sep 11 21:40:32.924516 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.924491    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"]
Sep 11 21:40:32.925719 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:40:32.925698    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1672317_e74e_4735_9039_0167625ad4c6.slice/crio-2921e7a0f34eadde9ce233c82def16e71cf87cd7078bc3523f2c35e048932143 WatchSource:0}: Error finding container 2921e7a0f34eadde9ce233c82def16e71cf87cd7078bc3523f2c35e048932143: Status 404 returned error can't find the container with id 2921e7a0f34eadde9ce233c82def16e71cf87cd7078bc3523f2c35e048932143
Sep 11 21:40:32.943949 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.943917    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f0e7cf0-40f5-4689-a946-f62eb479307c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9tfpz\" (UID: \"1f0e7cf0-40f5-4689-a946-f62eb479307c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:32.944120 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:32.944103    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5czq\" (UniqueName: \"kubernetes.io/projected/1f0e7cf0-40f5-4689-a946-f62eb479307c-kube-api-access-z5czq\") pod \"payload-processing-5b54b7fbb7-9tfpz\" (UID: \"1f0e7cf0-40f5-4689-a946-f62eb479307c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:33.044951 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:33.044913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5czq\" (UniqueName: \"kubernetes.io/projected/1f0e7cf0-40f5-4689-a946-f62eb479307c-kube-api-access-z5czq\") pod \"payload-processing-5b54b7fbb7-9tfpz\" (UID: \"1f0e7cf0-40f5-4689-a946-f62eb479307c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:33.045114 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:33.044989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f0e7cf0-40f5-4689-a946-f62eb479307c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9tfpz\" (UID: \"1f0e7cf0-40f5-4689-a946-f62eb479307c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:33.045652 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:33.045635    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f0e7cf0-40f5-4689-a946-f62eb479307c-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-9tfpz\" (UID: \"1f0e7cf0-40f5-4689-a946-f62eb479307c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:33.052802 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:33.052778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5czq\" (UniqueName: \"kubernetes.io/projected/1f0e7cf0-40f5-4689-a946-f62eb479307c-kube-api-access-z5czq\") pod \"payload-processing-5b54b7fbb7-9tfpz\" (UID: \"1f0e7cf0-40f5-4689-a946-f62eb479307c\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:33.135142 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:33.135106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg" event={"ID":"f1672317-e74e-4735-9039-0167625ad4c6","Type":"ContainerStarted","Data":"2921e7a0f34eadde9ce233c82def16e71cf87cd7078bc3523f2c35e048932143"}
Sep 11 21:40:33.136260 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:33.136232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:33.446250 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:33.446215    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"]
Sep 11 21:40:33.448009 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:40:33.447982    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f0e7cf0_40f5_4689_a946_f62eb479307c.slice/crio-ab9d98a678c7efa9ef4367ef2aef5a1ad421fee8287a01dffe6bb809442d0281 WatchSource:0}: Error finding container ab9d98a678c7efa9ef4367ef2aef5a1ad421fee8287a01dffe6bb809442d0281: Status 404 returned error can't find the container with id ab9d98a678c7efa9ef4367ef2aef5a1ad421fee8287a01dffe6bb809442d0281
Sep 11 21:40:34.145156 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:34.145117    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz" event={"ID":"1f0e7cf0-40f5-4689-a946-f62eb479307c","Type":"ContainerStarted","Data":"ab9d98a678c7efa9ef4367ef2aef5a1ad421fee8287a01dffe6bb809442d0281"}
Sep 11 21:40:36.161489 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:36.161430    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg" event={"ID":"f1672317-e74e-4735-9039-0167625ad4c6","Type":"ContainerStarted","Data":"79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe"}
Sep 11 21:40:36.161958 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:36.161526    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:36.163339 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:36.163307    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz" event={"ID":"1f0e7cf0-40f5-4689-a946-f62eb479307c","Type":"ContainerStarted","Data":"ed3188885b39075d9c9da90dc4a2e42d5ab8fed7f2b9266d951610e1301e3796"}
Sep 11 21:40:36.163496 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:36.163368    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:36.180784 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:36.180738    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg" podStartSLOduration=1.464379562 podStartE2EDuration="4.180723845s" totalImagesPullingTime="2.716344283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:40:36.178250346 +0000 UTC m=+590.835814104" watchObservedRunningTime="2026-09-11 21:40:36.180723845 +0000 UTC m=+590.838287600"
Sep 11 21:40:36.195534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:36.195495    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz" podStartSLOduration=1.999234671 podStartE2EDuration="4.195480134s" totalImagesPullingTime="2.196245463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:40:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:40:36.193128417 +0000 UTC m=+590.850692186" watchObservedRunningTime="2026-09-11 21:40:36.195480134 +0000 UTC m=+590.853043888"
Sep 11 21:40:41.653637 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:41.653597    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t5pnb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 21:40:41.654099 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:41.653654    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" podUID="e5fd29eb-c039-4b76-bd5e-c958a68dd71c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 21:40:42.175289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:42.175260    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 21:40:42.201606 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:42.201576    2577 generic.go:356] "Generic (PLEG): container finished" podID="e5fd29eb-c039-4b76-bd5e-c958a68dd71c" containerID="e599b50e8cb2c8b653e853050f17cadb7e25bf18358cfee67642d153ba83881f" exitCode=0
Sep 11 21:40:42.201795 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:42.201632    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" event={"ID":"e5fd29eb-c039-4b76-bd5e-c958a68dd71c","Type":"ContainerDied","Data":"e599b50e8cb2c8b653e853050f17cadb7e25bf18358cfee67642d153ba83881f"}
Sep 11 21:40:42.202043 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:42.202026    2577 scope.go:117] "RemoveContainer" containerID="e599b50e8cb2c8b653e853050f17cadb7e25bf18358cfee67642d153ba83881f"
Sep 11 21:40:42.203365 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:42.203332    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:40:42.203433 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:42.203399    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:40:42.203521 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:42.203448    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:40:43.212935 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:43.212902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" event={"ID":"e5fd29eb-c039-4b76-bd5e-c958a68dd71c","Type":"ContainerStarted","Data":"dabb90cc5b33db8d3166054e3a040dd17e58e3aa540418ae2bfc70987579ac01"}
Sep 11 21:40:44.185720 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:44.185690    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:40:44.185916 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:44.185823    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t5pnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:40:44.185916 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:44.185881    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" podUID="e5fd29eb-c039-4b76-bd5e-c958a68dd71c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 21:40:45.185440 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:45.185396    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t5pnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:40:45.185940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:45.185494    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" podUID="e5fd29eb-c039-4b76-bd5e-c958a68dd71c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 21:40:45.755705 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:45.755678    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:40:45.760713 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:45.760687    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:40:46.185945 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:46.185915    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t5pnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:40:46.186309 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:46.185970    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" podUID="e5fd29eb-c039-4b76-bd5e-c958a68dd71c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 21:40:47.171088 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:47.171059    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-9tfpz"
Sep 11 21:40:47.186321 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:47.186292    2577 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-t5pnb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 11 21:40:47.186683 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:47.186349    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb" podUID="e5fd29eb-c039-4b76-bd5e-c958a68dd71c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 11 21:40:48.189336 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:48.189310    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:40:48.189801 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:48.189622    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:40:48.190246 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:40:48.190225    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-t5pnb"
Sep 11 21:41:11.957390 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:11.957279    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"]
Sep 11 21:41:11.961644 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:11.961622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:11.964231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:11.964207    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-442fp\""
Sep 11 21:41:11.964417 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:11.964276    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 21:41:11.965388 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:11.965361    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 11 21:41:11.965388 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:11.965381    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 21:41:11.971697 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:11.971673    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"]
Sep 11 21:41:12.004785 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.004757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.004936 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.004803    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.004936 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.004844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-675b5\" (UniqueName: \"kubernetes.io/projected/e2332545-7b51-4de1-910f-0350a05d7517-kube-api-access-675b5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.004936 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.004878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.004936 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.004924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.005113 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.004951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2332545-7b51-4de1-910f-0350a05d7517-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.105854 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.105824    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.105982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.105862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.105982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.105882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2332545-7b51-4de1-910f-0350a05d7517-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.105982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.105941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.106134 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.105988    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.106134 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.106022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-675b5\" (UniqueName: \"kubernetes.io/projected/e2332545-7b51-4de1-910f-0350a05d7517-kube-api-access-675b5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.106276 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.106251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.106339 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.106290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.106396 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.106370    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.108292 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.108272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e2332545-7b51-4de1-910f-0350a05d7517-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.108602 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.108583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e2332545-7b51-4de1-910f-0350a05d7517-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.114383 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.114359    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-675b5\" (UniqueName: \"kubernetes.io/projected/e2332545-7b51-4de1-910f-0350a05d7517-kube-api-access-675b5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-7d96c\" (UID: \"e2332545-7b51-4de1-910f-0350a05d7517\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.273946 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.273869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:12.547231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.547209    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"]
Sep 11 21:41:12.548255 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:41:12.548230    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2332545_7b51_4de1_910f_0350a05d7517.slice/crio-fbc4b487289e4daef3d0dac39b60c02f2f869572db9455278a3c2256bb7d090b WatchSource:0}: Error finding container fbc4b487289e4daef3d0dac39b60c02f2f869572db9455278a3c2256bb7d090b: Status 404 returned error can't find the container with id fbc4b487289e4daef3d0dac39b60c02f2f869572db9455278a3c2256bb7d090b
Sep 11 21:41:12.549622 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:12.549597    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:41:13.409270 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:13.409238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c" event={"ID":"e2332545-7b51-4de1-910f-0350a05d7517","Type":"ContainerStarted","Data":"fbc4b487289e4daef3d0dac39b60c02f2f869572db9455278a3c2256bb7d090b"}
Sep 11 21:41:14.417033 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:14.416996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c" event={"ID":"e2332545-7b51-4de1-910f-0350a05d7517","Type":"ContainerStarted","Data":"9ad759ae4cb9e6bfbbfb21955fdf8932af289e7ffa755125720d10f0ee67d8d1"}
Sep 11 21:41:14.440845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:14.440785    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c" podStartSLOduration=2.45857321 podStartE2EDuration="3.440769999s" totalImagesPullingTime="982.196789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:41:14.438364242 +0000 UTC m=+629.095928005" watchObservedRunningTime="2026-09-11 21:41:14.440769999 +0000 UTC m=+629.098333763"
Sep 11 21:41:22.274134 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:22.274085    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:22.274580 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:22.274154    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:22.286734 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:22.286713    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:22.480912 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:22.480885    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-7d96c"
Sep 11 21:41:49.567296 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.567263    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"]
Sep 11 21:41:49.572174 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.572153    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.574964 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.574940    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 21:41:49.583161 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.583136    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"]
Sep 11 21:41:49.738990 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.738960    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.739184 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.739016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.739184 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.739034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.739184 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.739155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz5gp\" (UniqueName: \"kubernetes.io/projected/59e5022c-74ae-44d8-9ffb-57f33b69a464-kube-api-access-nz5gp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.739332 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.739198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.739332 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.739222    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59e5022c-74ae-44d8-9ffb-57f33b69a464-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.840353 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.840273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.840353 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.840326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.840586 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.840433    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.840586 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.840531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz5gp\" (UniqueName: \"kubernetes.io/projected/59e5022c-74ae-44d8-9ffb-57f33b69a464-kube-api-access-nz5gp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.840675 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.840588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.840675 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.840625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59e5022c-74ae-44d8-9ffb-57f33b69a464-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.840768 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.840749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.840814 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.840799    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.840992 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.840969    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.842726 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.842698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59e5022c-74ae-44d8-9ffb-57f33b69a464-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.843036 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.843018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59e5022c-74ae-44d8-9ffb-57f33b69a464-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.848420 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.848396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz5gp\" (UniqueName: \"kubernetes.io/projected/59e5022c-74ae-44d8-9ffb-57f33b69a464-kube-api-access-nz5gp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5\" (UID: \"59e5022c-74ae-44d8-9ffb-57f33b69a464\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:49.884508 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:49.884491    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:50.165566 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:50.165540    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"]
Sep 11 21:41:50.167282 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:41:50.167258    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e5022c_74ae_44d8_9ffb_57f33b69a464.slice/crio-9cff6a98ad2d508ff4302f4737857acb69486096e9fdf6e3b89d25876711e29c WatchSource:0}: Error finding container 9cff6a98ad2d508ff4302f4737857acb69486096e9fdf6e3b89d25876711e29c: Status 404 returned error can't find the container with id 9cff6a98ad2d508ff4302f4737857acb69486096e9fdf6e3b89d25876711e29c
Sep 11 21:41:50.640228 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:50.640142    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5" event={"ID":"59e5022c-74ae-44d8-9ffb-57f33b69a464","Type":"ContainerStarted","Data":"12934ff9749f8a215f0687ec95240217d31e729398dd32bd09d4291498e03e20"}
Sep 11 21:41:50.640228 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:50.640199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5" event={"ID":"59e5022c-74ae-44d8-9ffb-57f33b69a464","Type":"ContainerStarted","Data":"9cff6a98ad2d508ff4302f4737857acb69486096e9fdf6e3b89d25876711e29c"}
Sep 11 21:41:50.657504 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:50.657423    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5" podStartSLOduration=1.474330417 podStartE2EDuration="1.657406813s" totalImagesPullingTime="183.076396ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:41:50.655342659 +0000 UTC m=+665.312906423" watchObservedRunningTime="2026-09-11 21:41:50.657406813 +0000 UTC m=+665.314970577"
Sep 11 21:41:59.885541 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:59.885504    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:59.885921 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:59.885574    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:41:59.898034 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:41:59.898008    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:42:00.713933 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:42:00.713903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5"
Sep 11 21:43:39.980363 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:39.980332    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"]
Sep 11 21:43:39.984434 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:39.984416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:39.987301 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:39.987281    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-f12741-openshift-default-dockercfg-tf752\""
Sep 11 21:43:39.999731 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:39.999707    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"]
Sep 11 21:43:40.055433 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.055374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-certs\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.055692 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.055500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-istio-token\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.055692 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.055545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-socket\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.055692 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.055587    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-data\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.055692 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.055618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3095797f-510f-4081-938d-eef8cec363d8-istio-podinfo\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.056005 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.055729    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-envoy\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.056005 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.055793    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92hmq\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-kube-api-access-92hmq\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.056005 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.055832    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-credential-socket\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.056005 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.055872    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3095797f-510f-4081-938d-eef8cec363d8-istiod-ca-cert\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.156743 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.156704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-data\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.156952 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.156760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3095797f-510f-4081-938d-eef8cec363d8-istio-podinfo\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.156952 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.156817    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-envoy\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.156952 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.156884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92hmq\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-kube-api-access-92hmq\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.156952 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.156928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-credential-socket\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.157182 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.156975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3095797f-510f-4081-938d-eef8cec363d8-istiod-ca-cert\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.157182 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.157046    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-certs\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.157182 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.157072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-istio-token\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.157182 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.157110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-socket\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.157399 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.157219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-data\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.157399 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.157310    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-credential-socket\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.157566 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.157534    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-socket\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.157629 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.157544    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-certs\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.158123 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.158096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3095797f-510f-4081-938d-eef8cec363d8-istiod-ca-cert\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.159464 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.159422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-envoy\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.159711 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.159691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3095797f-510f-4081-938d-eef8cec363d8-istio-podinfo\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.166095 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.166063    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-istio-token\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.166208 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.166188    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92hmq\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-kube-api-access-92hmq\") pod \"e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") " pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.302521 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.302404    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:40.581520 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.581486    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"]
Sep 11 21:43:40.582059 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:43:40.582035    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3095797f_510f_4081_938d_eef8cec363d8.slice/crio-f9539f75f89018b58ee3939c1196513a79de25fa1b73c8733411a087ef010835 WatchSource:0}: Error finding container f9539f75f89018b58ee3939c1196513a79de25fa1b73c8733411a087ef010835: Status 404 returned error can't find the container with id f9539f75f89018b58ee3939c1196513a79de25fa1b73c8733411a087ef010835
Sep 11 21:43:40.584294 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.584265    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:43:40.584357 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.584333    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:43:40.584395 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:40.584360    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:43:41.299641 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.299604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" event={"ID":"3095797f-510f-4081-938d-eef8cec363d8","Type":"ContainerStarted","Data":"48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903"}
Sep 11 21:43:41.300106 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.299668    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" event={"ID":"3095797f-510f-4081-938d-eef8cec363d8","Type":"ContainerStarted","Data":"f9539f75f89018b58ee3939c1196513a79de25fa1b73c8733411a087ef010835"}
Sep 11 21:43:41.303106 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.303029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:41.308806 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.308782    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:41.324327 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.324284    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" podStartSLOduration=2.324270279 podStartE2EDuration="2.324270279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:43:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:43:41.322709694 +0000 UTC m=+775.980273458" watchObservedRunningTime="2026-09-11 21:43:41.324270279 +0000 UTC m=+775.981834042"
Sep 11 21:43:41.651056 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.650980    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7980-924820"]
Sep 11 21:43:41.654693 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.654675    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7980-924820"
Sep 11 21:43:41.657453 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.657428    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x6r4k\""
Sep 11 21:43:41.659346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.659324    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7980-924820"]
Sep 11 21:43:41.773015 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.772985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mljp7\" (UniqueName: \"kubernetes.io/projected/22ec0e34-ab76-487a-8841-7481fb1b06cc-kube-api-access-mljp7\") pod \"test-curl-7980-924820\" (UID: \"22ec0e34-ab76-487a-8841-7481fb1b06cc\") " pod="opendatahub/test-curl-7980-924820"
Sep 11 21:43:41.874040 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.874002    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mljp7\" (UniqueName: \"kubernetes.io/projected/22ec0e34-ab76-487a-8841-7481fb1b06cc-kube-api-access-mljp7\") pod \"test-curl-7980-924820\" (UID: \"22ec0e34-ab76-487a-8841-7481fb1b06cc\") " pod="opendatahub/test-curl-7980-924820"
Sep 11 21:43:41.882600 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.882578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mljp7\" (UniqueName: \"kubernetes.io/projected/22ec0e34-ab76-487a-8841-7481fb1b06cc-kube-api-access-mljp7\") pod \"test-curl-7980-924820\" (UID: \"22ec0e34-ab76-487a-8841-7481fb1b06cc\") " pod="opendatahub/test-curl-7980-924820"
Sep 11 21:43:41.967596 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:41.967548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7980-924820"
Sep 11 21:43:42.245371 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:42.245341    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7980-924820"]
Sep 11 21:43:42.246217 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:43:42.246187    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22ec0e34_ab76_487a_8841_7481fb1b06cc.slice/crio-b0b218e5fd5da718ff6c5a2b4a4c062248fbcb2c5976e59465ac8586afab3d3a WatchSource:0}: Error finding container b0b218e5fd5da718ff6c5a2b4a4c062248fbcb2c5976e59465ac8586afab3d3a: Status 404 returned error can't find the container with id b0b218e5fd5da718ff6c5a2b4a4c062248fbcb2c5976e59465ac8586afab3d3a
Sep 11 21:43:42.309393 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:42.309346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7980-924820" event={"ID":"22ec0e34-ab76-487a-8841-7481fb1b06cc","Type":"ContainerStarted","Data":"b0b218e5fd5da718ff6c5a2b4a4c062248fbcb2c5976e59465ac8586afab3d3a"}
Sep 11 21:43:42.309955 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:42.309871    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:42.311018 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:42.310996    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:43:45.157513 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.157461    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"]
Sep 11 21:43:45.161571 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.161538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.164603 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.164402    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-35e777-serving-cert\""
Sep 11 21:43:45.173869 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.172755    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"]
Sep 11 21:43:45.211354 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.211313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a198872-bc11-4d12-8381-d253ff32ca13-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.211559 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.211382    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdzbd\" (UniqueName: \"kubernetes.io/projected/7a198872-bc11-4d12-8381-d253ff32ca13-kube-api-access-rdzbd\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.211559 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.211441    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-metrics-certs\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.211698 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.211558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-maas-api-tls\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.312574 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.312530    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a198872-bc11-4d12-8381-d253ff32ca13-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.312776 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.312604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdzbd\" (UniqueName: \"kubernetes.io/projected/7a198872-bc11-4d12-8381-d253ff32ca13-kube-api-access-rdzbd\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.312776 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.312634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-metrics-certs\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.312776 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.312732    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-maas-api-tls\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.313425 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.313392    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a198872-bc11-4d12-8381-d253ff32ca13-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.316255 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.316224    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-metrics-certs\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.316887 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.316857    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-maas-api-tls\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.322023 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.321996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdzbd\" (UniqueName: \"kubernetes.io/projected/7a198872-bc11-4d12-8381-d253ff32ca13-kube-api-access-rdzbd\") pod \"maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.340852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.340789    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7980-924820" event={"ID":"22ec0e34-ab76-487a-8841-7481fb1b06cc","Type":"ContainerStarted","Data":"80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45"}
Sep 11 21:43:45.357442 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.357391    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7980-924820" podStartSLOduration=2.348879333 podStartE2EDuration="4.357373169s" totalImagesPullingTime="2.008493836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:43:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:43:45.3556412 +0000 UTC m=+780.013204964" watchObservedRunningTime="2026-09-11 21:43:45.357373169 +0000 UTC m=+780.014936935"
Sep 11 21:43:45.481317 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.481288    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:45.772360 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.772329    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"]
Sep 11 21:43:45.772877 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:43:45.772836    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a198872_bc11_4d12_8381_d253ff32ca13.slice/crio-8c777a99caa043953ce00aa777ad75dc2c8f24dd7e9c9f41c1b5e046811c75ab WatchSource:0}: Error finding container 8c777a99caa043953ce00aa777ad75dc2c8f24dd7e9c9f41c1b5e046811c75ab: Status 404 returned error can't find the container with id 8c777a99caa043953ce00aa777ad75dc2c8f24dd7e9c9f41c1b5e046811c75ab
Sep 11 21:43:45.989587 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.989559    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7980-924820"]
Sep 11 21:43:45.996262 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:45.996235    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7980-924820"]
Sep 11 21:43:46.114671 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.114587    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7980-385a96"]
Sep 11 21:43:46.115148 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.115129    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22ec0e34-ab76-487a-8841-7481fb1b06cc" containerName="test-curl-7980-924820"
Sep 11 21:43:46.115148 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.115149    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="22ec0e34-ab76-487a-8841-7481fb1b06cc" containerName="test-curl-7980-924820"
Sep 11 21:43:46.115294 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.115249    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="22ec0e34-ab76-487a-8841-7481fb1b06cc" containerName="test-curl-7980-924820"
Sep 11 21:43:46.119900 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.119868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7980-385a96"
Sep 11 21:43:46.123319 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.123297    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7980-385a96"]
Sep 11 21:43:46.170432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.170401    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"]
Sep 11 21:43:46.174108 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.174084    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.176688 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.176668    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w0-f12741-serving-cert\""
Sep 11 21:43:46.198876 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.198308    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"]
Sep 11 21:43:46.223639 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.223608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-metrics-certs\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.223776 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.223694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pf5g\" (UniqueName: \"kubernetes.io/projected/068787ce-a167-481d-a73a-2b9137452276-kube-api-access-9pf5g\") pod \"test-curl-7980-385a96\" (UID: \"068787ce-a167-481d-a73a-2b9137452276\") " pod="opendatahub/test-curl-7980-385a96"
Sep 11 21:43:46.223776 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.223719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0c39023-7b08-42dc-89f8-5a59d061b854-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.223776 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.223748    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.223924 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.223775    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqfht\" (UniqueName: \"kubernetes.io/projected/f0c39023-7b08-42dc-89f8-5a59d061b854-kube-api-access-gqfht\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.324776 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.324744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pf5g\" (UniqueName: \"kubernetes.io/projected/068787ce-a167-481d-a73a-2b9137452276-kube-api-access-9pf5g\") pod \"test-curl-7980-385a96\" (UID: \"068787ce-a167-481d-a73a-2b9137452276\") " pod="opendatahub/test-curl-7980-385a96"
Sep 11 21:43:46.324971 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.324791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0c39023-7b08-42dc-89f8-5a59d061b854-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.324971 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.324845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.324971 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.324876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqfht\" (UniqueName: \"kubernetes.io/projected/f0c39023-7b08-42dc-89f8-5a59d061b854-kube-api-access-gqfht\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.325140 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.324971    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-metrics-certs\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.325140 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:46.324969    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-serving-cert: secret "maas-api-e2e-worker-w0-f12741-serving-cert" not found
Sep 11 21:43:46.325140 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:46.325112    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-maas-api-tls podName:f0c39023-7b08-42dc-89f8-5a59d061b854 nodeName:}" failed. No retries permitted until 2026-09-11 21:43:46.825087692 +0000 UTC m=+781.482651438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-maas-api-tls") pod "maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42" (UID: "f0c39023-7b08-42dc-89f8-5a59d061b854") : secret "maas-api-e2e-worker-w0-f12741-serving-cert" not found
Sep 11 21:43:46.325595 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.325563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0c39023-7b08-42dc-89f8-5a59d061b854-openshift-service-ca\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.327448 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.327428    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-metrics-certs\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.333649 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.333626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqfht\" (UniqueName: \"kubernetes.io/projected/f0c39023-7b08-42dc-89f8-5a59d061b854-kube-api-access-gqfht\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.334084 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.334064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pf5g\" (UniqueName: \"kubernetes.io/projected/068787ce-a167-481d-a73a-2b9137452276-kube-api-access-9pf5g\") pod \"test-curl-7980-385a96\" (UID: \"068787ce-a167-481d-a73a-2b9137452276\") " pod="opendatahub/test-curl-7980-385a96"
Sep 11 21:43:46.348308 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.348285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s" event={"ID":"7a198872-bc11-4d12-8381-d253ff32ca13","Type":"ContainerStarted","Data":"f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b"}
Sep 11 21:43:46.348409 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.348337    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s" event={"ID":"7a198872-bc11-4d12-8381-d253ff32ca13","Type":"ContainerStarted","Data":"8c777a99caa043953ce00aa777ad75dc2c8f24dd7e9c9f41c1b5e046811c75ab"}
Sep 11 21:43:46.348550 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:46.348532    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7980-924820" container="test-curl-7980-924820"
Sep 11 21:43:46.368252 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.368169    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s" podStartSLOduration=0.965559391 podStartE2EDuration="1.368156322s" totalImagesPullingTime="402.596931ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:43:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:43:46.365443196 +0000 UTC m=+781.023006958" watchObservedRunningTime="2026-09-11 21:43:46.368156322 +0000 UTC m=+781.025720105"
Sep 11 21:43:46.431708 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.431681    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7980-385a96"
Sep 11 21:43:46.706870 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.706839    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7980-385a96"]
Sep 11 21:43:46.708510 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:43:46.708464    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod068787ce_a167_481d_a73a_2b9137452276.slice/crio-59c237e6ab4cbc8774e019ef7998b3cf46338a4fec0133b11b466b504f35a78c WatchSource:0}: Error finding container 59c237e6ab4cbc8774e019ef7998b3cf46338a4fec0133b11b466b504f35a78c: Status 404 returned error can't find the container with id 59c237e6ab4cbc8774e019ef7998b3cf46338a4fec0133b11b466b504f35a78c
Sep 11 21:43:46.830517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.830486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:46.833224 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:46.833201    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-maas-api-tls\") pod \"maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:47.096790 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:47.096712    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:47.356456 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:47.356363    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7980-385a96" event={"ID":"068787ce-a167-481d-a73a-2b9137452276","Type":"ContainerStarted","Data":"58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216"}
Sep 11 21:43:47.356456 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:47.356412    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7980-385a96" event={"ID":"068787ce-a167-481d-a73a-2b9137452276","Type":"ContainerStarted","Data":"59c237e6ab4cbc8774e019ef7998b3cf46338a4fec0133b11b466b504f35a78c"}
Sep 11 21:43:47.356959 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:47.356768    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7980-924820" podUID="22ec0e34-ab76-487a-8841-7481fb1b06cc" containerName="test-curl-7980-924820" containerID="cri-o://80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45" gracePeriod=2
Sep 11 21:43:47.356959 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:47.356788    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:47.371930 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:47.371889    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7980-385a96" podStartSLOduration=1.37187619 podStartE2EDuration="1.37187619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:43:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:43:47.370239997 +0000 UTC m=+782.027803765" watchObservedRunningTime="2026-09-11 21:43:47.37187619 +0000 UTC m=+782.029439954"
Sep 11 21:43:47.372419 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:47.372394    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7980-924820\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="22ec0e34-ab76-487a-8841-7481fb1b06cc" pod="opendatahub/test-curl-7980-924820"
Sep 11 21:43:47.378787 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:47.378758    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"]
Sep 11 21:43:47.379627 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:43:47.379609    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0c39023_7b08_42dc_89f8_5a59d061b854.slice/crio-0bd620f23d2d92316b6af7e7f5a4888b8f35fe0dd42df48cc15f3780af82d7f7 WatchSource:0}: Error finding container 0bd620f23d2d92316b6af7e7f5a4888b8f35fe0dd42df48cc15f3780af82d7f7: Status 404 returned error can't find the container with id 0bd620f23d2d92316b6af7e7f5a4888b8f35fe0dd42df48cc15f3780af82d7f7
Sep 11 21:43:48.029532 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:48.029397    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7980-385a96"]
Sep 11 21:43:48.033591 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:48.033567    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7980-385a96"]
Sep 11 21:43:48.364789 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:48.364456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42" event={"ID":"f0c39023-7b08-42dc-89f8-5a59d061b854","Type":"ContainerStarted","Data":"85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557"}
Sep 11 21:43:48.364789 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:48.364741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42" event={"ID":"f0c39023-7b08-42dc-89f8-5a59d061b854","Type":"ContainerStarted","Data":"0bd620f23d2d92316b6af7e7f5a4888b8f35fe0dd42df48cc15f3780af82d7f7"}
Sep 11 21:43:48.365245 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:48.364949    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7980-385a96" container="test-curl-7980-385a96"
Sep 11 21:43:48.386756 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:48.386712    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42" podStartSLOduration=2.013608186 podStartE2EDuration="2.386698073s" totalImagesPullingTime="373.089887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:43:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:43:48.384639761 +0000 UTC m=+783.042203526" watchObservedRunningTime="2026-09-11 21:43:48.386698073 +0000 UTC m=+783.044261875"
Sep 11 21:43:49.371322 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:49.371274    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7980-385a96" podUID="068787ce-a167-481d-a73a-2b9137452276" containerName="test-curl-7980-385a96" containerID="cri-o://58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216" gracePeriod=2
Sep 11 21:43:49.371700 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:49.371580    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:49.373430 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:49.373399    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7980-385a96\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="068787ce-a167-481d-a73a-2b9137452276" pod="opendatahub/test-curl-7980-385a96"
Sep 11 21:43:49.540940 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:49.540918    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7980-924820"
Sep 11 21:43:49.543314 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:49.543286    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7980-385a96\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="068787ce-a167-481d-a73a-2b9137452276" pod="opendatahub/test-curl-7980-385a96"
Sep 11 21:43:49.658446 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:49.658375    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mljp7\" (UniqueName: \"kubernetes.io/projected/22ec0e34-ab76-487a-8841-7481fb1b06cc-kube-api-access-mljp7\") pod \"22ec0e34-ab76-487a-8841-7481fb1b06cc\" (UID: \"22ec0e34-ab76-487a-8841-7481fb1b06cc\") "
Sep 11 21:43:49.660536 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:49.660512    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22ec0e34-ab76-487a-8841-7481fb1b06cc-kube-api-access-mljp7" (OuterVolumeSpecName: "kube-api-access-mljp7") pod "22ec0e34-ab76-487a-8841-7481fb1b06cc" (UID: "22ec0e34-ab76-487a-8841-7481fb1b06cc"). InnerVolumeSpecName "kube-api-access-mljp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:43:49.759217 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:49.759184    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mljp7\" (UniqueName: \"kubernetes.io/projected/22ec0e34-ab76-487a-8841-7481fb1b06cc-kube-api-access-mljp7\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:43:49.761341 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:49.761317    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22ec0e34-ab76-487a-8841-7481fb1b06cc" path="/var/lib/kubelet/pods/22ec0e34-ab76-487a-8841-7481fb1b06cc/volumes"
Sep 11 21:43:50.379014 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:50.378972    2577 generic.go:356] "Generic (PLEG): container finished" podID="22ec0e34-ab76-487a-8841-7481fb1b06cc" containerID="80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45" exitCode=137
Sep 11 21:43:50.379014 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:50.379017    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7980-924820"
Sep 11 21:43:50.379550 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:50.379062    2577 scope.go:117] "RemoveContainer" containerID="80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45"
Sep 11 21:43:50.388722 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:50.388702    2577 scope.go:117] "RemoveContainer" containerID="80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45"
Sep 11 21:43:50.388995 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:50.388978    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45\": container with ID starting with 80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45 not found: ID does not exist" containerID="80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45"
Sep 11 21:43:50.389046 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:50.389005    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45"} err="failed to get container status \"80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45\": rpc error: code = NotFound desc = could not find container \"80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45\": container with ID starting with 80211c393da2ae01d8b825ed8875f86a6bc2ed806c8d56ae020a9863f98d9a45 not found: ID does not exist"
Sep 11 21:43:51.554898 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:51.554870    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7980-385a96"
Sep 11 21:43:51.678769 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:51.678741    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pf5g\" (UniqueName: \"kubernetes.io/projected/068787ce-a167-481d-a73a-2b9137452276-kube-api-access-9pf5g\") pod \"068787ce-a167-481d-a73a-2b9137452276\" (UID: \"068787ce-a167-481d-a73a-2b9137452276\") "
Sep 11 21:43:51.680920 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:51.680890    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068787ce-a167-481d-a73a-2b9137452276-kube-api-access-9pf5g" (OuterVolumeSpecName: "kube-api-access-9pf5g") pod "068787ce-a167-481d-a73a-2b9137452276" (UID: "068787ce-a167-481d-a73a-2b9137452276"). InnerVolumeSpecName "kube-api-access-9pf5g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:43:51.761420 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:51.761389    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="068787ce-a167-481d-a73a-2b9137452276" path="/var/lib/kubelet/pods/068787ce-a167-481d-a73a-2b9137452276/volumes"
Sep 11 21:43:51.779829 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:51.779804    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pf5g\" (UniqueName: \"kubernetes.io/projected/068787ce-a167-481d-a73a-2b9137452276-kube-api-access-9pf5g\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:43:52.394073 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:52.394033    2577 generic.go:356] "Generic (PLEG): container finished" podID="068787ce-a167-481d-a73a-2b9137452276" containerID="58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216" exitCode=137
Sep 11 21:43:52.394261 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:52.394098    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7980-385a96"
Sep 11 21:43:52.394261 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:52.394115    2577 scope.go:117] "RemoveContainer" containerID="58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216"
Sep 11 21:43:52.406969 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:52.406636    2577 scope.go:117] "RemoveContainer" containerID="58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216"
Sep 11 21:43:52.407064 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:52.407040    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216\": container with ID starting with 58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216 not found: ID does not exist" containerID="58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216"
Sep 11 21:43:52.407136 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:52.407078    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216"} err="failed to get container status \"58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216\": rpc error: code = NotFound desc = could not find container \"58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216\": container with ID starting with 58f9c5b11e22d216625bb60171e65f25460716ea793b2234fca89a4a586a3216 not found: ID does not exist"
Sep 11 21:43:53.374751 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:53.374715    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:43:54.276790 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.276753    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"]
Sep 11 21:43:54.277263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.277249    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068787ce-a167-481d-a73a-2b9137452276" containerName="test-curl-7980-385a96"
Sep 11 21:43:54.277313 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.277266    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="068787ce-a167-481d-a73a-2b9137452276" containerName="test-curl-7980-385a96"
Sep 11 21:43:54.277368 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.277358    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="068787ce-a167-481d-a73a-2b9137452276" containerName="test-curl-7980-385a96"
Sep 11 21:43:54.282087 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.282064    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.284631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.284609    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-5b160c-serving-cert\""
Sep 11 21:43:54.291253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.291220    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"]
Sep 11 21:43:54.416076 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.416040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-maas-api-tls\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.416810 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.416788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-metrics-certs\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.416988 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.416973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c04789-ee76-420a-8586-f81ef6dc15ed-openshift-service-ca\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.417144 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.417129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bp4v\" (UniqueName: \"kubernetes.io/projected/10c04789-ee76-420a-8586-f81ef6dc15ed-kube-api-access-8bp4v\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.518184 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.518144    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-metrics-certs\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.518358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.518204    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c04789-ee76-420a-8586-f81ef6dc15ed-openshift-service-ca\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.518358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.518262    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bp4v\" (UniqueName: \"kubernetes.io/projected/10c04789-ee76-420a-8586-f81ef6dc15ed-kube-api-access-8bp4v\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.518358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.518306    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-maas-api-tls\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.518586 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:54.518565    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-serving-cert: secret "maas-api-e2e-autores-5b160c-serving-cert" not found
Sep 11 21:43:54.518650 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:54.518639    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-maas-api-tls podName:10c04789-ee76-420a-8586-f81ef6dc15ed nodeName:}" failed. No retries permitted until 2026-09-11 21:43:55.018617656 +0000 UTC m=+789.676181405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-maas-api-tls") pod "maas-api-e2e-autores-5b160c-5566f6757-wpjcs" (UID: "10c04789-ee76-420a-8586-f81ef6dc15ed") : secret "maas-api-e2e-autores-5b160c-serving-cert" not found
Sep 11 21:43:54.520222 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.520196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c04789-ee76-420a-8586-f81ef6dc15ed-openshift-service-ca\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.522071 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.522052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-metrics-certs\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:54.529570 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:54.529508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bp4v\" (UniqueName: \"kubernetes.io/projected/10c04789-ee76-420a-8586-f81ef6dc15ed-kube-api-access-8bp4v\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:55.034975 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.034940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-maas-api-tls\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:55.041755 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.041715    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-maas-api-tls\") pod \"maas-api-e2e-autores-5b160c-5566f6757-wpjcs\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:55.199424 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.199388    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:55.275954 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.275914    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"]
Sep 11 21:43:55.280832 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.280805    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.290095 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.289322    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-b2d1bd14-serving-cert\""
Sep 11 21:43:55.296244 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.296116    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"]
Sep 11 21:43:55.384256 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.384228    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:43:55.448171 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.448106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-maas-api-tls\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.448171 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.448172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-metrics-certs\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.448733 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.448220    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89g7s\" (UniqueName: \"kubernetes.io/projected/b9e018fb-6618-424c-ac04-0949e18b02ac-kube-api-access-89g7s\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.448733 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.448298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e018fb-6618-424c-ac04-0949e18b02ac-openshift-service-ca\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.525370 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.525320    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"]
Sep 11 21:43:55.549388 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.549364    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-maas-api-tls\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.549537 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.549398    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-metrics-certs\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.549537 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.549459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89g7s\" (UniqueName: \"kubernetes.io/projected/b9e018fb-6618-424c-ac04-0949e18b02ac-kube-api-access-89g7s\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.549658 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:55.549532    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-serving-cert: secret "maas-api-e2e-ait-b2d1bd14-serving-cert" not found
Sep 11 21:43:55.549658 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.549553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e018fb-6618-424c-ac04-0949e18b02ac-openshift-service-ca\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.549658 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:43:55.549586    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-maas-api-tls podName:b9e018fb-6618-424c-ac04-0949e18b02ac nodeName:}" failed. No retries permitted until 2026-09-11 21:43:56.049570454 +0000 UTC m=+790.707134195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-maas-api-tls") pod "maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c" (UID: "b9e018fb-6618-424c-ac04-0949e18b02ac") : secret "maas-api-e2e-ait-b2d1bd14-serving-cert" not found
Sep 11 21:43:55.550273 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.550254    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e018fb-6618-424c-ac04-0949e18b02ac-openshift-service-ca\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.552805 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.552785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-metrics-certs\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:55.561735 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:55.561712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89g7s\" (UniqueName: \"kubernetes.io/projected/b9e018fb-6618-424c-ac04-0949e18b02ac-kube-api-access-89g7s\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:56.055815 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:56.055784    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-maas-api-tls\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:56.058155 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:56.058124    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-maas-api-tls\") pod \"maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:56.223428 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:56.223085    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:43:56.445739 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:56.445706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs" event={"ID":"10c04789-ee76-420a-8586-f81ef6dc15ed","Type":"ContainerStarted","Data":"6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344"}
Sep 11 21:43:56.445881 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:56.445756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs" event={"ID":"10c04789-ee76-420a-8586-f81ef6dc15ed","Type":"ContainerStarted","Data":"8892d50bc68bbd110f99fad6c7ca89a9bea519fb1c3e84322a6bc143f761e966"}
Sep 11 21:43:56.446008 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:56.445990    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:43:56.465339 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:56.465295    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs" podStartSLOduration=2.062355293 podStartE2EDuration="2.465280663s" totalImagesPullingTime="402.92537ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:43:56.462295077 +0000 UTC m=+791.119858835" watchObservedRunningTime="2026-09-11 21:43:56.465280663 +0000 UTC m=+791.122844428"
Sep 11 21:43:56.519656 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:56.519623    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"]
Sep 11 21:43:57.453740 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:57.453703    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c" event={"ID":"b9e018fb-6618-424c-ac04-0949e18b02ac","Type":"ContainerStarted","Data":"766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c"}
Sep 11 21:43:57.453956 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:57.453778    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c" event={"ID":"b9e018fb-6618-424c-ac04-0949e18b02ac","Type":"ContainerStarted","Data":"c117c5186e3c9c7ac4d392b64ee83375c2e157bb8b384771b27da8071dd3a4be"}
Sep 11 21:43:57.490257 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:57.490199    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c" podStartSLOduration=1.9823233409999998 podStartE2EDuration="2.4901834s" totalImagesPullingTime="507.860059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:43:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:43:57.489508491 +0000 UTC m=+792.147072256" watchObservedRunningTime="2026-09-11 21:43:57.4901834 +0000 UTC m=+792.147747196"
Sep 11 21:43:58.460455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:43:58.460420    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:44:02.459194 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:02.459163    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:44:02.493913 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:02.493886    2577 generic.go:356] "Generic (PLEG): container finished" podID="3095797f-510f-4081-938d-eef8cec363d8" containerID="48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903" exitCode=0
Sep 11 21:44:02.494068 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:02.493923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" event={"ID":"3095797f-510f-4081-938d-eef8cec363d8","Type":"ContainerDied","Data":"48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903"}
Sep 11 21:44:02.494363 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:02.494343    2577 scope.go:117] "RemoveContainer" containerID="48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903"
Sep 11 21:44:02.495539 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:02.495512    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:44:02.495628 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:02.495574    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:44:02.495628 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:02.495607    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:44:03.502429 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:03.502397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" event={"ID":"3095797f-510f-4081-938d-eef8cec363d8","Type":"ContainerStarted","Data":"70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e"}
Sep 11 21:44:04.303234 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:04.303201    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:44:04.303682 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:04.303588    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:44:04.303923 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:04.303898    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:44:04.472033 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:04.472011    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:44:05.303109 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:05.303069    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:44:05.303753 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:05.303719    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:44:06.303189 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:06.303153    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:44:06.303811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:06.303779    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:44:07.306063 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:07.305559    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:44:07.306063 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:07.305631    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:44:08.315898 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:08.315860    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:44:08.316539 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:08.316504    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:44:09.303497 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:09.303424    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Sep 11 21:44:09.303699 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:09.303526    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Sep 11 21:44:10.308091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:10.308057    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:44:10.308554 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:10.308508    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:44:10.309329 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:10.309304    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:44:15.657347 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.657320    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"]
Sep 11 21:44:15.668063 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.668034    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.672179 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.672155    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-7e6f5e-serving-cert\""
Sep 11 21:44:15.677512 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.677422    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"]
Sep 11 21:44:15.763272 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.763242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj57r\" (UniqueName: \"kubernetes.io/projected/841a675f-50b8-42d4-a015-efd6cae16c6a-kube-api-access-qj57r\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.763455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.763306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-metrics-certs\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.763455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.763416    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a675f-50b8-42d4-a015-efd6cae16c6a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.763611 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.763502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.864294 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.864253    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj57r\" (UniqueName: \"kubernetes.io/projected/841a675f-50b8-42d4-a015-efd6cae16c6a-kube-api-access-qj57r\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.864513 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.864308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-metrics-certs\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.864513 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.864381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a675f-50b8-42d4-a015-efd6cae16c6a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.864513 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.864432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.864706 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:44:15.864618    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-serving-cert: secret "maas-api-e2e-inf-b-7e6f5e-serving-cert" not found
Sep 11 21:44:15.864706 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:44:15.864701    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls podName:841a675f-50b8-42d4-a015-efd6cae16c6a nodeName:}" failed. No retries permitted until 2026-09-11 21:44:16.364679493 +0000 UTC m=+811.022243251 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls") pod "maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l" (UID: "841a675f-50b8-42d4-a015-efd6cae16c6a") : secret "maas-api-e2e-inf-b-7e6f5e-serving-cert" not found
Sep 11 21:44:15.865152 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.865132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a675f-50b8-42d4-a015-efd6cae16c6a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.866939 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.866922    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-metrics-certs\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:15.874659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:15.874638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj57r\" (UniqueName: \"kubernetes.io/projected/841a675f-50b8-42d4-a015-efd6cae16c6a-kube-api-access-qj57r\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:16.369311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:16.369259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:16.372210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:16.372150    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls\") pod \"maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:16.583595 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:16.583563    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:16.869233 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:16.869204    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"]
Sep 11 21:44:16.870407 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:44:16.870382    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841a675f_50b8_42d4_a015_efd6cae16c6a.slice/crio-68f5da62da038b5f056ad6b6f34a8e4f38fb1c0920482fc389c476fe9be94735 WatchSource:0}: Error finding container 68f5da62da038b5f056ad6b6f34a8e4f38fb1c0920482fc389c476fe9be94735: Status 404 returned error can't find the container with id 68f5da62da038b5f056ad6b6f34a8e4f38fb1c0920482fc389c476fe9be94735
Sep 11 21:44:17.617289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:17.617195    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l" event={"ID":"841a675f-50b8-42d4-a015-efd6cae16c6a","Type":"ContainerStarted","Data":"6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b"}
Sep 11 21:44:17.617289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:17.617249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l" event={"ID":"841a675f-50b8-42d4-a015-efd6cae16c6a","Type":"ContainerStarted","Data":"68f5da62da038b5f056ad6b6f34a8e4f38fb1c0920482fc389c476fe9be94735"}
Sep 11 21:44:17.617289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:17.617272    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:17.640591 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:17.640543    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l" podStartSLOduration=2.303726618 podStartE2EDuration="2.640527701s" totalImagesPullingTime="336.801083ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:44:17.638316916 +0000 UTC m=+812.295880692" watchObservedRunningTime="2026-09-11 21:44:17.640527701 +0000 UTC m=+812.298091466"
Sep 11 21:44:22.574802 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.574770    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"]
Sep 11 21:44:22.575273 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.575033    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c" podUID="b9e018fb-6618-424c-ac04-0949e18b02ac" containerName="maas-api" containerID="cri-o://766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c" gracePeriod=30
Sep 11 21:44:22.839968 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.839900    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:44:22.937905 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.937871    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89g7s\" (UniqueName: \"kubernetes.io/projected/b9e018fb-6618-424c-ac04-0949e18b02ac-kube-api-access-89g7s\") pod \"b9e018fb-6618-424c-ac04-0949e18b02ac\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") "
Sep 11 21:44:22.938120 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.937953    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-maas-api-tls\") pod \"b9e018fb-6618-424c-ac04-0949e18b02ac\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") "
Sep 11 21:44:22.938120 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.938007    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-metrics-certs\") pod \"b9e018fb-6618-424c-ac04-0949e18b02ac\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") "
Sep 11 21:44:22.938271 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.938123    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e018fb-6618-424c-ac04-0949e18b02ac-openshift-service-ca\") pod \"b9e018fb-6618-424c-ac04-0949e18b02ac\" (UID: \"b9e018fb-6618-424c-ac04-0949e18b02ac\") "
Sep 11 21:44:22.938828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.938800    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9e018fb-6618-424c-ac04-0949e18b02ac-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b9e018fb-6618-424c-ac04-0949e18b02ac" (UID: "b9e018fb-6618-424c-ac04-0949e18b02ac"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:44:22.943913 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.943883    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b9e018fb-6618-424c-ac04-0949e18b02ac" (UID: "b9e018fb-6618-424c-ac04-0949e18b02ac"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:44:22.944033 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.943985    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "b9e018fb-6618-424c-ac04-0949e18b02ac" (UID: "b9e018fb-6618-424c-ac04-0949e18b02ac"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:44:22.944033 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:22.944006    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9e018fb-6618-424c-ac04-0949e18b02ac-kube-api-access-89g7s" (OuterVolumeSpecName: "kube-api-access-89g7s") pod "b9e018fb-6618-424c-ac04-0949e18b02ac" (UID: "b9e018fb-6618-424c-ac04-0949e18b02ac"). InnerVolumeSpecName "kube-api-access-89g7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:44:23.040028 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.040000    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b9e018fb-6618-424c-ac04-0949e18b02ac-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:23.040028 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.040024    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89g7s\" (UniqueName: \"kubernetes.io/projected/b9e018fb-6618-424c-ac04-0949e18b02ac-kube-api-access-89g7s\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:23.040219 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.040040    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:23.040219 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.040050    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b9e018fb-6618-424c-ac04-0949e18b02ac-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:23.630455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.630426    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:44:23.662626 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.662588    2577 generic.go:356] "Generic (PLEG): container finished" podID="b9e018fb-6618-424c-ac04-0949e18b02ac" containerID="766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c" exitCode=0
Sep 11 21:44:23.662828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.662632    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"
Sep 11 21:44:23.662828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.662679    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c" event={"ID":"b9e018fb-6618-424c-ac04-0949e18b02ac","Type":"ContainerDied","Data":"766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c"}
Sep 11 21:44:23.662828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.662743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c" event={"ID":"b9e018fb-6618-424c-ac04-0949e18b02ac","Type":"ContainerDied","Data":"c117c5186e3c9c7ac4d392b64ee83375c2e157bb8b384771b27da8071dd3a4be"}
Sep 11 21:44:23.662828 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.662776    2577 scope.go:117] "RemoveContainer" containerID="766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c"
Sep 11 21:44:23.673762 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.673742    2577 scope.go:117] "RemoveContainer" containerID="766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c"
Sep 11 21:44:23.674115 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:44:23.674087    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c\": container with ID starting with 766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c not found: ID does not exist" containerID="766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c"
Sep 11 21:44:23.674221 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.674114    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c"} err="failed to get container status \"766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c\": rpc error: code = NotFound desc = could not find container \"766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c\": container with ID starting with 766fc8d79bb6a752f0cfcc4f6de83c6d91003cd0fa2cbf59654992e05ac6487c not found: ID does not exist"
Sep 11 21:44:23.701841 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.701804    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"]
Sep 11 21:44:23.710890 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.710863    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-b2d1bd14-67cffb9c95-5wp2c"]
Sep 11 21:44:23.762901 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:23.762866    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9e018fb-6618-424c-ac04-0949e18b02ac" path="/var/lib/kubelet/pods/b9e018fb-6618-424c-ac04-0949e18b02ac/volumes"
Sep 11 21:44:28.672018 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.671982    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"]
Sep 11 21:44:28.672804 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.672776    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9e018fb-6618-424c-ac04-0949e18b02ac" containerName="maas-api"
Sep 11 21:44:28.672804 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.672804    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9e018fb-6618-424c-ac04-0949e18b02ac" containerName="maas-api"
Sep 11 21:44:28.673027 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.672940    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9e018fb-6618-424c-ac04-0949e18b02ac" containerName="maas-api"
Sep 11 21:44:28.678271 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.678249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.681853 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.681830    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-762b41ed-serving-cert\""
Sep 11 21:44:28.693371 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.693348    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"]
Sep 11 21:44:28.800029 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.799992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l9lq\" (UniqueName: \"kubernetes.io/projected/27bb6f85-bab3-4dae-990b-461461bd36e1-kube-api-access-5l9lq\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.800029 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.800033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-maas-api-tls\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.800235 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.800058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bb6f85-bab3-4dae-990b-461461bd36e1-openshift-service-ca\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.800235 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.800088    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-metrics-certs\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.901227 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.901190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l9lq\" (UniqueName: \"kubernetes.io/projected/27bb6f85-bab3-4dae-990b-461461bd36e1-kube-api-access-5l9lq\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.901227 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.901232    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-maas-api-tls\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.901465 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.901258    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bb6f85-bab3-4dae-990b-461461bd36e1-openshift-service-ca\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.901465 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.901283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-metrics-certs\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.901465 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:44:28.901339    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-serving-cert: secret "maas-api-e2e-migrate-762b41ed-serving-cert" not found
Sep 11 21:44:28.901465 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:44:28.901398    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-maas-api-tls podName:27bb6f85-bab3-4dae-990b-461461bd36e1 nodeName:}" failed. No retries permitted until 2026-09-11 21:44:29.401383709 +0000 UTC m=+824.058947450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-maas-api-tls") pod "maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh" (UID: "27bb6f85-bab3-4dae-990b-461461bd36e1") : secret "maas-api-e2e-migrate-762b41ed-serving-cert" not found
Sep 11 21:44:28.901964 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.901945    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bb6f85-bab3-4dae-990b-461461bd36e1-openshift-service-ca\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.904403 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.904377    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-metrics-certs\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:28.911459 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:28.911428    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l9lq\" (UniqueName: \"kubernetes.io/projected/27bb6f85-bab3-4dae-990b-461461bd36e1-kube-api-access-5l9lq\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:29.408534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.408461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-maas-api-tls\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:29.411039 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.411005    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-maas-api-tls\") pod \"maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:29.590317 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.590285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:29.613105 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.613075    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"]
Sep 11 21:44:29.623616 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.619178    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:29.625654 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.625622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"]
Sep 11 21:44:29.626042 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.626022    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-762b41ed-dockercfg-snpgt\""
Sep 11 21:44:29.626332 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.626313    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-762b41ed\""
Sep 11 21:44:29.712073 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.712038    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrrg\" (UniqueName: \"kubernetes.io/projected/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-kube-api-access-bjrrg\") pod \"payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t\" (UID: \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:29.712597 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.712257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t\" (UID: \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:29.813525 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.813449    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t\" (UID: \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:29.813702 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.813577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrrg\" (UniqueName: \"kubernetes.io/projected/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-kube-api-access-bjrrg\") pod \"payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t\" (UID: \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:29.814241 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.814223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t\" (UID: \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:29.822253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.822229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrrg\" (UniqueName: \"kubernetes.io/projected/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-kube-api-access-bjrrg\") pod \"payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t\" (UID: \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:29.887804 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.887774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"]
Sep 11 21:44:29.888548 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:44:29.888519    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27bb6f85_bab3_4dae_990b_461461bd36e1.slice/crio-0c5ee0f2b756c6f2a52381e681ea22d1d185324539542f5875b8482dcf78b2f1 WatchSource:0}: Error finding container 0c5ee0f2b756c6f2a52381e681ea22d1d185324539542f5875b8482dcf78b2f1: Status 404 returned error can't find the container with id 0c5ee0f2b756c6f2a52381e681ea22d1d185324539542f5875b8482dcf78b2f1
Sep 11 21:44:29.940223 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:29.940201    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:30.214460 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:44:30.214423    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c2b711_1d18_4dd3_85b6_13ae2189d4d8.slice/crio-d6cdad905e9160863356804ef59ab06d94fd0ee55a4066efbc27d3fdbd2d3a53 WatchSource:0}: Error finding container d6cdad905e9160863356804ef59ab06d94fd0ee55a4066efbc27d3fdbd2d3a53: Status 404 returned error can't find the container with id d6cdad905e9160863356804ef59ab06d94fd0ee55a4066efbc27d3fdbd2d3a53
Sep 11 21:44:30.216013 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:30.215986    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"]
Sep 11 21:44:30.716809 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:30.716777    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t" event={"ID":"90c2b711-1d18-4dd3-85b6-13ae2189d4d8","Type":"ContainerStarted","Data":"01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3"}
Sep 11 21:44:30.717292 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:30.716838    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t" event={"ID":"90c2b711-1d18-4dd3-85b6-13ae2189d4d8","Type":"ContainerStarted","Data":"d6cdad905e9160863356804ef59ab06d94fd0ee55a4066efbc27d3fdbd2d3a53"}
Sep 11 21:44:30.717292 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:30.716881    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:30.718662 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:30.718640    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh" event={"ID":"27bb6f85-bab3-4dae-990b-461461bd36e1","Type":"ContainerStarted","Data":"961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36"}
Sep 11 21:44:30.718759 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:30.718685    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:30.718759 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:30.718702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh" event={"ID":"27bb6f85-bab3-4dae-990b-461461bd36e1","Type":"ContainerStarted","Data":"0c5ee0f2b756c6f2a52381e681ea22d1d185324539542f5875b8482dcf78b2f1"}
Sep 11 21:44:30.733916 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:30.733873    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t" podStartSLOduration=1.73385998 podStartE2EDuration="1.73385998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:44:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:44:30.732871515 +0000 UTC m=+825.390435280" watchObservedRunningTime="2026-09-11 21:44:30.73385998 +0000 UTC m=+825.391423744"
Sep 11 21:44:30.753229 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:30.753170    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh" podStartSLOduration=2.379361777 podStartE2EDuration="2.753152061s" totalImagesPullingTime="373.790284ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:44:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:44:30.751827619 +0000 UTC m=+825.409391386" watchObservedRunningTime="2026-09-11 21:44:30.753152061 +0000 UTC m=+825.410715825"
Sep 11 21:44:36.731983 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:36.731953    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:41.728306 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:41.728276    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:58.376067 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.376035    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"]
Sep 11 21:44:58.376505 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.376250    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh" podUID="27bb6f85-bab3-4dae-990b-461461bd36e1" containerName="maas-api" containerID="cri-o://961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36" gracePeriod=30
Sep 11 21:44:58.442457 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.442423    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"]
Sep 11 21:44:58.442758 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.442701    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t" podUID="90c2b711-1d18-4dd3-85b6-13ae2189d4d8" containerName="payload-processing" containerID="cri-o://01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3" gracePeriod=30
Sep 11 21:44:58.697013 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.696988    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:58.754131 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.754089    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:58.778246 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.777937    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-maas-api-tls\") pod \"27bb6f85-bab3-4dae-990b-461461bd36e1\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") "
Sep 11 21:44:58.778540 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.778488    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bb6f85-bab3-4dae-990b-461461bd36e1-openshift-service-ca\") pod \"27bb6f85-bab3-4dae-990b-461461bd36e1\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") "
Sep 11 21:44:58.778805 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.778580    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5l9lq\" (UniqueName: \"kubernetes.io/projected/27bb6f85-bab3-4dae-990b-461461bd36e1-kube-api-access-5l9lq\") pod \"27bb6f85-bab3-4dae-990b-461461bd36e1\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") "
Sep 11 21:44:58.778805 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.778711    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-metrics-certs\") pod \"27bb6f85-bab3-4dae-990b-461461bd36e1\" (UID: \"27bb6f85-bab3-4dae-990b-461461bd36e1\") "
Sep 11 21:44:58.779506 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.779260    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27bb6f85-bab3-4dae-990b-461461bd36e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "27bb6f85-bab3-4dae-990b-461461bd36e1" (UID: "27bb6f85-bab3-4dae-990b-461461bd36e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:44:58.785197 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.784951    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "27bb6f85-bab3-4dae-990b-461461bd36e1" (UID: "27bb6f85-bab3-4dae-990b-461461bd36e1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:44:58.785343 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.785280    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27bb6f85-bab3-4dae-990b-461461bd36e1-kube-api-access-5l9lq" (OuterVolumeSpecName: "kube-api-access-5l9lq") pod "27bb6f85-bab3-4dae-990b-461461bd36e1" (UID: "27bb6f85-bab3-4dae-990b-461461bd36e1"). InnerVolumeSpecName "kube-api-access-5l9lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:44:58.786609 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.786558    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "27bb6f85-bab3-4dae-990b-461461bd36e1" (UID: "27bb6f85-bab3-4dae-990b-461461bd36e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:44:58.880155 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.880118    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-plugins-config-volume\") pod \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\" (UID: \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\") "
Sep 11 21:44:58.880327 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.880260    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjrrg\" (UniqueName: \"kubernetes.io/projected/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-kube-api-access-bjrrg\") pod \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\" (UID: \"90c2b711-1d18-4dd3-85b6-13ae2189d4d8\") "
Sep 11 21:44:58.880555 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.880522    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/27bb6f85-bab3-4dae-990b-461461bd36e1-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:58.880555 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.880547    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5l9lq\" (UniqueName: \"kubernetes.io/projected/27bb6f85-bab3-4dae-990b-461461bd36e1-kube-api-access-5l9lq\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:58.880555 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.880562    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:58.880766 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.880574    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/27bb6f85-bab3-4dae-990b-461461bd36e1-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:58.880766 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.880603    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90c2b711-1d18-4dd3-85b6-13ae2189d4d8" (UID: "90c2b711-1d18-4dd3-85b6-13ae2189d4d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:44:58.882497 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.882459    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-kube-api-access-bjrrg" (OuterVolumeSpecName: "kube-api-access-bjrrg") pod "90c2b711-1d18-4dd3-85b6-13ae2189d4d8" (UID: "90c2b711-1d18-4dd3-85b6-13ae2189d4d8"). InnerVolumeSpecName "kube-api-access-bjrrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:44:58.900877 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.900831    2577 generic.go:356] "Generic (PLEG): container finished" podID="90c2b711-1d18-4dd3-85b6-13ae2189d4d8" containerID="01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3" exitCode=0
Sep 11 21:44:58.901064 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.900890    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"
Sep 11 21:44:58.901064 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.900924    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t" event={"ID":"90c2b711-1d18-4dd3-85b6-13ae2189d4d8","Type":"ContainerDied","Data":"01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3"}
Sep 11 21:44:58.901064 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.901007    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t" event={"ID":"90c2b711-1d18-4dd3-85b6-13ae2189d4d8","Type":"ContainerDied","Data":"d6cdad905e9160863356804ef59ab06d94fd0ee55a4066efbc27d3fdbd2d3a53"}
Sep 11 21:44:58.901064 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.901038    2577 scope.go:117] "RemoveContainer" containerID="01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3"
Sep 11 21:44:58.903248 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.903043    2577 generic.go:356] "Generic (PLEG): container finished" podID="27bb6f85-bab3-4dae-990b-461461bd36e1" containerID="961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36" exitCode=0
Sep 11 21:44:58.903248 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.903125    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh" event={"ID":"27bb6f85-bab3-4dae-990b-461461bd36e1","Type":"ContainerDied","Data":"961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36"}
Sep 11 21:44:58.903248 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.903185    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh" event={"ID":"27bb6f85-bab3-4dae-990b-461461bd36e1","Type":"ContainerDied","Data":"0c5ee0f2b756c6f2a52381e681ea22d1d185324539542f5875b8482dcf78b2f1"}
Sep 11 21:44:58.903416 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.903257    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"
Sep 11 21:44:58.916347 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.916228    2577 scope.go:117] "RemoveContainer" containerID="01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3"
Sep 11 21:44:58.916808 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:44:58.916661    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3\": container with ID starting with 01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3 not found: ID does not exist" containerID="01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3"
Sep 11 21:44:58.916808 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.916700    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3"} err="failed to get container status \"01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3\": rpc error: code = NotFound desc = could not find container \"01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3\": container with ID starting with 01ae5123e086179f4ab79ffa54c09f0f4d869012e72ae1bdc2acb11a0f8feec3 not found: ID does not exist"
Sep 11 21:44:58.916808 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.916723    2577 scope.go:117] "RemoveContainer" containerID="961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36"
Sep 11 21:44:58.928923 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.928900    2577 scope.go:117] "RemoveContainer" containerID="961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36"
Sep 11 21:44:58.929821 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:44:58.929789    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36\": container with ID starting with 961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36 not found: ID does not exist" containerID="961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36"
Sep 11 21:44:58.929928 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.929822    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36"} err="failed to get container status \"961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36\": rpc error: code = NotFound desc = could not find container \"961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36\": container with ID starting with 961a4b8f9fda25a72f08b294b8b8c04180644236350bd36ebd87f0f0f42f8f36 not found: ID does not exist"
Sep 11 21:44:58.932658 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.932638    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"]
Sep 11 21:44:58.936574 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.936554    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-762b41ed-6559fdc98b-k8m6t"]
Sep 11 21:44:58.948864 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.948839    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"]
Sep 11 21:44:58.954858 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.954834    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-762b41ed-6c974cbbcc-tnmlh"]
Sep 11 21:44:58.981799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.981777    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjrrg\" (UniqueName: \"kubernetes.io/projected/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-kube-api-access-bjrrg\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:58.981799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:58.981800    2577 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90c2b711-1d18-4dd3-85b6-13ae2189d4d8-plugins-config-volume\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:44:59.761655 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:59.761624    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27bb6f85-bab3-4dae-990b-461461bd36e1" path="/var/lib/kubelet/pods/27bb6f85-bab3-4dae-990b-461461bd36e1/volumes"
Sep 11 21:44:59.762098 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:44:59.762065    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c2b711-1d18-4dd3-85b6-13ae2189d4d8" path="/var/lib/kubelet/pods/90c2b711-1d18-4dd3-85b6-13ae2189d4d8/volumes"
Sep 11 21:45:03.980987 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.980953    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"]
Sep 11 21:45:03.981690 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.981673    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27bb6f85-bab3-4dae-990b-461461bd36e1" containerName="maas-api"
Sep 11 21:45:03.981745 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.981694    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27bb6f85-bab3-4dae-990b-461461bd36e1" containerName="maas-api"
Sep 11 21:45:03.981745 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.981714    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c2b711-1d18-4dd3-85b6-13ae2189d4d8" containerName="payload-processing"
Sep 11 21:45:03.981745 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.981722    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c2b711-1d18-4dd3-85b6-13ae2189d4d8" containerName="payload-processing"
Sep 11 21:45:03.981844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.981827    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c2b711-1d18-4dd3-85b6-13ae2189d4d8" containerName="payload-processing"
Sep 11 21:45:03.981844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.981838    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27bb6f85-bab3-4dae-990b-461461bd36e1" containerName="maas-api"
Sep 11 21:45:03.987109 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.987090    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:03.989886 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.989856    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-dad794b4-serving-cert\""
Sep 11 21:45:03.994934 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:03.994915    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"]
Sep 11 21:45:04.037147 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.037121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-metrics-certs\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.037321 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.037151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-maas-api-tls\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.037321 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.037192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdkq4\" (UniqueName: \"kubernetes.io/projected/19fee533-fb1f-4e30-b194-00a18d24948a-kube-api-access-rdkq4\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.037321 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.037299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fee533-fb1f-4e30-b194-00a18d24948a-openshift-service-ca\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.138582 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.138549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fee533-fb1f-4e30-b194-00a18d24948a-openshift-service-ca\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.138765 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.138644    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-metrics-certs\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.138765 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.138668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-maas-api-tls\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.138765 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.138709    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdkq4\" (UniqueName: \"kubernetes.io/projected/19fee533-fb1f-4e30-b194-00a18d24948a-kube-api-access-rdkq4\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.138947 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:45:04.138825    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-serving-cert: secret "maas-api-e2e-ait-dad794b4-serving-cert" not found
Sep 11 21:45:04.138947 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:45:04.138905    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-maas-api-tls podName:19fee533-fb1f-4e30-b194-00a18d24948a nodeName:}" failed. No retries permitted until 2026-09-11 21:45:04.638887682 +0000 UTC m=+859.296451428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-maas-api-tls") pod "maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv" (UID: "19fee533-fb1f-4e30-b194-00a18d24948a") : secret "maas-api-e2e-ait-dad794b4-serving-cert" not found
Sep 11 21:45:04.139213 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.139192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fee533-fb1f-4e30-b194-00a18d24948a-openshift-service-ca\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.141366 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.141335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-metrics-certs\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.147209 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.147191    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdkq4\" (UniqueName: \"kubernetes.io/projected/19fee533-fb1f-4e30-b194-00a18d24948a-kube-api-access-rdkq4\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.645048 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.645016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-maas-api-tls\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.647929 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.647891    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-maas-api-tls\") pod \"maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:04.902068 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:04.901981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:05.189722 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:05.189687    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"]
Sep 11 21:45:05.190983 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:45:05.190957    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19fee533_fb1f_4e30_b194_00a18d24948a.slice/crio-80833fc8418174790a49b4f27f91ceafbba72c5db16818d1c0aa6a524ec0d390 WatchSource:0}: Error finding container 80833fc8418174790a49b4f27f91ceafbba72c5db16818d1c0aa6a524ec0d390: Status 404 returned error can't find the container with id 80833fc8418174790a49b4f27f91ceafbba72c5db16818d1c0aa6a524ec0d390
Sep 11 21:45:05.955596 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:05.955560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv" event={"ID":"19fee533-fb1f-4e30-b194-00a18d24948a","Type":"ContainerStarted","Data":"0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1"}
Sep 11 21:45:05.955788 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:05.955613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv" event={"ID":"19fee533-fb1f-4e30-b194-00a18d24948a","Type":"ContainerStarted","Data":"80833fc8418174790a49b4f27f91ceafbba72c5db16818d1c0aa6a524ec0d390"}
Sep 11 21:45:05.955788 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:05.955736    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:05.974735 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:05.974693    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv" podStartSLOduration=2.590426447 podStartE2EDuration="2.974677655s" totalImagesPullingTime="384.251208ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:45:05.972281976 +0000 UTC m=+860.629845762" watchObservedRunningTime="2026-09-11 21:45:05.974677655 +0000 UTC m=+860.632241418"
Sep 11 21:45:11.966978 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:11.966950    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:34.776391 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:34.776352    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"]
Sep 11 21:45:34.777015 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:34.776627    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv" podUID="19fee533-fb1f-4e30-b194-00a18d24948a" containerName="maas-api" containerID="cri-o://0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1" gracePeriod=30
Sep 11 21:45:35.045693 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.045624    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:35.147114 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.147075    2577 generic.go:356] "Generic (PLEG): container finished" podID="19fee533-fb1f-4e30-b194-00a18d24948a" containerID="0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1" exitCode=0
Sep 11 21:45:35.147311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.147137    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"
Sep 11 21:45:35.147311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.147285    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv" event={"ID":"19fee533-fb1f-4e30-b194-00a18d24948a","Type":"ContainerDied","Data":"0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1"}
Sep 11 21:45:35.147524 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.147357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv" event={"ID":"19fee533-fb1f-4e30-b194-00a18d24948a","Type":"ContainerDied","Data":"80833fc8418174790a49b4f27f91ceafbba72c5db16818d1c0aa6a524ec0d390"}
Sep 11 21:45:35.147524 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.147385    2577 scope.go:117] "RemoveContainer" containerID="0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1"
Sep 11 21:45:35.156060 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.156033    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdkq4\" (UniqueName: \"kubernetes.io/projected/19fee533-fb1f-4e30-b194-00a18d24948a-kube-api-access-rdkq4\") pod \"19fee533-fb1f-4e30-b194-00a18d24948a\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") "
Sep 11 21:45:35.156163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.156079    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fee533-fb1f-4e30-b194-00a18d24948a-openshift-service-ca\") pod \"19fee533-fb1f-4e30-b194-00a18d24948a\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") "
Sep 11 21:45:35.156242 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.156226    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-maas-api-tls\") pod \"19fee533-fb1f-4e30-b194-00a18d24948a\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") "
Sep 11 21:45:35.156571 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.156538    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19fee533-fb1f-4e30-b194-00a18d24948a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "19fee533-fb1f-4e30-b194-00a18d24948a" (UID: "19fee533-fb1f-4e30-b194-00a18d24948a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:45:35.156693 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.156259    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-metrics-certs\") pod \"19fee533-fb1f-4e30-b194-00a18d24948a\" (UID: \"19fee533-fb1f-4e30-b194-00a18d24948a\") "
Sep 11 21:45:35.157592 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.157043    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19fee533-fb1f-4e30-b194-00a18d24948a-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:45:35.158644 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.158615    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "19fee533-fb1f-4e30-b194-00a18d24948a" (UID: "19fee533-fb1f-4e30-b194-00a18d24948a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:45:35.158974 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.158954    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "19fee533-fb1f-4e30-b194-00a18d24948a" (UID: "19fee533-fb1f-4e30-b194-00a18d24948a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:45:35.159346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.159327    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19fee533-fb1f-4e30-b194-00a18d24948a-kube-api-access-rdkq4" (OuterVolumeSpecName: "kube-api-access-rdkq4") pod "19fee533-fb1f-4e30-b194-00a18d24948a" (UID: "19fee533-fb1f-4e30-b194-00a18d24948a"). InnerVolumeSpecName "kube-api-access-rdkq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:45:35.160235 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.160218    2577 scope.go:117] "RemoveContainer" containerID="0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1"
Sep 11 21:45:35.160669 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:45:35.160644    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1\": container with ID starting with 0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1 not found: ID does not exist" containerID="0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1"
Sep 11 21:45:35.160745 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.160680    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1"} err="failed to get container status \"0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1\": rpc error: code = NotFound desc = could not find container \"0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1\": container with ID starting with 0955b08f163a25b970cf0e796387756252e370be4d143d88010d045ddfb876d1 not found: ID does not exist"
Sep 11 21:45:35.257661 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.257628    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdkq4\" (UniqueName: \"kubernetes.io/projected/19fee533-fb1f-4e30-b194-00a18d24948a-kube-api-access-rdkq4\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:45:35.257661 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.257655    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:45:35.257661 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.257665    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/19fee533-fb1f-4e30-b194-00a18d24948a-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:45:35.470314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.470281    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"]
Sep 11 21:45:35.477116 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.477095    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dad794b4-ffb5f4548-6stmv"]
Sep 11 21:45:35.762848 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:35.762768    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19fee533-fb1f-4e30-b194-00a18d24948a" path="/var/lib/kubelet/pods/19fee533-fb1f-4e30-b194-00a18d24948a/volumes"
Sep 11 21:45:36.895855 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.895825    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"]
Sep 11 21:45:36.896395 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.896380    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19fee533-fb1f-4e30-b194-00a18d24948a" containerName="maas-api"
Sep 11 21:45:36.896449 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.896397    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="19fee533-fb1f-4e30-b194-00a18d24948a" containerName="maas-api"
Sep 11 21:45:36.896503 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.896492    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="19fee533-fb1f-4e30-b194-00a18d24948a" containerName="maas-api"
Sep 11 21:45:36.901355 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.901332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:36.904273 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.904252    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-7a9aa317-openshift-default-dockercfg-tvg2w\""
Sep 11 21:45:36.917334 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.917311    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"]
Sep 11 21:45:36.975354 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.975324    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-data\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:36.975531 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.975364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqrw4\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-kube-api-access-lqrw4\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:36.975531 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.975402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-socket\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:36.975531 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.975450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-podinfo\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:36.975531 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.975494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istiod-ca-cert\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:36.975766 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.975554    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-certs\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:36.975766 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.975645    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-envoy\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:36.975766 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.975695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-token\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:36.975766 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:36.975742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-credential-socket\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.077326 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.077291    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-podinfo\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.077326 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.077331    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istiod-ca-cert\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.077643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.077353    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-certs\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.077643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.077396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-envoy\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.077643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.077422    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-token\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.077643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.077450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-credential-socket\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.077643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.077509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-data\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.077643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.077552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqrw4\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-kube-api-access-lqrw4\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.077643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.077613    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-socket\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.078086 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.078059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-data\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.078166 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.078115    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-certs\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.078166 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.078152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-credential-socket\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.078442 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.078157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istiod-ca-cert\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.078442 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.078208    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-socket\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.080118 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.080097    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-podinfo\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.080789 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.080766    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-envoy\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.087725 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.087695    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqrw4\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-kube-api-access-lqrw4\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.088667 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.088648    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-token\") pod \"e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") " pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.212498 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.212457    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:37.558735 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.558708    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"]
Sep 11 21:45:37.559449 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:45:37.559418    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da4c8ed_0a1a_45c6_ac99_c7dd54893ded.slice/crio-764e76e3584c3bbe8948886ffad0eeb73a1fb679f30dad40084c64b4172888de WatchSource:0}: Error finding container 764e76e3584c3bbe8948886ffad0eeb73a1fb679f30dad40084c64b4172888de: Status 404 returned error can't find the container with id 764e76e3584c3bbe8948886ffad0eeb73a1fb679f30dad40084c64b4172888de
Sep 11 21:45:37.561862 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.561829    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:45:37.561944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.561895    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:45:37.561944 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:37.561923    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:45:38.176646 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:38.176608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" event={"ID":"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded","Type":"ContainerStarted","Data":"b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee"}
Sep 11 21:45:38.177149 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:38.176699    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" event={"ID":"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded","Type":"ContainerStarted","Data":"764e76e3584c3bbe8948886ffad0eeb73a1fb679f30dad40084c64b4172888de"}
Sep 11 21:45:38.197523 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:38.197457    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" podStartSLOduration=2.197442878 podStartE2EDuration="2.197442878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:45:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:45:38.196005489 +0000 UTC m=+892.853569252" watchObservedRunningTime="2026-09-11 21:45:38.197442878 +0000 UTC m=+892.855006642"
Sep 11 21:45:38.213564 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:38.213538    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:38.215035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:38.215017    2577 patch_prober.go:28] interesting pod/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:45:38.215095 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:38.215058    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:45:39.218165 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:39.218139    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:40.189854 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:40.189818    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:40.190779 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:40.190756    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:45:45.811067 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:45.811033    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:45:45.815092 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:45:45.815071    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:46:03.346945 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:03.346896    2577 generic.go:356] "Generic (PLEG): container finished" podID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerID="b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee" exitCode=0
Sep 11 21:46:03.347537 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:03.346943    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" event={"ID":"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded","Type":"ContainerDied","Data":"b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee"}
Sep 11 21:46:03.347537 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:03.347383    2577 scope.go:117] "RemoveContainer" containerID="b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee"
Sep 11 21:46:03.348659 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:03.348629    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:46:03.348769 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:03.348703    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:46:03.348769 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:03.348738    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:46:03.380194 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:46:03.380162    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da4c8ed_0a1a_45c6_ac99_c7dd54893ded.slice/crio-conmon-9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 21:46:03.380342 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:46:03.380261    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da4c8ed_0a1a_45c6_ac99_c7dd54893ded.slice/crio-conmon-9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 21:46:04.355045 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:04.355011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" event={"ID":"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded","Type":"ContainerStarted","Data":"9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0"}
Sep 11 21:46:05.213675 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:05.213643    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:46:05.214036 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:05.213948    2577 patch_prober.go:28] interesting pod/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:46:05.214214 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:05.214192    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:46:06.213344 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:06.213303    2577 patch_prober.go:28] interesting pod/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:46:06.214155 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:06.214118    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:46:07.213695 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:07.213652    2577 patch_prober.go:28] interesting pod/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:46:07.214176 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:07.213719    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:46:08.213411 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:08.213366    2577 patch_prober.go:28] interesting pod/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:46:08.213639 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:08.213433    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:46:09.213130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.213094    2577 patch_prober.go:28] interesting pod/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused" start-of-body=
Sep 11 21:46:09.214331 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.214295    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.74:15021/healthz/ready\": dial tcp 10.134.0.74:15021: connect: connection refused"
Sep 11 21:46:09.859576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.859542    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"]
Sep 11 21:46:09.862564 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.862540    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:09.865374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.865353    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e919c5\"/\"kube-root-ca.crt\""
Sep 11 21:46:09.866601 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.866582    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e919c5\"/\"default-dockercfg-mklps\""
Sep 11 21:46:09.866710 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.866579    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e919c5\"/\"test-model-e919c5-kserve-self-signed-certs\""
Sep 11 21:46:09.866710 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.866588    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e919c5\"/\"openshift-service-ca.crt\""
Sep 11 21:46:09.874906 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.874881    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"]
Sep 11 21:46:09.922283 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.922251    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-dshm\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:09.922432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.922299    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zhxk\" (UniqueName: \"kubernetes.io/projected/7bbc6800-190b-410e-849a-ce665e6bf87d-kube-api-access-9zhxk\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:09.922432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.922323    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-home\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:09.922432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.922397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-model-cache\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:09.922624 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.922489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bbc6800-190b-410e-849a-ce665e6bf87d-tls-certs\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:09.922624 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:09.922561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-tmp-dir\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.023816 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.023783    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-tmp-dir\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.023990 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.023839    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-dshm\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.023990 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.023876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zhxk\" (UniqueName: \"kubernetes.io/projected/7bbc6800-190b-410e-849a-ce665e6bf87d-kube-api-access-9zhxk\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.023990 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.023900    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-home\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.023990 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.023936    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-model-cache\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.024202 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.024004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bbc6800-190b-410e-849a-ce665e6bf87d-tls-certs\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.024301 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.024269    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-tmp-dir\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.024301 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.024292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-home\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.024564 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.024541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-model-cache\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.026445 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.026422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-dshm\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.026574 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.026558    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bbc6800-190b-410e-849a-ce665e6bf87d-tls-certs\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.031956 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.031936    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zhxk\" (UniqueName: \"kubernetes.io/projected/7bbc6800-190b-410e-849a-ce665e6bf87d-kube-api-access-9zhxk\") pod \"test-model-e919c5-kserve-67b9b7585c-xx92v\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") " pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.175977 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.175945    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:10.190331 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.190307    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:46:10.218436 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.218404    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:46:10.393028 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.393004    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:46:10.453926 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:10.453890    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"]
Sep 11 21:46:10.454757 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:46:10.454728    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bbc6800_190b_410e_849a_ce665e6bf87d.slice/crio-7fcfa179d6d202973b848ccde2c356dffc6b32a1c561e2e47371f20c9823f4ba WatchSource:0}: Error finding container 7fcfa179d6d202973b848ccde2c356dffc6b32a1c561e2e47371f20c9823f4ba: Status 404 returned error can't find the container with id 7fcfa179d6d202973b848ccde2c356dffc6b32a1c561e2e47371f20c9823f4ba
Sep 11 21:46:11.400332 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:11.400292    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v" event={"ID":"7bbc6800-190b-410e-849a-ce665e6bf87d","Type":"ContainerStarted","Data":"1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90"}
Sep 11 21:46:11.400756 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:11.400340    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v" event={"ID":"7bbc6800-190b-410e-849a-ce665e6bf87d","Type":"ContainerStarted","Data":"7fcfa179d6d202973b848ccde2c356dffc6b32a1c561e2e47371f20c9823f4ba"}
Sep 11 21:46:11.416943 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:11.416897    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v" podStartSLOduration=2.416883059 podStartE2EDuration="2.416883059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:46:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:46:11.416080737 +0000 UTC m=+926.073644504" watchObservedRunningTime="2026-09-11 21:46:11.416883059 +0000 UTC m=+926.074446822"
Sep 11 21:46:11.734059 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:11.734028    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"]
Sep 11 21:46:11.734286 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:11.734261    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs" podUID="10c04789-ee76-420a-8586-f81ef6dc15ed" containerName="maas-api" containerID="cri-o://6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344" gracePeriod=30
Sep 11 21:46:12.016042 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.016010    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:46:12.146930 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.146894    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bp4v\" (UniqueName: \"kubernetes.io/projected/10c04789-ee76-420a-8586-f81ef6dc15ed-kube-api-access-8bp4v\") pod \"10c04789-ee76-420a-8586-f81ef6dc15ed\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") "
Sep 11 21:46:12.147097 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.146944    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-metrics-certs\") pod \"10c04789-ee76-420a-8586-f81ef6dc15ed\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") "
Sep 11 21:46:12.147097 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.146977    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-maas-api-tls\") pod \"10c04789-ee76-420a-8586-f81ef6dc15ed\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") "
Sep 11 21:46:12.147097 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.147008    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c04789-ee76-420a-8586-f81ef6dc15ed-openshift-service-ca\") pod \"10c04789-ee76-420a-8586-f81ef6dc15ed\" (UID: \"10c04789-ee76-420a-8586-f81ef6dc15ed\") "
Sep 11 21:46:12.147441 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.147418    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10c04789-ee76-420a-8586-f81ef6dc15ed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "10c04789-ee76-420a-8586-f81ef6dc15ed" (UID: "10c04789-ee76-420a-8586-f81ef6dc15ed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:46:12.149368 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.149339    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10c04789-ee76-420a-8586-f81ef6dc15ed-kube-api-access-8bp4v" (OuterVolumeSpecName: "kube-api-access-8bp4v") pod "10c04789-ee76-420a-8586-f81ef6dc15ed" (UID: "10c04789-ee76-420a-8586-f81ef6dc15ed"). InnerVolumeSpecName "kube-api-access-8bp4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:46:12.149627 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.149604    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "10c04789-ee76-420a-8586-f81ef6dc15ed" (UID: "10c04789-ee76-420a-8586-f81ef6dc15ed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:46:12.149717 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.149677    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "10c04789-ee76-420a-8586-f81ef6dc15ed" (UID: "10c04789-ee76-420a-8586-f81ef6dc15ed"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:46:12.248047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.247974    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/10c04789-ee76-420a-8586-f81ef6dc15ed-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:12.248047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.248001    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bp4v\" (UniqueName: \"kubernetes.io/projected/10c04789-ee76-420a-8586-f81ef6dc15ed-kube-api-access-8bp4v\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:12.248047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.248010    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:12.248047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.248018    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/10c04789-ee76-420a-8586-f81ef6dc15ed-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:12.410097 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.410063    2577 generic.go:356] "Generic (PLEG): container finished" podID="10c04789-ee76-420a-8586-f81ef6dc15ed" containerID="6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344" exitCode=0
Sep 11 21:46:12.410552 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.410117    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"
Sep 11 21:46:12.410552 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.410144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs" event={"ID":"10c04789-ee76-420a-8586-f81ef6dc15ed","Type":"ContainerDied","Data":"6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344"}
Sep 11 21:46:12.410552 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.410202    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs" event={"ID":"10c04789-ee76-420a-8586-f81ef6dc15ed","Type":"ContainerDied","Data":"8892d50bc68bbd110f99fad6c7ca89a9bea519fb1c3e84322a6bc143f761e966"}
Sep 11 21:46:12.410552 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.410231    2577 scope.go:117] "RemoveContainer" containerID="6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344"
Sep 11 21:46:12.421243 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.421225    2577 scope.go:117] "RemoveContainer" containerID="6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344"
Sep 11 21:46:12.421545 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:46:12.421526    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344\": container with ID starting with 6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344 not found: ID does not exist" containerID="6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344"
Sep 11 21:46:12.421633 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.421552    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344"} err="failed to get container status \"6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344\": rpc error: code = NotFound desc = could not find container \"6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344\": container with ID starting with 6e821fa68a911dd2a21bcbd76ea5aed4a25e2f262b4df05cfbf865a936443344 not found: ID does not exist"
Sep 11 21:46:12.436139 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.436112    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"]
Sep 11 21:46:12.440392 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:12.440369    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-5b160c-5566f6757-wpjcs"]
Sep 11 21:46:13.761638 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:13.761611    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10c04789-ee76-420a-8586-f81ef6dc15ed" path="/var/lib/kubelet/pods/10c04789-ee76-420a-8586-f81ef6dc15ed/volumes"
Sep 11 21:46:20.176780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:20.176747    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:20.177187 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:20.176797    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:20.189081 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:20.189060    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:20.474654 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:20.474569    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:46:21.665663 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:21.665628    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"]
Sep 11 21:46:21.666303 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:21.665950    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy" containerID="cri-o://9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0" gracePeriod=30
Sep 11 21:46:25.394446 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:25.394409    2577 patch_prober.go:28] interesting pod/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 21:46:25.394979 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:25.394488    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:46:26.929348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:26.929282    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:46:27.104788 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.104757    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-podinfo\") pod \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") "
Sep 11 21:46:27.104995 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.104867    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-data\") pod \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") "
Sep 11 21:46:27.104995 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.104976    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istiod-ca-cert\") pod \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") "
Sep 11 21:46:27.105124 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-envoy\") pod \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") "
Sep 11 21:46:27.105124 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105069    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-socket\") pod \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") "
Sep 11 21:46:27.105237 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105120    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqrw4\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-kube-api-access-lqrw4\") pod \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") "
Sep 11 21:46:27.105237 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105135    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-data" (OuterVolumeSpecName: "istio-data") pod "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" (UID: "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:46:27.105237 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105184    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-credential-socket\") pod \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") "
Sep 11 21:46:27.105237 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105223    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-certs\") pod \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") "
Sep 11 21:46:27.105442 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105247    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-token\") pod \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\" (UID: \"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded\") "
Sep 11 21:46:27.105442 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105334    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" (UID: "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:46:27.105592 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105564    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" (UID: "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:46:27.105799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105738    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-data\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:27.105799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105763    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:27.105799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105768    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" (UID: "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:46:27.105799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105777    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-credential-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:27.106113 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.105843    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" (UID: "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:46:27.108262 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.108211    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-kube-api-access-lqrw4" (OuterVolumeSpecName: "kube-api-access-lqrw4") pod "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" (UID: "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded"). InnerVolumeSpecName "kube-api-access-lqrw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:46:27.108262 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.108222    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" (UID: "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:46:27.108513 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.108490    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-token" (OuterVolumeSpecName: "istio-token") pod "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" (UID: "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:46:27.108582 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.108526    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" (UID: "3da4c8ed-0a1a-45c6-ac99-c7dd54893ded"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:46:27.207569 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.207505    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqrw4\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-kube-api-access-lqrw4\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:27.207569 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.207540    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-workload-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:27.207569 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.207555    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-token\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:27.207569 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.207568    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-podinfo\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:27.207772 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.207580    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istiod-ca-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:27.207772 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.207593    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded-istio-envoy\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:46:27.512746 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.512664    2577 generic.go:356] "Generic (PLEG): container finished" podID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerID="9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0" exitCode=0
Sep 11 21:46:27.512746 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.512714    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"
Sep 11 21:46:27.512966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.512755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" event={"ID":"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded","Type":"ContainerDied","Data":"9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0"}
Sep 11 21:46:27.512966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.512831    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2" event={"ID":"3da4c8ed-0a1a-45c6-ac99-c7dd54893ded","Type":"ContainerDied","Data":"764e76e3584c3bbe8948886ffad0eeb73a1fb679f30dad40084c64b4172888de"}
Sep 11 21:46:27.512966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.512864    2577 scope.go:117] "RemoveContainer" containerID="9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0"
Sep 11 21:46:27.523333 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.523318    2577 scope.go:117] "RemoveContainer" containerID="b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee"
Sep 11 21:46:27.532251 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.532163    2577 scope.go:117] "RemoveContainer" containerID="9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0"
Sep 11 21:46:27.532602 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:46:27.532577    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0\": container with ID starting with 9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0 not found: ID does not exist" containerID="9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0"
Sep 11 21:46:27.532708 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.532607    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0"} err="failed to get container status \"9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0\": rpc error: code = NotFound desc = could not find container \"9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0\": container with ID starting with 9c5d5c553ac14de106c3102bfb13757c91fbd5f0146418707781d3397666d6b0 not found: ID does not exist"
Sep 11 21:46:27.532708 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.532627    2577 scope.go:117] "RemoveContainer" containerID="b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee"
Sep 11 21:46:27.532923 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:46:27.532901    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee\": container with ID starting with b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee not found: ID does not exist" containerID="b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee"
Sep 11 21:46:27.532981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.532929    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee"} err="failed to get container status \"b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee\": rpc error: code = NotFound desc = could not find container \"b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee\": container with ID starting with b510babadcca409f3474216b3c42ad3153750f44160cba5a2dfa80f4efdbc4ee not found: ID does not exist"
Sep 11 21:46:27.536181 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.536161    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"]
Sep 11 21:46:27.539033 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.539012    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-7a9aa317-openshift-default-5fd5d9d9d4-cp5r2"]
Sep 11 21:46:27.762380 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:27.762347    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" path="/var/lib/kubelet/pods/3da4c8ed-0a1a-45c6-ac99-c7dd54893ded/volumes"
Sep 11 21:46:55.338754 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.338720    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"]
Sep 11 21:46:55.339278 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.339180    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10c04789-ee76-420a-8586-f81ef6dc15ed" containerName="maas-api"
Sep 11 21:46:55.339278 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.339191    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="10c04789-ee76-420a-8586-f81ef6dc15ed" containerName="maas-api"
Sep 11 21:46:55.339278 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.339212    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy"
Sep 11 21:46:55.339278 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.339218    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy"
Sep 11 21:46:55.339278 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.339228    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy"
Sep 11 21:46:55.339278 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.339233    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy"
Sep 11 21:46:55.339640 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.339302    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="10c04789-ee76-420a-8586-f81ef6dc15ed" containerName="maas-api"
Sep 11 21:46:55.339640 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.339311    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy"
Sep 11 21:46:55.339640 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.339317    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da4c8ed-0a1a-45c6-ac99-c7dd54893ded" containerName="istio-proxy"
Sep 11 21:46:55.344216 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.344193    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.346877 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.346856    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-b75330-openshift-default-dockercfg-k58vc\""
Sep 11 21:46:55.354716 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.354692    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"]
Sep 11 21:46:55.485541 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.485511    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-certs\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.485727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.485549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-token\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.485727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.485571    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-envoy\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.485727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.485596    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc76d02-9210-4755-9180-64a336bc2a2c-istiod-ca-cert\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.485727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.485669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnz6m\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-kube-api-access-gnz6m\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.485727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.485699    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-podinfo\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.485727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.485721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-socket\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.485958 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.485802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-credential-socket\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.485958 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.485841    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-data\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.586957 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.586910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-data\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.586978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-certs\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-token\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587027    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-envoy\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc76d02-9210-4755-9180-64a336bc2a2c-istiod-ca-cert\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnz6m\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-kube-api-access-gnz6m\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587163 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-podinfo\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587489 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-socket\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587489 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-credential-socket\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587489 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587374    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-data\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587489 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587410    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-certs\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587721 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587706    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-credential-socket\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587772 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587750    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-socket\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.587853 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.587836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc76d02-9210-4755-9180-64a336bc2a2c-istiod-ca-cert\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.589620 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.589577    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-envoy\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.589859 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.589843    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-podinfo\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.595357 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.595331    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-token\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.595573 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.595554    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnz6m\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-kube-api-access-gnz6m\") pod \"e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") " pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.655605 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.655574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:55.935558 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.935530    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"]
Sep 11 21:46:55.936660 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:46:55.936634    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc76d02_9210_4755_9180_64a336bc2a2c.slice/crio-fe4567deb8c83b163ab156f4cabba112bee7e43eaff07ae994be2c3baf585168 WatchSource:0}: Error finding container fe4567deb8c83b163ab156f4cabba112bee7e43eaff07ae994be2c3baf585168: Status 404 returned error can't find the container with id fe4567deb8c83b163ab156f4cabba112bee7e43eaff07ae994be2c3baf585168
Sep 11 21:46:55.938911 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.938878    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:46:55.938992 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.938944    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:46:55.938992 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:55.938988    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:46:56.713217 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:56.713181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" event={"ID":"dfc76d02-9210-4755-9180-64a336bc2a2c","Type":"ContainerStarted","Data":"427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c"}
Sep 11 21:46:56.713668 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:56.713242    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" event={"ID":"dfc76d02-9210-4755-9180-64a336bc2a2c","Type":"ContainerStarted","Data":"fe4567deb8c83b163ab156f4cabba112bee7e43eaff07ae994be2c3baf585168"}
Sep 11 21:46:56.734294 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:56.734238    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" podStartSLOduration=1.734222501 podStartE2EDuration="1.734222501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:46:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:46:56.732385679 +0000 UTC m=+971.389949454" watchObservedRunningTime="2026-09-11 21:46:56.734222501 +0000 UTC m=+971.391786265"
Sep 11 21:46:57.656098 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:57.656061    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:57.662131 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:57.662107    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:57.723063 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:57.723029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:46:57.724198 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:46:57.724174    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:47:22.890009 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:22.889975    2577 generic.go:356] "Generic (PLEG): container finished" podID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerID="427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c" exitCode=0
Sep 11 21:47:22.890428 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:22.890052    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" event={"ID":"dfc76d02-9210-4755-9180-64a336bc2a2c","Type":"ContainerDied","Data":"427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c"}
Sep 11 21:47:22.890520 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:22.890504    2577 scope.go:117] "RemoveContainer" containerID="427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c"
Sep 11 21:47:22.891625 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:22.891598    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:47:22.891687 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:22.891667    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:47:22.891723 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:22.891696    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:47:23.898417 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:23.898381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" event={"ID":"dfc76d02-9210-4755-9180-64a336bc2a2c","Type":"ContainerStarted","Data":"09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203"}
Sep 11 21:47:24.656058 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:24.655970    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:47:24.656910 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:24.656885    2577 patch_prober.go:28] interesting pod/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 21:47:24.656972 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:24.656951    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 21:47:25.656615 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:25.656584    2577 patch_prober.go:28] interesting pod/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 21:47:25.657006 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:25.656634    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 21:47:26.656517 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:26.656434    2577 patch_prober.go:28] interesting pod/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 21:47:26.656703 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:26.656552    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 21:47:27.656755 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:27.656722    2577 patch_prober.go:28] interesting pod/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 21:47:27.657159 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:27.656776    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 21:47:27.723409 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:27.723377    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:47:28.656718 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:28.656680    2577 patch_prober.go:28] interesting pod/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused" start-of-body=
Sep 11 21:47:28.656898 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:28.656743    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.76:15021/healthz/ready\": dial tcp 10.134.0.76:15021: connect: connection refused"
Sep 11 21:47:29.661810 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:29.661779    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:47:29.663049 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:29.663029    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:47:52.772882 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.772851    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"]
Sep 11 21:47:52.776627 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.776611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.779289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.779272    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-b75330\"/\"explicit-model-b75330-kserve-self-signed-certs\""
Sep 11 21:47:52.780445 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.780425    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-b75330\"/\"default-dockercfg-xl5np\""
Sep 11 21:47:52.780604 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.780497    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-b75330\"/\"openshift-service-ca.crt\""
Sep 11 21:47:52.780604 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.780544    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-b75330\"/\"kube-root-ca.crt\""
Sep 11 21:47:52.788015 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.787993    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"]
Sep 11 21:47:52.883697 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.883661    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-dshm\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.883697 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.883708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13482a2e-9955-4fed-af00-12ea6a97b07e-tls-certs\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.883939 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.883743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-home\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.883939 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.883864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-tmp-dir\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.883939 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.883888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-model-cache\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.883939 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.883920    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq66s\" (UniqueName: \"kubernetes.io/projected/13482a2e-9955-4fed-af00-12ea6a97b07e-kube-api-access-wq66s\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.984974 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.984937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-tmp-dir\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.985180 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.984993    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-model-cache\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.985180 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.985052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq66s\" (UniqueName: \"kubernetes.io/projected/13482a2e-9955-4fed-af00-12ea6a97b07e-kube-api-access-wq66s\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.985180 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.985105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-dshm\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.985180 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.985139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13482a2e-9955-4fed-af00-12ea6a97b07e-tls-certs\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.985411 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.985342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-tmp-dir\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.985507 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.985415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-model-cache\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.985718 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.985694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-home\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.986091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.986070    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-home\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.987690 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.987659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-dshm\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.988649 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.988629    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13482a2e-9955-4fed-af00-12ea6a97b07e-tls-certs\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:52.996542 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:52.996512    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq66s\" (UniqueName: \"kubernetes.io/projected/13482a2e-9955-4fed-af00-12ea6a97b07e-kube-api-access-wq66s\") pod \"explicit-model-b75330-kserve-55d685b6bf-vdld5\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") " pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:53.086958 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:53.086881    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:47:53.372282 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:53.372251    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"]
Sep 11 21:47:53.372743 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:47:53.372712    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13482a2e_9955_4fed_af00_12ea6a97b07e.slice/crio-5ec5aa19d6f8b2012bc2af2685ce4d36964ffed41b46f466fc1ce068f7581897 WatchSource:0}: Error finding container 5ec5aa19d6f8b2012bc2af2685ce4d36964ffed41b46f466fc1ce068f7581897: Status 404 returned error can't find the container with id 5ec5aa19d6f8b2012bc2af2685ce4d36964ffed41b46f466fc1ce068f7581897
Sep 11 21:47:54.121533 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:54.121493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5" event={"ID":"13482a2e-9955-4fed-af00-12ea6a97b07e","Type":"ContainerStarted","Data":"791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1"}
Sep 11 21:47:54.121533 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:54.121540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5" event={"ID":"13482a2e-9955-4fed-af00-12ea6a97b07e","Type":"ContainerStarted","Data":"5ec5aa19d6f8b2012bc2af2685ce4d36964ffed41b46f466fc1ce068f7581897"}
Sep 11 21:47:54.140957 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:54.140889    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5" podStartSLOduration=2.140874524 podStartE2EDuration="2.140874524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:47:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:47:54.137349193 +0000 UTC m=+1028.794912970" watchObservedRunningTime="2026-09-11 21:47:54.140874524 +0000 UTC m=+1028.798438287"
Sep 11 21:47:59.675526 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.675493    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"]
Sep 11 21:47:59.679235 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.679217    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.682501 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.682459    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-a21586a5-openshift-default-dockercfg-wh8bn\""
Sep 11 21:47:59.693588 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.693561    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"]
Sep 11 21:47:59.758658 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.758629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-podinfo\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.758832 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.758689    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-token\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.758832 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.758744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a956ace3-2011-43a5-b9ed-6cf59e92066e-istiod-ca-cert\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.758832 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.758786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-data\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.758832 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.758809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-credential-socket\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.759011 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.758893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-socket\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.759011 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.758924    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-envoy\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.759011 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.758947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-certs\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.759011 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.758966    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4gk5\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-kube-api-access-w4gk5\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.860093 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860057    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-envoy\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.860093 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-certs\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.860361 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4gk5\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-kube-api-access-w4gk5\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.860361 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860196    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-podinfo\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.860361 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860261    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-token\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.860361 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a956ace3-2011-43a5-b9ed-6cf59e92066e-istiod-ca-cert\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.861153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-data\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.861153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-credential-socket\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.861153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860511    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-socket\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.861153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860570    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-certs\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.861153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860745    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-data\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.861153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-socket\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.861153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.860875    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-credential-socket\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.861153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.861035    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a956ace3-2011-43a5-b9ed-6cf59e92066e-istiod-ca-cert\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.862752 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.862731    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-envoy\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.862881 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.862863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-podinfo\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.868250 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.868225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-token\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.868529 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.868457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4gk5\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-kube-api-access-w4gk5\") pod \"e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") " pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:47:59.993177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:47:59.993092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:48:00.304316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:00.304285    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"]
Sep 11 21:48:00.305619 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:48:00.305580    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda956ace3_2011_43a5_b9ed_6cf59e92066e.slice/crio-c4e4eef96665e5786086bb896c805ee6a1da453700ddd605139d5a7a91b33f32 WatchSource:0}: Error finding container c4e4eef96665e5786086bb896c805ee6a1da453700ddd605139d5a7a91b33f32: Status 404 returned error can't find the container with id c4e4eef96665e5786086bb896c805ee6a1da453700ddd605139d5a7a91b33f32
Sep 11 21:48:00.308568 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:00.308530    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:48:00.308653 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:00.308601    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:48:00.308653 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:00.308631    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:48:01.174297 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:01.174262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" event={"ID":"a956ace3-2011-43a5-b9ed-6cf59e92066e","Type":"ContainerStarted","Data":"4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60"}
Sep 11 21:48:01.174712 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:01.174316    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" event={"ID":"a956ace3-2011-43a5-b9ed-6cf59e92066e","Type":"ContainerStarted","Data":"c4e4eef96665e5786086bb896c805ee6a1da453700ddd605139d5a7a91b33f32"}
Sep 11 21:48:01.198430 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:01.198382    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" podStartSLOduration=2.198366799 podStartE2EDuration="2.198366799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:48:01.195641171 +0000 UTC m=+1035.853204938" watchObservedRunningTime="2026-09-11 21:48:01.198366799 +0000 UTC m=+1035.855930563"
Sep 11 21:48:01.993830 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:01.993796    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:48:01.999342 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:01.999321    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:48:02.180142 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:02.180110    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:48:02.181009 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:02.180987    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:48:03.087253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:03.087220    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:48:03.087421 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:03.087273    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:48:03.099998 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:03.099970    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:48:03.198781 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:03.198758    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:48:37.422082 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:37.421998    2577 generic.go:356] "Generic (PLEG): container finished" podID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerID="4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60" exitCode=0
Sep 11 21:48:37.422579 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:37.422069    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" event={"ID":"a956ace3-2011-43a5-b9ed-6cf59e92066e","Type":"ContainerDied","Data":"4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60"}
Sep 11 21:48:37.422579 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:37.422543    2577 scope.go:117] "RemoveContainer" containerID="4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60"
Sep 11 21:48:37.423932 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:37.423900    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:48:37.424039 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:37.423964    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:48:37.424039 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:37.423997    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:48:38.431035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:38.430993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" event={"ID":"a956ace3-2011-43a5-b9ed-6cf59e92066e","Type":"ContainerStarted","Data":"e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f"}
Sep 11 21:48:38.993557 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:38.993518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:48:38.993788 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:38.993767    2577 patch_prober.go:28] interesting pod/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 21:48:38.993844 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:38.993814    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 21:48:39.772559 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:39.772516    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"]
Sep 11 21:48:39.994093 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:39.994037    2577 patch_prober.go:28] interesting pod/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 21:48:39.994301 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:39.994107    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 21:48:40.993910 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:40.993870    2577 patch_prober.go:28] interesting pod/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 21:48:40.994296 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:40.993928    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 21:48:41.993730 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:41.993692    2577 patch_prober.go:28] interesting pod/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 21:48:41.993901 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:41.993752    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 21:48:42.993804 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:42.993767    2577 patch_prober.go:28] interesting pod/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 21:48:42.994194 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:42.993827    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 21:48:43.993714 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:43.993675    2577 patch_prober.go:28] interesting pod/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Sep 11 21:48:43.993903 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:43.993739    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Sep 11 21:48:44.998762 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:44.998732    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:48:44.999167 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:44.999145    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:48:44.999922 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:44.999904    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:48:54.792934 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:54.792899    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5" podUID="13482a2e-9955-4fed-af00-12ea6a97b07e" containerName="main" containerID="cri-o://791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1" gracePeriod=45
Sep 11 21:48:55.055335 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.055267    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:48:55.061644 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.061622    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13482a2e-9955-4fed-af00-12ea6a97b07e-tls-certs\") pod \"13482a2e-9955-4fed-af00-12ea6a97b07e\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") "
Sep 11 21:48:55.061768 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.061652    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq66s\" (UniqueName: \"kubernetes.io/projected/13482a2e-9955-4fed-af00-12ea6a97b07e-kube-api-access-wq66s\") pod \"13482a2e-9955-4fed-af00-12ea6a97b07e\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") "
Sep 11 21:48:55.061768 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.061675    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-tmp-dir\") pod \"13482a2e-9955-4fed-af00-12ea6a97b07e\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") "
Sep 11 21:48:55.061768 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.061704    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-model-cache\") pod \"13482a2e-9955-4fed-af00-12ea6a97b07e\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") "
Sep 11 21:48:55.061768 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.061744    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-home\") pod \"13482a2e-9955-4fed-af00-12ea6a97b07e\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") "
Sep 11 21:48:55.061980 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.061819    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-dshm\") pod \"13482a2e-9955-4fed-af00-12ea6a97b07e\" (UID: \"13482a2e-9955-4fed-af00-12ea6a97b07e\") "
Sep 11 21:48:55.061980 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.061963    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "13482a2e-9955-4fed-af00-12ea6a97b07e" (UID: "13482a2e-9955-4fed-af00-12ea6a97b07e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:48:55.062088 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.062021    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-model-cache" (OuterVolumeSpecName: "model-cache") pod "13482a2e-9955-4fed-af00-12ea6a97b07e" (UID: "13482a2e-9955-4fed-af00-12ea6a97b07e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:48:55.062088 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.062061    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-home" (OuterVolumeSpecName: "home") pod "13482a2e-9955-4fed-af00-12ea6a97b07e" (UID: "13482a2e-9955-4fed-af00-12ea6a97b07e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:48:55.062269 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.062243    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-tmp-dir\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:48:55.062269 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.062260    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-model-cache\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:48:55.062269 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.062269    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-home\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:48:55.064114 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.064091    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-dshm" (OuterVolumeSpecName: "dshm") pod "13482a2e-9955-4fed-af00-12ea6a97b07e" (UID: "13482a2e-9955-4fed-af00-12ea6a97b07e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:48:55.064407 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.064390    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13482a2e-9955-4fed-af00-12ea6a97b07e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "13482a2e-9955-4fed-af00-12ea6a97b07e" (UID: "13482a2e-9955-4fed-af00-12ea6a97b07e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:48:55.064502 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.064410    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13482a2e-9955-4fed-af00-12ea6a97b07e-kube-api-access-wq66s" (OuterVolumeSpecName: "kube-api-access-wq66s") pod "13482a2e-9955-4fed-af00-12ea6a97b07e" (UID: "13482a2e-9955-4fed-af00-12ea6a97b07e"). InnerVolumeSpecName "kube-api-access-wq66s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:48:55.163242 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.163208    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13482a2e-9955-4fed-af00-12ea6a97b07e-dshm\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:48:55.163242 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.163239    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13482a2e-9955-4fed-af00-12ea6a97b07e-tls-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:48:55.163242 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.163251    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq66s\" (UniqueName: \"kubernetes.io/projected/13482a2e-9955-4fed-af00-12ea6a97b07e-kube-api-access-wq66s\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:48:55.546155 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.546118    2577 generic.go:356] "Generic (PLEG): container finished" podID="13482a2e-9955-4fed-af00-12ea6a97b07e" containerID="791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1" exitCode=0
Sep 11 21:48:55.546342 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.546178    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"
Sep 11 21:48:55.546342 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.546199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5" event={"ID":"13482a2e-9955-4fed-af00-12ea6a97b07e","Type":"ContainerDied","Data":"791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1"}
Sep 11 21:48:55.546342 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.546242    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5" event={"ID":"13482a2e-9955-4fed-af00-12ea6a97b07e","Type":"ContainerDied","Data":"5ec5aa19d6f8b2012bc2af2685ce4d36964ffed41b46f466fc1ce068f7581897"}
Sep 11 21:48:55.546342 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.546263    2577 scope.go:117] "RemoveContainer" containerID="791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1"
Sep 11 21:48:55.556764 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.556725    2577 scope.go:117] "RemoveContainer" containerID="791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1"
Sep 11 21:48:55.557078 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:48:55.557057    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1\": container with ID starting with 791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1 not found: ID does not exist" containerID="791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1"
Sep 11 21:48:55.557169 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.557091    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1"} err="failed to get container status \"791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1\": rpc error: code = NotFound desc = could not find container \"791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1\": container with ID starting with 791cc3960ebcd8503947fdf79c988df37b5fb1b7717302f9ae4a8b7ee8e786b1 not found: ID does not exist"
Sep 11 21:48:55.574645 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.574616    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"]
Sep 11 21:48:55.581166 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.581143    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-b75330/explicit-model-b75330-kserve-55d685b6bf-vdld5"]
Sep 11 21:48:55.765750 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:48:55.765714    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13482a2e-9955-4fed-af00-12ea6a97b07e" path="/var/lib/kubelet/pods/13482a2e-9955-4fed-af00-12ea6a97b07e/volumes"
Sep 11 21:49:00.189062 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:00.189026    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"]
Sep 11 21:49:00.189543 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:00.189235    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy" containerID="cri-o://e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f" gracePeriod=30
Sep 11 21:49:05.456882 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.456819    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:49:05.571142 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571111    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-credential-socket\") pod \"a956ace3-2011-43a5-b9ed-6cf59e92066e\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") "
Sep 11 21:49:05.571337 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571161    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-podinfo\") pod \"a956ace3-2011-43a5-b9ed-6cf59e92066e\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") "
Sep 11 21:49:05.571337 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571178    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-envoy\") pod \"a956ace3-2011-43a5-b9ed-6cf59e92066e\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") "
Sep 11 21:49:05.571337 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571205    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a956ace3-2011-43a5-b9ed-6cf59e92066e-istiod-ca-cert\") pod \"a956ace3-2011-43a5-b9ed-6cf59e92066e\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") "
Sep 11 21:49:05.571337 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571248    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-socket\") pod \"a956ace3-2011-43a5-b9ed-6cf59e92066e\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") "
Sep 11 21:49:05.571337 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571280    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-data\") pod \"a956ace3-2011-43a5-b9ed-6cf59e92066e\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") "
Sep 11 21:49:05.571337 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571320    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-token\") pod \"a956ace3-2011-43a5-b9ed-6cf59e92066e\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") "
Sep 11 21:49:05.571714 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571398    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4gk5\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-kube-api-access-w4gk5\") pod \"a956ace3-2011-43a5-b9ed-6cf59e92066e\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") "
Sep 11 21:49:05.571714 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571428    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-certs\") pod \"a956ace3-2011-43a5-b9ed-6cf59e92066e\" (UID: \"a956ace3-2011-43a5-b9ed-6cf59e92066e\") "
Sep 11 21:49:05.571835 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571419    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a956ace3-2011-43a5-b9ed-6cf59e92066e" (UID: "a956ace3-2011-43a5-b9ed-6cf59e92066e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:05.571835 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571746    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a956ace3-2011-43a5-b9ed-6cf59e92066e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a956ace3-2011-43a5-b9ed-6cf59e92066e" (UID: "a956ace3-2011-43a5-b9ed-6cf59e92066e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:49:05.571835 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571656    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a956ace3-2011-43a5-b9ed-6cf59e92066e" (UID: "a956ace3-2011-43a5-b9ed-6cf59e92066e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:05.571835 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571663    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a956ace3-2011-43a5-b9ed-6cf59e92066e" (UID: "a956ace3-2011-43a5-b9ed-6cf59e92066e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:05.572047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571875    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a956ace3-2011-43a5-b9ed-6cf59e92066e" (UID: "a956ace3-2011-43a5-b9ed-6cf59e92066e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:05.572047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571895    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-credential-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:05.572047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571916    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a956ace3-2011-43a5-b9ed-6cf59e92066e-istiod-ca-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:05.572047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571929    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:05.572047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.571942    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-data\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:05.573629 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.573602    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a956ace3-2011-43a5-b9ed-6cf59e92066e" (UID: "a956ace3-2011-43a5-b9ed-6cf59e92066e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:49:05.573754 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.573736    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a956ace3-2011-43a5-b9ed-6cf59e92066e" (UID: "a956ace3-2011-43a5-b9ed-6cf59e92066e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:49:05.573799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.573765    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-kube-api-access-w4gk5" (OuterVolumeSpecName: "kube-api-access-w4gk5") pod "a956ace3-2011-43a5-b9ed-6cf59e92066e" (UID: "a956ace3-2011-43a5-b9ed-6cf59e92066e"). InnerVolumeSpecName "kube-api-access-w4gk5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:49:05.574175 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.574157    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a956ace3-2011-43a5-b9ed-6cf59e92066e" (UID: "a956ace3-2011-43a5-b9ed-6cf59e92066e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:05.617112 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.617087    2577 generic.go:356] "Generic (PLEG): container finished" podID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerID="e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f" exitCode=0
Sep 11 21:49:05.617234 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.617138    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"
Sep 11 21:49:05.617234 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.617176    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" event={"ID":"a956ace3-2011-43a5-b9ed-6cf59e92066e","Type":"ContainerDied","Data":"e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f"}
Sep 11 21:49:05.617358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.617244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp" event={"ID":"a956ace3-2011-43a5-b9ed-6cf59e92066e","Type":"ContainerDied","Data":"c4e4eef96665e5786086bb896c805ee6a1da453700ddd605139d5a7a91b33f32"}
Sep 11 21:49:05.617358 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.617278    2577 scope.go:117] "RemoveContainer" containerID="e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f"
Sep 11 21:49:05.627669 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.627655    2577 scope.go:117] "RemoveContainer" containerID="4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60"
Sep 11 21:49:05.639337 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.639319    2577 scope.go:117] "RemoveContainer" containerID="e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f"
Sep 11 21:49:05.639838 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:49:05.639803    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f\": container with ID starting with e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f not found: ID does not exist" containerID="e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f"
Sep 11 21:49:05.639941 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.639840    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f"} err="failed to get container status \"e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f\": rpc error: code = NotFound desc = could not find container \"e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f\": container with ID starting with e5995e7e84c4ac5d50edffa0947276993a99173b594a3bc7fd225fa2e46dbb6f not found: ID does not exist"
Sep 11 21:49:05.639941 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.639863    2577 scope.go:117] "RemoveContainer" containerID="4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60"
Sep 11 21:49:05.640196 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:49:05.640177    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60\": container with ID starting with 4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60 not found: ID does not exist" containerID="4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60"
Sep 11 21:49:05.640257 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.640206    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60"} err="failed to get container status \"4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60\": rpc error: code = NotFound desc = could not find container \"4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60\": container with ID starting with 4b14a94f5bd9af7cdaddcd00195d9219c2343b21a0aac4026e29874eaa242f60 not found: ID does not exist"
Sep 11 21:49:05.642226 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.642206    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"]
Sep 11 21:49:05.645139 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.645122    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-a21586a5-openshift-default-86d67cbcb8-8sbbp"]
Sep 11 21:49:05.672695 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.672670    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4gk5\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-kube-api-access-w4gk5\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:05.672788 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.672699    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-workload-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:05.672788 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.672714    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-podinfo\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:05.672788 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.672726    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-envoy\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:05.672788 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.672740    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a956ace3-2011-43a5-b9ed-6cf59e92066e-istio-token\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:05.763666 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:05.763593    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" path="/var/lib/kubelet/pods/a956ace3-2011-43a5-b9ed-6cf59e92066e/volumes"
Sep 11 21:49:14.101676 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.101645    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"]
Sep 11 21:49:14.102166 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.102152    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13482a2e-9955-4fed-af00-12ea6a97b07e" containerName="main"
Sep 11 21:49:14.102212 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.102168    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="13482a2e-9955-4fed-af00-12ea6a97b07e" containerName="main"
Sep 11 21:49:14.102212 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.102176    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy"
Sep 11 21:49:14.102212 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.102182    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy"
Sep 11 21:49:14.102311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.102274    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="13482a2e-9955-4fed-af00-12ea6a97b07e" containerName="main"
Sep 11 21:49:14.102311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.102281    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy"
Sep 11 21:49:14.104978 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.104955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.107696 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.107672    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-5cb5f4-openshift-default-dockercfg-scwdp\""
Sep 11 21:49:14.116939 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.116916    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"]
Sep 11 21:49:14.157079 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.157042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-socket\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.157218 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.157086    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-envoy\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.157218 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.157108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98dd113-5eac-49ed-b741-d6d66a01beb4-istiod-ca-cert\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.157218 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.157185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-certs\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.157327 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.157249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-credential-socket\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.157327 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.157280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-podinfo\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.157400 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.157362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hcst\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-kube-api-access-7hcst\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.157400 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.157393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-data\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.157483 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.157409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-token\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258235 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258199    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-credential-socket\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-podinfo\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hcst\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-kube-api-access-7hcst\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-data\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-token\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258362    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-socket\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-envoy\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258432 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98dd113-5eac-49ed-b741-d6d66a01beb4-istiod-ca-cert\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258841 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-certs\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258841 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258697    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-credential-socket\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258841 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258699    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-data\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.258965 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-socket\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.259018 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.258977    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-certs\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.259223 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.259205    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98dd113-5eac-49ed-b741-d6d66a01beb4-istiod-ca-cert\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.261304 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.261284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-envoy\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.261632 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.261614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-podinfo\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.266756 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.266735    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hcst\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-kube-api-access-7hcst\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.266896 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.266877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-token\") pod \"e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") " pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.420431 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.420406    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:14.700087 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.700064    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"]
Sep 11 21:49:14.701978 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:49:14.701941    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc98dd113_5eac_49ed_b741_d6d66a01beb4.slice/crio-6e71ea98ce06c13dca9fc782b70de8b2c9bb7b4afdbc4c56d493a4c2a3e13baa WatchSource:0}: Error finding container 6e71ea98ce06c13dca9fc782b70de8b2c9bb7b4afdbc4c56d493a4c2a3e13baa: Status 404 returned error can't find the container with id 6e71ea98ce06c13dca9fc782b70de8b2c9bb7b4afdbc4c56d493a4c2a3e13baa
Sep 11 21:49:14.705098 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.705057    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:49:14.705221 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.705146    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:49:14.705221 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:14.705186    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:49:15.685456 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:15.685416    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" event={"ID":"c98dd113-5eac-49ed-b741-d6d66a01beb4","Type":"ContainerStarted","Data":"9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709"}
Sep 11 21:49:15.685831 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:15.685505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" event={"ID":"c98dd113-5eac-49ed-b741-d6d66a01beb4","Type":"ContainerStarted","Data":"6e71ea98ce06c13dca9fc782b70de8b2c9bb7b4afdbc4c56d493a4c2a3e13baa"}
Sep 11 21:49:15.708219 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:15.708169    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" podStartSLOduration=1.708154436 podStartE2EDuration="1.708154436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:49:15.704142964 +0000 UTC m=+1110.361706729" watchObservedRunningTime="2026-09-11 21:49:15.708154436 +0000 UTC m=+1110.365718199"
Sep 11 21:49:16.421013 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:16.420981    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:16.425832 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:16.425806    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:16.695746 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:16.695661    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:16.696597 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:16.696578    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:20.010855 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:20.010816    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"]
Sep 11 21:49:20.011319 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:20.011066    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy" containerID="cri-o://09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203" gracePeriod=30
Sep 11 21:49:25.271166 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.271123    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:49:25.375877 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.375800    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnz6m\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-kube-api-access-gnz6m\") pod \"dfc76d02-9210-4755-9180-64a336bc2a2c\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") "
Sep 11 21:49:25.375877 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.375846    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-data\") pod \"dfc76d02-9210-4755-9180-64a336bc2a2c\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") "
Sep 11 21:49:25.376092 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.375929    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-podinfo\") pod \"dfc76d02-9210-4755-9180-64a336bc2a2c\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") "
Sep 11 21:49:25.376092 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.375954    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc76d02-9210-4755-9180-64a336bc2a2c-istiod-ca-cert\") pod \"dfc76d02-9210-4755-9180-64a336bc2a2c\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") "
Sep 11 21:49:25.376092 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376002    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-certs\") pod \"dfc76d02-9210-4755-9180-64a336bc2a2c\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") "
Sep 11 21:49:25.376092 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376017    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-credential-socket\") pod \"dfc76d02-9210-4755-9180-64a336bc2a2c\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") "
Sep 11 21:49:25.376092 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376040    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-socket\") pod \"dfc76d02-9210-4755-9180-64a336bc2a2c\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") "
Sep 11 21:49:25.376350 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376150    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfc76d02-9210-4755-9180-64a336bc2a2c" (UID: "dfc76d02-9210-4755-9180-64a336bc2a2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:25.376350 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376284    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfc76d02-9210-4755-9180-64a336bc2a2c" (UID: "dfc76d02-9210-4755-9180-64a336bc2a2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:25.376350 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376295    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfc76d02-9210-4755-9180-64a336bc2a2c" (UID: "dfc76d02-9210-4755-9180-64a336bc2a2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:25.376350 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376299    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-envoy\") pod \"dfc76d02-9210-4755-9180-64a336bc2a2c\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") "
Sep 11 21:49:25.376537 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376368    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-token\") pod \"dfc76d02-9210-4755-9180-64a336bc2a2c\" (UID: \"dfc76d02-9210-4755-9180-64a336bc2a2c\") "
Sep 11 21:49:25.376537 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376360    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfc76d02-9210-4755-9180-64a336bc2a2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfc76d02-9210-4755-9180-64a336bc2a2c" (UID: "dfc76d02-9210-4755-9180-64a336bc2a2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:49:25.376981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376720    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-data\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:25.376981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376737    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc76d02-9210-4755-9180-64a336bc2a2c-istiod-ca-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:25.376981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376745    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:25.376981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376781    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-workload-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:25.376981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.376858    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfc76d02-9210-4755-9180-64a336bc2a2c" (UID: "dfc76d02-9210-4755-9180-64a336bc2a2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:25.378222 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.378195    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-kube-api-access-gnz6m" (OuterVolumeSpecName: "kube-api-access-gnz6m") pod "dfc76d02-9210-4755-9180-64a336bc2a2c" (UID: "dfc76d02-9210-4755-9180-64a336bc2a2c"). InnerVolumeSpecName "kube-api-access-gnz6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:49:25.378325 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.378290    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfc76d02-9210-4755-9180-64a336bc2a2c" (UID: "dfc76d02-9210-4755-9180-64a336bc2a2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:49:25.378938 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.378917    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfc76d02-9210-4755-9180-64a336bc2a2c" (UID: "dfc76d02-9210-4755-9180-64a336bc2a2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:49:25.379001 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.378934    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfc76d02-9210-4755-9180-64a336bc2a2c" (UID: "dfc76d02-9210-4755-9180-64a336bc2a2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:49:25.477455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.477427    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-podinfo\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:25.477455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.477453    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-credential-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:25.477657 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.477462    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-envoy\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:25.477657 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.477490    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-istio-token\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:25.477657 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.477503    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnz6m\" (UniqueName: \"kubernetes.io/projected/dfc76d02-9210-4755-9180-64a336bc2a2c-kube-api-access-gnz6m\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:49:25.764577 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.764544    2577 generic.go:356] "Generic (PLEG): container finished" podID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerID="09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203" exitCode=0
Sep 11 21:49:25.764744 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.764585    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" event={"ID":"dfc76d02-9210-4755-9180-64a336bc2a2c","Type":"ContainerDied","Data":"09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203"}
Sep 11 21:49:25.764744 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.764604    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"
Sep 11 21:49:25.764744 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.764627    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5" event={"ID":"dfc76d02-9210-4755-9180-64a336bc2a2c","Type":"ContainerDied","Data":"fe4567deb8c83b163ab156f4cabba112bee7e43eaff07ae994be2c3baf585168"}
Sep 11 21:49:25.764744 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.764647    2577 scope.go:117] "RemoveContainer" containerID="09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203"
Sep 11 21:49:25.775961 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.775941    2577 scope.go:117] "RemoveContainer" containerID="427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c"
Sep 11 21:49:25.785318 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.785300    2577 scope.go:117] "RemoveContainer" containerID="09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203"
Sep 11 21:49:25.785606 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:49:25.785588    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203\": container with ID starting with 09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203 not found: ID does not exist" containerID="09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203"
Sep 11 21:49:25.785684 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.785615    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203"} err="failed to get container status \"09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203\": rpc error: code = NotFound desc = could not find container \"09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203\": container with ID starting with 09af760746ad9a593f36c2e80e95d704520c581e0ac883bd16b26efe8fc3f203 not found: ID does not exist"
Sep 11 21:49:25.785684 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.785630    2577 scope.go:117] "RemoveContainer" containerID="427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c"
Sep 11 21:49:25.785859 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:49:25.785844    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c\": container with ID starting with 427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c not found: ID does not exist" containerID="427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c"
Sep 11 21:49:25.785900 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.785862    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c"} err="failed to get container status \"427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c\": rpc error: code = NotFound desc = could not find container \"427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c\": container with ID starting with 427c5dec1e776fb431c998ae356e0ed2238a3f60de255049e4ceea06476ae15c not found: ID does not exist"
Sep 11 21:49:25.793665 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.793640    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"]
Sep 11 21:49:25.801663 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:25.801642    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-b75330-openshift-default-7567c75fb4-2s8m5"]
Sep 11 21:49:27.761976 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:27.761942    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" path="/var/lib/kubelet/pods/dfc76d02-9210-4755-9180-64a336bc2a2c/volumes"
Sep 11 21:49:43.896990 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:43.896952    2577 generic.go:356] "Generic (PLEG): container finished" podID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerID="9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709" exitCode=0
Sep 11 21:49:43.897399 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:43.897022    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" event={"ID":"c98dd113-5eac-49ed-b741-d6d66a01beb4","Type":"ContainerDied","Data":"9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709"}
Sep 11 21:49:43.897492 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:43.897453    2577 scope.go:117] "RemoveContainer" containerID="9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709"
Sep 11 21:49:43.898624 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:43.898596    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:49:43.898724 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:43.898662    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:49:43.898724 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:43.898692    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 11 21:49:44.906729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:44.906694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" event={"ID":"c98dd113-5eac-49ed-b741-d6d66a01beb4","Type":"ContainerStarted","Data":"22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b"}
Sep 11 21:49:45.421274 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:45.421176    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:45.422802 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:45.422772    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 21:49:45.423042 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:45.423013    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 21:49:46.421538 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:46.421500    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 21:49:46.422109 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:46.422073    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 21:49:46.696012 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:46.695934    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:47.420903 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:47.420866    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 21:49:47.421190 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:47.421165    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 21:49:48.420929 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:48.420890    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 21:49:48.421572 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:48.421537    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 21:49:49.421656 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:49.421618    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 21:49:49.422241 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:49.422207    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 21:49:50.421045 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:50.420999    2577 patch_prober.go:28] interesting pod/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Sep 11 21:49:50.421253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:50.421067    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Sep 11 21:49:51.424978 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:51.424950    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:51.426041 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:51.426019    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:49:55.474560 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.474520    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"]
Sep 11 21:49:55.475001 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.474988    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy"
Sep 11 21:49:55.475001 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.475002    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy"
Sep 11 21:49:55.475091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.475029    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy"
Sep 11 21:49:55.475091 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.475034    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy"
Sep 11 21:49:55.475156 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.475110    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy"
Sep 11 21:49:55.475156 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.475120    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a956ace3-2011-43a5-b9ed-6cf59e92066e" containerName="istio-proxy"
Sep 11 21:49:55.477355 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.477333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.480408 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.480386    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-afd794-serving-cert\""
Sep 11 21:49:55.501145 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.501116    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"]
Sep 11 21:49:55.594758 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.594722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85pg5\" (UniqueName: \"kubernetes.io/projected/d44e0192-b4f3-4b31-908f-94eb38437fe0-kube-api-access-85pg5\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.594936 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.594783    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.594936 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.594868    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.594936 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.594922    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44e0192-b4f3-4b31-908f-94eb38437fe0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.695936 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.695902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.696107 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.695953    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.696107 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.696001    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44e0192-b4f3-4b31-908f-94eb38437fe0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.696107 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:49:55.696057    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-serving-cert: secret "maas-api-e2e-shared-b-w2-afd794-serving-cert" not found
Sep 11 21:49:55.696107 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.696085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85pg5\" (UniqueName: \"kubernetes.io/projected/d44e0192-b4f3-4b31-908f-94eb38437fe0-kube-api-access-85pg5\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.696271 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:49:55.696144    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-maas-api-tls podName:d44e0192-b4f3-4b31-908f-94eb38437fe0 nodeName:}" failed. No retries permitted until 2026-09-11 21:49:56.196129133 +0000 UTC m=+1150.853692875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-maas-api-tls") pod "maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc" (UID: "d44e0192-b4f3-4b31-908f-94eb38437fe0") : secret "maas-api-e2e-shared-b-w2-afd794-serving-cert" not found
Sep 11 21:49:55.696802 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.696784    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44e0192-b4f3-4b31-908f-94eb38437fe0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.698751 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.698727    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:55.705748 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:55.705722    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85pg5\" (UniqueName: \"kubernetes.io/projected/d44e0192-b4f3-4b31-908f-94eb38437fe0-kube-api-access-85pg5\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:56.201775 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:56.201725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:56.208446 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:56.208412    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:56.403439 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:56.403402    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:56.680457 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:56.680428    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"]
Sep 11 21:49:56.681815 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:49:56.681791    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44e0192_b4f3_4b31_908f_94eb38437fe0.slice/crio-01bab6ea421d93dd91b4e5d6fd452e7ed140de33e5fced884d35eef1b3945efb WatchSource:0}: Error finding container 01bab6ea421d93dd91b4e5d6fd452e7ed140de33e5fced884d35eef1b3945efb: Status 404 returned error can't find the container with id 01bab6ea421d93dd91b4e5d6fd452e7ed140de33e5fced884d35eef1b3945efb
Sep 11 21:49:56.683201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:56.683180    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:49:57.009188 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:57.009154    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc" event={"ID":"d44e0192-b4f3-4b31-908f-94eb38437fe0","Type":"ContainerStarted","Data":"01bab6ea421d93dd91b4e5d6fd452e7ed140de33e5fced884d35eef1b3945efb"}
Sep 11 21:49:58.017575 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:58.017529    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc" event={"ID":"d44e0192-b4f3-4b31-908f-94eb38437fe0","Type":"ContainerStarted","Data":"1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad"}
Sep 11 21:49:58.018144 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:58.017627    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:49:58.036365 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:49:58.036319    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc" podStartSLOduration=2.593727558 podStartE2EDuration="3.0363061s" totalImagesPullingTime="442.578542ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:49:58.035418719 +0000 UTC m=+1152.692982500" watchObservedRunningTime="2026-09-11 21:49:58.0363061 +0000 UTC m=+1152.693869863"
Sep 11 21:50:04.030415 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:04.030386    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:50:07.683460 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.683382    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"]
Sep 11 21:50:07.683945 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.683929    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy"
Sep 11 21:50:07.683945 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.683946    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy"
Sep 11 21:50:07.684027 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.684021    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc76d02-9210-4755-9180-64a336bc2a2c" containerName="istio-proxy"
Sep 11 21:50:07.686279 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.686263    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.689761 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.689740    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f12741\"/\"openshift-service-ca.crt\""
Sep 11 21:50:07.691005 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.690984    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f12741\"/\"default-dockercfg-9ztcv\""
Sep 11 21:50:07.691110 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.691016    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f12741\"/\"distinct-w0-f12741-kserve-self-signed-certs\""
Sep 11 21:50:07.691110 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.691023    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-f12741\"/\"kube-root-ca.crt\""
Sep 11 21:50:07.696796 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.696774    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"]
Sep 11 21:50:07.718407 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.718380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f692355-6dc2-4829-9cb5-a9d84601cc09-tls-certs\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.718580 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.718456    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-model-cache\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.718580 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.718545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-dshm\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.718580 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.718575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mfjq\" (UniqueName: \"kubernetes.io/projected/7f692355-6dc2-4829-9cb5-a9d84601cc09-kube-api-access-5mfjq\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.718753 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.718672    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-home\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.718753 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.718711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-tmp-dir\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.819591 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.819559    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-dshm\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.819591 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.819596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mfjq\" (UniqueName: \"kubernetes.io/projected/7f692355-6dc2-4829-9cb5-a9d84601cc09-kube-api-access-5mfjq\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.819852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.819664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-home\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.819852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.819704    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-tmp-dir\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.819852 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.819778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f692355-6dc2-4829-9cb5-a9d84601cc09-tls-certs\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.820025 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.819880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-model-cache\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.820137 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.820107    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-home\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.820137 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.820122    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-tmp-dir\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.820265 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.820186    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-model-cache\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.822028 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.821999    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-dshm\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.822696 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.822676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f692355-6dc2-4829-9cb5-a9d84601cc09-tls-certs\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.828322 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.828299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mfjq\" (UniqueName: \"kubernetes.io/projected/7f692355-6dc2-4829-9cb5-a9d84601cc09-kube-api-access-5mfjq\") pod \"distinct-w0-f12741-kserve-5d9987946-hbvx4\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") " pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:07.996501 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:07.996384    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:08.274233 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:08.274193    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"]
Sep 11 21:50:08.275569 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:50:08.275537    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f692355_6dc2_4829_9cb5_a9d84601cc09.slice/crio-fbace5d7a38064668a91f2f7007430a654e7057f34c959e9f9d82e7bf02671fe WatchSource:0}: Error finding container fbace5d7a38064668a91f2f7007430a654e7057f34c959e9f9d82e7bf02671fe: Status 404 returned error can't find the container with id fbace5d7a38064668a91f2f7007430a654e7057f34c959e9f9d82e7bf02671fe
Sep 11 21:50:09.092730 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:09.092694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4" event={"ID":"7f692355-6dc2-4829-9cb5-a9d84601cc09","Type":"ContainerStarted","Data":"fb3eb20dc0a5ab0791e994fbc49c495793d906aa70d3068f8de83b272635273f"}
Sep 11 21:50:09.092730 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:09.092738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4" event={"ID":"7f692355-6dc2-4829-9cb5-a9d84601cc09","Type":"ContainerStarted","Data":"fbace5d7a38064668a91f2f7007430a654e7057f34c959e9f9d82e7bf02671fe"}
Sep 11 21:50:09.114620 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:09.114573    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4" podStartSLOduration=2.114558443 podStartE2EDuration="2.114558443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:50:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:50:09.112664862 +0000 UTC m=+1163.770228627" watchObservedRunningTime="2026-09-11 21:50:09.114558443 +0000 UTC m=+1163.772122243"
Sep 11 21:50:17.996640 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:17.996605    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:17.997150 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:17.996684    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:18.011742 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:18.011712    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:18.163339 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:18.163309    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:50:22.642670 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:22.642638    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7968-ad32f3"]
Sep 11 21:50:22.646627 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:22.646605    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-ad32f3"
Sep 11 21:50:22.649242 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:22.649218    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x6r4k\""
Sep 11 21:50:22.652626 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:22.652597    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7968-ad32f3"]
Sep 11 21:50:22.771099 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:22.771056    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8hhm\" (UniqueName: \"kubernetes.io/projected/018a1daa-920f-4a2d-b452-e2040f381e98-kube-api-access-k8hhm\") pod \"test-curl-7968-ad32f3\" (UID: \"018a1daa-920f-4a2d-b452-e2040f381e98\") " pod="opendatahub/test-curl-7968-ad32f3"
Sep 11 21:50:22.872030 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:22.871999    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8hhm\" (UniqueName: \"kubernetes.io/projected/018a1daa-920f-4a2d-b452-e2040f381e98-kube-api-access-k8hhm\") pod \"test-curl-7968-ad32f3\" (UID: \"018a1daa-920f-4a2d-b452-e2040f381e98\") " pod="opendatahub/test-curl-7968-ad32f3"
Sep 11 21:50:22.880670 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:22.880647    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8hhm\" (UniqueName: \"kubernetes.io/projected/018a1daa-920f-4a2d-b452-e2040f381e98-kube-api-access-k8hhm\") pod \"test-curl-7968-ad32f3\" (UID: \"018a1daa-920f-4a2d-b452-e2040f381e98\") " pod="opendatahub/test-curl-7968-ad32f3"
Sep 11 21:50:22.958270 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:22.958246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-ad32f3"
Sep 11 21:50:23.233662 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:23.233630    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7968-ad32f3"]
Sep 11 21:50:23.234044 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:50:23.234016    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod018a1daa_920f_4a2d_b452_e2040f381e98.slice/crio-024f4b86ba3c0cd1dcb75bf43ae5dbac3fbbe1b3a7235c8e20be48742d82e7e1 WatchSource:0}: Error finding container 024f4b86ba3c0cd1dcb75bf43ae5dbac3fbbe1b3a7235c8e20be48742d82e7e1: Status 404 returned error can't find the container with id 024f4b86ba3c0cd1dcb75bf43ae5dbac3fbbe1b3a7235c8e20be48742d82e7e1
Sep 11 21:50:24.199050 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.199001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7968-ad32f3" event={"ID":"018a1daa-920f-4a2d-b452-e2040f381e98","Type":"ContainerStarted","Data":"630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae"}
Sep 11 21:50:24.199050 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.199056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7968-ad32f3" event={"ID":"018a1daa-920f-4a2d-b452-e2040f381e98","Type":"ContainerStarted","Data":"024f4b86ba3c0cd1dcb75bf43ae5dbac3fbbe1b3a7235c8e20be48742d82e7e1"}
Sep 11 21:50:24.217823 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.217739    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7968-ad32f3" podStartSLOduration=2.217722659 podStartE2EDuration="2.217722659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:50:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:50:24.214572376 +0000 UTC m=+1178.872136139" watchObservedRunningTime="2026-09-11 21:50:24.217722659 +0000 UTC m=+1178.875286423"
Sep 11 21:50:24.818733 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.818695    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7968-ad32f3"]
Sep 11 21:50:24.823177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.823135    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7968-ad32f3"]
Sep 11 21:50:24.943709 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.943679    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7968-b9e7a6"]
Sep 11 21:50:24.944261 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.944246    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018a1daa-920f-4a2d-b452-e2040f381e98" containerName="test-curl-7968-ad32f3"
Sep 11 21:50:24.944311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.944263    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="018a1daa-920f-4a2d-b452-e2040f381e98" containerName="test-curl-7968-ad32f3"
Sep 11 21:50:24.944368 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.944358    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="018a1daa-920f-4a2d-b452-e2040f381e98" containerName="test-curl-7968-ad32f3"
Sep 11 21:50:24.947979 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.947818    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-b9e7a6"
Sep 11 21:50:24.951676 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.951643    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7968-b9e7a6"]
Sep 11 21:50:24.997028 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:24.997005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vbj9\" (UniqueName: \"kubernetes.io/projected/2bafa64e-f16d-4628-bf23-eb532f12eb5f-kube-api-access-4vbj9\") pod \"test-curl-7968-b9e7a6\" (UID: \"2bafa64e-f16d-4628-bf23-eb532f12eb5f\") " pod="opendatahub/test-curl-7968-b9e7a6"
Sep 11 21:50:25.097998 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:25.097963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vbj9\" (UniqueName: \"kubernetes.io/projected/2bafa64e-f16d-4628-bf23-eb532f12eb5f-kube-api-access-4vbj9\") pod \"test-curl-7968-b9e7a6\" (UID: \"2bafa64e-f16d-4628-bf23-eb532f12eb5f\") " pod="opendatahub/test-curl-7968-b9e7a6"
Sep 11 21:50:25.108227 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:25.108199    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vbj9\" (UniqueName: \"kubernetes.io/projected/2bafa64e-f16d-4628-bf23-eb532f12eb5f-kube-api-access-4vbj9\") pod \"test-curl-7968-b9e7a6\" (UID: \"2bafa64e-f16d-4628-bf23-eb532f12eb5f\") " pod="opendatahub/test-curl-7968-b9e7a6"
Sep 11 21:50:25.207912 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:25.207819    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7968-ad32f3" container="test-curl-7968-ad32f3"
Sep 11 21:50:25.259926 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:25.259895    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-b9e7a6"
Sep 11 21:50:25.543427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:25.543399    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7968-b9e7a6"]
Sep 11 21:50:25.543675 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:50:25.543596    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2bafa64e_f16d_4628_bf23_eb532f12eb5f.slice/crio-831ed51a822296ea3956626ce1ac421445f584fdcee768e3d812b353e0f78534 WatchSource:0}: Error finding container 831ed51a822296ea3956626ce1ac421445f584fdcee768e3d812b353e0f78534: Status 404 returned error can't find the container with id 831ed51a822296ea3956626ce1ac421445f584fdcee768e3d812b353e0f78534
Sep 11 21:50:26.215957 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.215918    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7968-b9e7a6" event={"ID":"2bafa64e-f16d-4628-bf23-eb532f12eb5f","Type":"ContainerStarted","Data":"e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859"}
Sep 11 21:50:26.216382 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.215966    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7968-b9e7a6" event={"ID":"2bafa64e-f16d-4628-bf23-eb532f12eb5f","Type":"ContainerStarted","Data":"831ed51a822296ea3956626ce1ac421445f584fdcee768e3d812b353e0f78534"}
Sep 11 21:50:26.216382 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.216163    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7968-ad32f3" podUID="018a1daa-920f-4a2d-b452-e2040f381e98" containerName="test-curl-7968-ad32f3" containerID="cri-o://630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae" gracePeriod=2
Sep 11 21:50:26.232452 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.232402    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7968-b9e7a6" podStartSLOduration=2.232385594 podStartE2EDuration="2.232385594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:50:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:50:26.229465499 +0000 UTC m=+1180.887029264" watchObservedRunningTime="2026-09-11 21:50:26.232385594 +0000 UTC m=+1180.889949355"
Sep 11 21:50:26.825867 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.825832    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7968-b9e7a6"]
Sep 11 21:50:26.829406 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.829377    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7968-b9e7a6"]
Sep 11 21:50:26.943389 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.943352    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7968-0fe799"]
Sep 11 21:50:26.943896 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.943881    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bafa64e-f16d-4628-bf23-eb532f12eb5f" containerName="test-curl-7968-b9e7a6"
Sep 11 21:50:26.943950 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.943899    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bafa64e-f16d-4628-bf23-eb532f12eb5f" containerName="test-curl-7968-b9e7a6"
Sep 11 21:50:26.944006 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.943997    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bafa64e-f16d-4628-bf23-eb532f12eb5f" containerName="test-curl-7968-b9e7a6"
Sep 11 21:50:26.947152 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.947136    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-0fe799"
Sep 11 21:50:26.953008 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:26.952979    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7968-0fe799"]
Sep 11 21:50:27.020039 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:27.020008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk6sg\" (UniqueName: \"kubernetes.io/projected/3391ce45-6e66-4ee7-b273-1bcbd8dff0c8-kube-api-access-qk6sg\") pod \"test-curl-7968-0fe799\" (UID: \"3391ce45-6e66-4ee7-b273-1bcbd8dff0c8\") " pod="opendatahub/test-curl-7968-0fe799"
Sep 11 21:50:27.120880 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:27.120845    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk6sg\" (UniqueName: \"kubernetes.io/projected/3391ce45-6e66-4ee7-b273-1bcbd8dff0c8-kube-api-access-qk6sg\") pod \"test-curl-7968-0fe799\" (UID: \"3391ce45-6e66-4ee7-b273-1bcbd8dff0c8\") " pod="opendatahub/test-curl-7968-0fe799"
Sep 11 21:50:27.128607 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:27.128576    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk6sg\" (UniqueName: \"kubernetes.io/projected/3391ce45-6e66-4ee7-b273-1bcbd8dff0c8-kube-api-access-qk6sg\") pod \"test-curl-7968-0fe799\" (UID: \"3391ce45-6e66-4ee7-b273-1bcbd8dff0c8\") " pod="opendatahub/test-curl-7968-0fe799"
Sep 11 21:50:27.222719 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:27.222632    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7968-b9e7a6" container="test-curl-7968-b9e7a6"
Sep 11 21:50:27.259033 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:27.259003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-0fe799"
Sep 11 21:50:27.535147 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:27.535109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7968-0fe799"]
Sep 11 21:50:28.230827 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.230796    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7968-0fe799" event={"ID":"3391ce45-6e66-4ee7-b273-1bcbd8dff0c8","Type":"ContainerStarted","Data":"06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013"}
Sep 11 21:50:28.231110 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.230847    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7968-0fe799" event={"ID":"3391ce45-6e66-4ee7-b273-1bcbd8dff0c8","Type":"ContainerStarted","Data":"a1e53e410bf933d5d09e578f72d552588d2c26271c81f41b4e50811e8266eb16"}
Sep 11 21:50:28.231110 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.231073    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7968-b9e7a6" podUID="2bafa64e-f16d-4628-bf23-eb532f12eb5f" containerName="test-curl-7968-b9e7a6" containerID="cri-o://e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859" gracePeriod=2
Sep 11 21:50:28.245239 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.245199    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7968-0fe799" podStartSLOduration=2.245185669 podStartE2EDuration="2.245185669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:50:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:50:28.243924576 +0000 UTC m=+1182.901488342" watchObservedRunningTime="2026-09-11 21:50:28.245185669 +0000 UTC m=+1182.902749476"
Sep 11 21:50:28.400752 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.400714    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-ad32f3"
Sep 11 21:50:28.537225 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.537142    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8hhm\" (UniqueName: \"kubernetes.io/projected/018a1daa-920f-4a2d-b452-e2040f381e98-kube-api-access-k8hhm\") pod \"018a1daa-920f-4a2d-b452-e2040f381e98\" (UID: \"018a1daa-920f-4a2d-b452-e2040f381e98\") "
Sep 11 21:50:28.539485 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.539447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018a1daa-920f-4a2d-b452-e2040f381e98-kube-api-access-k8hhm" (OuterVolumeSpecName: "kube-api-access-k8hhm") pod "018a1daa-920f-4a2d-b452-e2040f381e98" (UID: "018a1daa-920f-4a2d-b452-e2040f381e98"). InnerVolumeSpecName "kube-api-access-k8hhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:28.638668 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.638642    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8hhm\" (UniqueName: \"kubernetes.io/projected/018a1daa-920f-4a2d-b452-e2040f381e98-kube-api-access-k8hhm\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:50:28.831175 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.831086    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7968-0fe799"]
Sep 11 21:50:28.834514 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.834483    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7968-0fe799"]
Sep 11 21:50:28.955130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.955100    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7968-5570f5"]
Sep 11 21:50:28.955616 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.955602    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3391ce45-6e66-4ee7-b273-1bcbd8dff0c8" containerName="test-curl-7968-0fe799"
Sep 11 21:50:28.955666 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.955617    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3391ce45-6e66-4ee7-b273-1bcbd8dff0c8" containerName="test-curl-7968-0fe799"
Sep 11 21:50:28.955713 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.955704    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3391ce45-6e66-4ee7-b273-1bcbd8dff0c8" containerName="test-curl-7968-0fe799"
Sep 11 21:50:28.958942 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.958927    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-5570f5"
Sep 11 21:50:28.966003 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:28.965976    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7968-5570f5"]
Sep 11 21:50:29.043287 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.043254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmz86\" (UniqueName: \"kubernetes.io/projected/43588d69-270f-4dae-8d98-5f1b5d5e3180-kube-api-access-hmz86\") pod \"test-curl-7968-5570f5\" (UID: \"43588d69-270f-4dae-8d98-5f1b5d5e3180\") " pod="opendatahub/test-curl-7968-5570f5"
Sep 11 21:50:29.144576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.144501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmz86\" (UniqueName: \"kubernetes.io/projected/43588d69-270f-4dae-8d98-5f1b5d5e3180-kube-api-access-hmz86\") pod \"test-curl-7968-5570f5\" (UID: \"43588d69-270f-4dae-8d98-5f1b5d5e3180\") " pod="opendatahub/test-curl-7968-5570f5"
Sep 11 21:50:29.152800 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.152781    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmz86\" (UniqueName: \"kubernetes.io/projected/43588d69-270f-4dae-8d98-5f1b5d5e3180-kube-api-access-hmz86\") pod \"test-curl-7968-5570f5\" (UID: \"43588d69-270f-4dae-8d98-5f1b5d5e3180\") " pod="opendatahub/test-curl-7968-5570f5"
Sep 11 21:50:29.238896 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.238869    2577 generic.go:356] "Generic (PLEG): container finished" podID="018a1daa-920f-4a2d-b452-e2040f381e98" containerID="630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae" exitCode=137
Sep 11 21:50:29.239314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.238926    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-ad32f3"
Sep 11 21:50:29.239314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.238944    2577 scope.go:117] "RemoveContainer" containerID="630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae"
Sep 11 21:50:29.239416 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:29.239353    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7968-0fe799" container="test-curl-7968-0fe799"
Sep 11 21:50:29.249385 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.249370    2577 scope.go:117] "RemoveContainer" containerID="630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae"
Sep 11 21:50:29.249674 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:29.249657    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae\": container with ID starting with 630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae not found: ID does not exist" containerID="630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae"
Sep 11 21:50:29.249751 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.249684    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae"} err="failed to get container status \"630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae\": rpc error: code = NotFound desc = could not find container \"630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae\": container with ID starting with 630a937c8aba147ce2bbe3d45772522a62b2f0758f0265867de7db8200f946ae not found: ID does not exist"
Sep 11 21:50:29.250652 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:29.250634    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7968-ad32f3\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="018a1daa-920f-4a2d-b452-e2040f381e98" pod="opendatahub/test-curl-7968-ad32f3"
Sep 11 21:50:29.269803 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.269788    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-5570f5"
Sep 11 21:50:29.541774 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.541745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7968-5570f5"]
Sep 11 21:50:29.542186 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:50:29.542152    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43588d69_270f_4dae_8d98_5f1b5d5e3180.slice/crio-751231af462b78145938423434cfdf4956a33be56ce584f702a030c308d147f4 WatchSource:0}: Error finding container 751231af462b78145938423434cfdf4956a33be56ce584f702a030c308d147f4: Status 404 returned error can't find the container with id 751231af462b78145938423434cfdf4956a33be56ce584f702a030c308d147f4
Sep 11 21:50:29.762745 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:29.762708    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018a1daa-920f-4a2d-b452-e2040f381e98" path="/var/lib/kubelet/pods/018a1daa-920f-4a2d-b452-e2040f381e98/volumes"
Sep 11 21:50:30.248532 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.248504    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7968-5570f5" event={"ID":"43588d69-270f-4dae-8d98-5f1b5d5e3180","Type":"ContainerStarted","Data":"97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4"}
Sep 11 21:50:30.248811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.248552    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7968-5570f5" event={"ID":"43588d69-270f-4dae-8d98-5f1b5d5e3180","Type":"ContainerStarted","Data":"751231af462b78145938423434cfdf4956a33be56ce584f702a030c308d147f4"}
Sep 11 21:50:30.248811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.248731    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7968-0fe799" podUID="3391ce45-6e66-4ee7-b273-1bcbd8dff0c8" containerName="test-curl-7968-0fe799" containerID="cri-o://06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013" gracePeriod=2
Sep 11 21:50:30.262665 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.262620    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7968-5570f5" podStartSLOduration=2.262604092 podStartE2EDuration="2.262604092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:50:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:50:30.261671367 +0000 UTC m=+1184.919235136" watchObservedRunningTime="2026-09-11 21:50:30.262604092 +0000 UTC m=+1184.920167857"
Sep 11 21:50:30.419943 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.419913    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-b9e7a6"
Sep 11 21:50:30.558168 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.558086    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vbj9\" (UniqueName: \"kubernetes.io/projected/2bafa64e-f16d-4628-bf23-eb532f12eb5f-kube-api-access-4vbj9\") pod \"2bafa64e-f16d-4628-bf23-eb532f12eb5f\" (UID: \"2bafa64e-f16d-4628-bf23-eb532f12eb5f\") "
Sep 11 21:50:30.560148 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.560123    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bafa64e-f16d-4628-bf23-eb532f12eb5f-kube-api-access-4vbj9" (OuterVolumeSpecName: "kube-api-access-4vbj9") pod "2bafa64e-f16d-4628-bf23-eb532f12eb5f" (UID: "2bafa64e-f16d-4628-bf23-eb532f12eb5f"). InnerVolumeSpecName "kube-api-access-4vbj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:30.659834 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.659808    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vbj9\" (UniqueName: \"kubernetes.io/projected/2bafa64e-f16d-4628-bf23-eb532f12eb5f-kube-api-access-4vbj9\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:50:30.856126 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.856045    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7968-5570f5"]
Sep 11 21:50:30.860781 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:30.860757    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7968-5570f5"]
Sep 11 21:50:31.256098 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:31.256064    2577 generic.go:356] "Generic (PLEG): container finished" podID="2bafa64e-f16d-4628-bf23-eb532f12eb5f" containerID="e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859" exitCode=137
Sep 11 21:50:31.256548 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:31.256118    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-b9e7a6"
Sep 11 21:50:31.256548 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:31.256173    2577 scope.go:117] "RemoveContainer" containerID="e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859"
Sep 11 21:50:31.256548 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:31.256453    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7968-5570f5" container="test-curl-7968-5570f5"
Sep 11 21:50:31.269716 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:31.267644    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7968-b9e7a6\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="2bafa64e-f16d-4628-bf23-eb532f12eb5f" pod="opendatahub/test-curl-7968-b9e7a6"
Sep 11 21:50:31.269913 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:31.269794    2577 scope.go:117] "RemoveContainer" containerID="e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859"
Sep 11 21:50:31.270329 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:31.270309    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859\": container with ID starting with e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859 not found: ID does not exist" containerID="e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859"
Sep 11 21:50:31.270406 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:31.270337    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859"} err="failed to get container status \"e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859\": rpc error: code = NotFound desc = could not find container \"e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859\": container with ID starting with e65d54eea0d2e6a22576feafc0005cabe3b0e050d2db032f65c1582c6871f859 not found: ID does not exist"
Sep 11 21:50:31.764663 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:31.764632    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bafa64e-f16d-4628-bf23-eb532f12eb5f" path="/var/lib/kubelet/pods/2bafa64e-f16d-4628-bf23-eb532f12eb5f/volumes"
Sep 11 21:50:32.263957 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:32.263921    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7968-5570f5" podUID="43588d69-270f-4dae-8d98-5f1b5d5e3180" containerName="test-curl-7968-5570f5" containerID="cri-o://97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4" gracePeriod=2
Sep 11 21:50:32.427324 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:32.427299    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-0fe799"
Sep 11 21:50:32.583841 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:32.583763    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk6sg\" (UniqueName: \"kubernetes.io/projected/3391ce45-6e66-4ee7-b273-1bcbd8dff0c8-kube-api-access-qk6sg\") pod \"3391ce45-6e66-4ee7-b273-1bcbd8dff0c8\" (UID: \"3391ce45-6e66-4ee7-b273-1bcbd8dff0c8\") "
Sep 11 21:50:32.585960 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:32.585939    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3391ce45-6e66-4ee7-b273-1bcbd8dff0c8-kube-api-access-qk6sg" (OuterVolumeSpecName: "kube-api-access-qk6sg") pod "3391ce45-6e66-4ee7-b273-1bcbd8dff0c8" (UID: "3391ce45-6e66-4ee7-b273-1bcbd8dff0c8"). InnerVolumeSpecName "kube-api-access-qk6sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:32.684838 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:32.684794    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk6sg\" (UniqueName: \"kubernetes.io/projected/3391ce45-6e66-4ee7-b273-1bcbd8dff0c8-kube-api-access-qk6sg\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:50:33.273089 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:33.273054    2577 generic.go:356] "Generic (PLEG): container finished" podID="3391ce45-6e66-4ee7-b273-1bcbd8dff0c8" containerID="06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013" exitCode=137
Sep 11 21:50:33.273549 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:33.273119    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-0fe799"
Sep 11 21:50:33.273549 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:33.273164    2577 scope.go:117] "RemoveContainer" containerID="06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013"
Sep 11 21:50:33.283589 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:33.283571    2577 scope.go:117] "RemoveContainer" containerID="06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013"
Sep 11 21:50:33.283914 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:33.283896    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013\": container with ID starting with 06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013 not found: ID does not exist" containerID="06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013"
Sep 11 21:50:33.283962 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:33.283924    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013"} err="failed to get container status \"06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013\": rpc error: code = NotFound desc = could not find container \"06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013\": container with ID starting with 06ed2fa19bd9af786ed969b6962e7dcf0d011fada0a002801621aea4a9e8c013 not found: ID does not exist"
Sep 11 21:50:33.284652 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:33.284630    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7968-0fe799\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="3391ce45-6e66-4ee7-b273-1bcbd8dff0c8" pod="opendatahub/test-curl-7968-0fe799"
Sep 11 21:50:33.762044 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:33.761980    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3391ce45-6e66-4ee7-b273-1bcbd8dff0c8" path="/var/lib/kubelet/pods/3391ce45-6e66-4ee7-b273-1bcbd8dff0c8/volumes"
Sep 11 21:50:34.461246 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:34.461225    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-5570f5"
Sep 11 21:50:34.601823 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:34.601732    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmz86\" (UniqueName: \"kubernetes.io/projected/43588d69-270f-4dae-8d98-5f1b5d5e3180-kube-api-access-hmz86\") pod \"43588d69-270f-4dae-8d98-5f1b5d5e3180\" (UID: \"43588d69-270f-4dae-8d98-5f1b5d5e3180\") "
Sep 11 21:50:34.604246 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:34.604211    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43588d69-270f-4dae-8d98-5f1b5d5e3180-kube-api-access-hmz86" (OuterVolumeSpecName: "kube-api-access-hmz86") pod "43588d69-270f-4dae-8d98-5f1b5d5e3180" (UID: "43588d69-270f-4dae-8d98-5f1b5d5e3180"). InnerVolumeSpecName "kube-api-access-hmz86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:50:34.703207 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:34.703167    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmz86\" (UniqueName: \"kubernetes.io/projected/43588d69-270f-4dae-8d98-5f1b5d5e3180-kube-api-access-hmz86\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:50:35.288661 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:35.288625    2577 generic.go:356] "Generic (PLEG): container finished" podID="43588d69-270f-4dae-8d98-5f1b5d5e3180" containerID="97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4" exitCode=137
Sep 11 21:50:35.288821 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:35.288702    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7968-5570f5"
Sep 11 21:50:35.288821 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:35.288714    2577 scope.go:117] "RemoveContainer" containerID="97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4"
Sep 11 21:50:35.299200 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:35.299186    2577 scope.go:117] "RemoveContainer" containerID="97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4"
Sep 11 21:50:35.299626 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:35.299602    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4\": container with ID starting with 97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4 not found: ID does not exist" containerID="97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4"
Sep 11 21:50:35.299713 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:35.299633    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4"} err="failed to get container status \"97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4\": rpc error: code = NotFound desc = could not find container \"97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4\": container with ID starting with 97b7b19d54f6f7f11a8b828116343f850b8cd92b43ebafb7ba982190987342a4 not found: ID does not exist"
Sep 11 21:50:35.300111 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:35.300088    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7968-5570f5\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="43588d69-270f-4dae-8d98-5f1b5d5e3180" pod="opendatahub/test-curl-7968-5570f5"
Sep 11 21:50:35.761926 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:50:35.761880    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7968-5570f5\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="43588d69-270f-4dae-8d98-5f1b5d5e3180" pod="opendatahub/test-curl-7968-5570f5"
Sep 11 21:50:35.764135 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:35.764110    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43588d69-270f-4dae-8d98-5f1b5d5e3180" path="/var/lib/kubelet/pods/43588d69-270f-4dae-8d98-5f1b5d5e3180/volumes"
Sep 11 21:50:37.990018 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:37.989980    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"]
Sep 11 21:50:37.991047 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:37.991024    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43588d69-270f-4dae-8d98-5f1b5d5e3180" containerName="test-curl-7968-5570f5"
Sep 11 21:50:37.991255 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:37.991231    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="43588d69-270f-4dae-8d98-5f1b5d5e3180" containerName="test-curl-7968-5570f5"
Sep 11 21:50:37.991427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:37.991410    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="43588d69-270f-4dae-8d98-5f1b5d5e3180" containerName="test-curl-7968-5570f5"
Sep 11 21:50:37.997678 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:37.997655    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.000814 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.000790    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9f68da5e-serving-cert\""
Sep 11 21:50:38.002864 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.002840    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"]
Sep 11 21:50:38.140735 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.140703    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-metrics-certs\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.140930 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.140742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-maas-api-tls\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.140930 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.140785    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljgdz\" (UniqueName: \"kubernetes.io/projected/9676c361-f1b8-49c0-b77e-8b0339587ac1-kube-api-access-ljgdz\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.140930 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.140809    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9676c361-f1b8-49c0-b77e-8b0339587ac1-openshift-service-ca\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.241961 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.241886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-metrics-certs\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.241961 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.241928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-maas-api-tls\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.242168 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.242054    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljgdz\" (UniqueName: \"kubernetes.io/projected/9676c361-f1b8-49c0-b77e-8b0339587ac1-kube-api-access-ljgdz\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.242168 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.242093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9676c361-f1b8-49c0-b77e-8b0339587ac1-openshift-service-ca\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.242770 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.242749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9676c361-f1b8-49c0-b77e-8b0339587ac1-openshift-service-ca\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.244417 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.244400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-maas-api-tls\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.244577 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.244562    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-metrics-certs\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.250133 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.250116    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljgdz\" (UniqueName: \"kubernetes.io/projected/9676c361-f1b8-49c0-b77e-8b0339587ac1-kube-api-access-ljgdz\") pod \"maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.315272 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.315244    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:38.600117 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:38.600085    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"]
Sep 11 21:50:38.600243 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:50:38.600082    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9676c361_f1b8_49c0_b77e_8b0339587ac1.slice/crio-0a8c1778266d48048122e3a5423b13600fcc8086c56fc4cbf98edfaf7b3ccc94 WatchSource:0}: Error finding container 0a8c1778266d48048122e3a5423b13600fcc8086c56fc4cbf98edfaf7b3ccc94: Status 404 returned error can't find the container with id 0a8c1778266d48048122e3a5423b13600fcc8086c56fc4cbf98edfaf7b3ccc94
Sep 11 21:50:39.320636 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:39.320537    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk" event={"ID":"9676c361-f1b8-49c0-b77e-8b0339587ac1","Type":"ContainerStarted","Data":"a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c"}
Sep 11 21:50:39.320636 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:39.320607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk" event={"ID":"9676c361-f1b8-49c0-b77e-8b0339587ac1","Type":"ContainerStarted","Data":"0a8c1778266d48048122e3a5423b13600fcc8086c56fc4cbf98edfaf7b3ccc94"}
Sep 11 21:50:39.321082 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:39.320735    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:39.338951 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:39.338904    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk" podStartSLOduration=2.02196165 podStartE2EDuration="2.338890059s" totalImagesPullingTime="316.928409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:50:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:50:39.336322076 +0000 UTC m=+1193.993885841" watchObservedRunningTime="2026-09-11 21:50:39.338890059 +0000 UTC m=+1193.996453823"
Sep 11 21:50:45.334547 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:45.334517    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:50:45.862452 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:45.862421    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:50:45.867119 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:45.867096    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:50:47.148688 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:50:47.148656    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"]
Sep 11 21:51:02.170036 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.169970    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v" podUID="7bbc6800-190b-410e-849a-ce665e6bf87d" containerName="main" containerID="cri-o://1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90" gracePeriod=45
Sep 11 21:51:02.431861 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.431798    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:51:02.485489 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.485437    2577 generic.go:356] "Generic (PLEG): container finished" podID="7bbc6800-190b-410e-849a-ce665e6bf87d" containerID="1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90" exitCode=0
Sep 11 21:51:02.485672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.485552    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"
Sep 11 21:51:02.485672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.485560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v" event={"ID":"7bbc6800-190b-410e-849a-ce665e6bf87d","Type":"ContainerDied","Data":"1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90"}
Sep 11 21:51:02.485672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.485617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v" event={"ID":"7bbc6800-190b-410e-849a-ce665e6bf87d","Type":"ContainerDied","Data":"7fcfa179d6d202973b848ccde2c356dffc6b32a1c561e2e47371f20c9823f4ba"}
Sep 11 21:51:02.485672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.485656    2577 scope.go:117] "RemoveContainer" containerID="1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90"
Sep 11 21:51:02.496090 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.496067    2577 scope.go:117] "RemoveContainer" containerID="1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90"
Sep 11 21:51:02.496361 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:51:02.496339    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90\": container with ID starting with 1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90 not found: ID does not exist" containerID="1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90"
Sep 11 21:51:02.496431 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.496369    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90"} err="failed to get container status \"1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90\": rpc error: code = NotFound desc = could not find container \"1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90\": container with ID starting with 1a4edda54ea3e7a7c19310142432e8d5480f893044e56555960cee45956fff90 not found: ID does not exist"
Sep 11 21:51:02.503854 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.503827    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-tmp-dir\") pod \"7bbc6800-190b-410e-849a-ce665e6bf87d\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") "
Sep 11 21:51:02.503980 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.503867    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-dshm\") pod \"7bbc6800-190b-410e-849a-ce665e6bf87d\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") "
Sep 11 21:51:02.503980 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.503913    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bbc6800-190b-410e-849a-ce665e6bf87d-tls-certs\") pod \"7bbc6800-190b-410e-849a-ce665e6bf87d\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") "
Sep 11 21:51:02.503980 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.503976    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-home\") pod \"7bbc6800-190b-410e-849a-ce665e6bf87d\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") "
Sep 11 21:51:02.504147 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.504004    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-model-cache\") pod \"7bbc6800-190b-410e-849a-ce665e6bf87d\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") "
Sep 11 21:51:02.504147 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.504050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zhxk\" (UniqueName: \"kubernetes.io/projected/7bbc6800-190b-410e-849a-ce665e6bf87d-kube-api-access-9zhxk\") pod \"7bbc6800-190b-410e-849a-ce665e6bf87d\" (UID: \"7bbc6800-190b-410e-849a-ce665e6bf87d\") "
Sep 11 21:51:02.504669 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.504609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-home" (OuterVolumeSpecName: "home") pod "7bbc6800-190b-410e-849a-ce665e6bf87d" (UID: "7bbc6800-190b-410e-849a-ce665e6bf87d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:51:02.504966 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.504693    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7bbc6800-190b-410e-849a-ce665e6bf87d" (UID: "7bbc6800-190b-410e-849a-ce665e6bf87d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:51:02.505107 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.505079    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-model-cache" (OuterVolumeSpecName: "model-cache") pod "7bbc6800-190b-410e-849a-ce665e6bf87d" (UID: "7bbc6800-190b-410e-849a-ce665e6bf87d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:51:02.507067 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.507046    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bbc6800-190b-410e-849a-ce665e6bf87d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7bbc6800-190b-410e-849a-ce665e6bf87d" (UID: "7bbc6800-190b-410e-849a-ce665e6bf87d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:51:02.507208 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.507099    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-dshm" (OuterVolumeSpecName: "dshm") pod "7bbc6800-190b-410e-849a-ce665e6bf87d" (UID: "7bbc6800-190b-410e-849a-ce665e6bf87d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:51:02.507855 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.507832    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bbc6800-190b-410e-849a-ce665e6bf87d-kube-api-access-9zhxk" (OuterVolumeSpecName: "kube-api-access-9zhxk") pod "7bbc6800-190b-410e-849a-ce665e6bf87d" (UID: "7bbc6800-190b-410e-849a-ce665e6bf87d"). InnerVolumeSpecName "kube-api-access-9zhxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:51:02.605544 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.605500    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-tmp-dir\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:02.605544 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.605530    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-dshm\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:02.605544 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.605543    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bbc6800-190b-410e-849a-ce665e6bf87d-tls-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:02.605737 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.605555    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-home\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:02.605737 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.605566    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bbc6800-190b-410e-849a-ce665e6bf87d-model-cache\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:02.605737 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.605577    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zhxk\" (UniqueName: \"kubernetes.io/projected/7bbc6800-190b-410e-849a-ce665e6bf87d-kube-api-access-9zhxk\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:02.810197 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.810135    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"]
Sep 11 21:51:02.813374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:02.813352    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e919c5/test-model-e919c5-kserve-67b9b7585c-xx92v"]
Sep 11 21:51:03.762530 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:03.762500    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bbc6800-190b-410e-849a-ce665e6bf87d" path="/var/lib/kubelet/pods/7bbc6800-190b-410e-849a-ce665e6bf87d/volumes"
Sep 11 21:51:49.906800 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:49.906748    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"]
Sep 11 21:51:49.907643 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:49.907607    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l" podUID="841a675f-50b8-42d4-a015-efd6cae16c6a" containerName="maas-api" containerID="cri-o://6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b" gracePeriod=30
Sep 11 21:51:49.909240 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:51:49.908633    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-serving-cert: secret "maas-api-e2e-inf-b-7e6f5e-serving-cert" not found
Sep 11 21:51:49.909240 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:51:49.908725    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls podName:841a675f-50b8-42d4-a015-efd6cae16c6a nodeName:}" failed. No retries permitted until 2026-09-11 21:51:50.408685899 +0000 UTC m=+1265.066249656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls") pod "maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l" (UID: "841a675f-50b8-42d4-a015-efd6cae16c6a") : secret "maas-api-e2e-inf-b-7e6f5e-serving-cert" not found
Sep 11 21:51:50.181735 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.181713    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:51:50.233534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.215085    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj57r\" (UniqueName: \"kubernetes.io/projected/841a675f-50b8-42d4-a015-efd6cae16c6a-kube-api-access-qj57r\") pod \"841a675f-50b8-42d4-a015-efd6cae16c6a\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") "
Sep 11 21:51:50.233534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.215161    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a675f-50b8-42d4-a015-efd6cae16c6a-openshift-service-ca\") pod \"841a675f-50b8-42d4-a015-efd6cae16c6a\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") "
Sep 11 21:51:50.233534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.215244    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls\") pod \"841a675f-50b8-42d4-a015-efd6cae16c6a\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") "
Sep 11 21:51:50.233534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.215276    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-metrics-certs\") pod \"841a675f-50b8-42d4-a015-efd6cae16c6a\" (UID: \"841a675f-50b8-42d4-a015-efd6cae16c6a\") "
Sep 11 21:51:50.233534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.228647    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/841a675f-50b8-42d4-a015-efd6cae16c6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "841a675f-50b8-42d4-a015-efd6cae16c6a" (UID: "841a675f-50b8-42d4-a015-efd6cae16c6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:51:50.233534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.231822    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/841a675f-50b8-42d4-a015-efd6cae16c6a-kube-api-access-qj57r" (OuterVolumeSpecName: "kube-api-access-qj57r") pod "841a675f-50b8-42d4-a015-efd6cae16c6a" (UID: "841a675f-50b8-42d4-a015-efd6cae16c6a"). InnerVolumeSpecName "kube-api-access-qj57r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:51:50.234081 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.233573    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "841a675f-50b8-42d4-a015-efd6cae16c6a" (UID: "841a675f-50b8-42d4-a015-efd6cae16c6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:51:50.235886 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.235753    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "841a675f-50b8-42d4-a015-efd6cae16c6a" (UID: "841a675f-50b8-42d4-a015-efd6cae16c6a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:51:50.317177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.317141    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/841a675f-50b8-42d4-a015-efd6cae16c6a-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:50.317177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.317174    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:50.317177 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.317183    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/841a675f-50b8-42d4-a015-efd6cae16c6a-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:50.317485 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.317191    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj57r\" (UniqueName: \"kubernetes.io/projected/841a675f-50b8-42d4-a015-efd6cae16c6a-kube-api-access-qj57r\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:51:50.802253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.802221    2577 generic.go:356] "Generic (PLEG): container finished" podID="841a675f-50b8-42d4-a015-efd6cae16c6a" containerID="6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b" exitCode=0
Sep 11 21:51:50.802491 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.802284    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"
Sep 11 21:51:50.802491 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.802313    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l" event={"ID":"841a675f-50b8-42d4-a015-efd6cae16c6a","Type":"ContainerDied","Data":"6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b"}
Sep 11 21:51:50.802491 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.802375    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l" event={"ID":"841a675f-50b8-42d4-a015-efd6cae16c6a","Type":"ContainerDied","Data":"68f5da62da038b5f056ad6b6f34a8e4f38fb1c0920482fc389c476fe9be94735"}
Sep 11 21:51:50.802491 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.802405    2577 scope.go:117] "RemoveContainer" containerID="6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b"
Sep 11 21:51:50.814190 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.814175    2577 scope.go:117] "RemoveContainer" containerID="6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b"
Sep 11 21:51:50.814456 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:51:50.814438    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b\": container with ID starting with 6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b not found: ID does not exist" containerID="6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b"
Sep 11 21:51:50.814534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.814492    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b"} err="failed to get container status \"6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b\": rpc error: code = NotFound desc = could not find container \"6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b\": container with ID starting with 6919389445ca6f25869aaeb5ed5dc4202de44294ced81147e8279e693b04056b not found: ID does not exist"
Sep 11 21:51:50.827567 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.827547    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"]
Sep 11 21:51:50.831994 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:50.831975    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-7e6f5e-78b7c85b6c-ww82l"]
Sep 11 21:51:51.761382 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:51:51.761353    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="841a675f-50b8-42d4-a015-efd6cae16c6a" path="/var/lib/kubelet/pods/841a675f-50b8-42d4-a015-efd6cae16c6a/volumes"
Sep 11 21:52:05.272303 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.272268    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"]
Sep 11 21:52:05.273111 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.273081    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="841a675f-50b8-42d4-a015-efd6cae16c6a" containerName="maas-api"
Sep 11 21:52:05.273111 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.273109    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="841a675f-50b8-42d4-a015-efd6cae16c6a" containerName="maas-api"
Sep 11 21:52:05.273307 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.273129    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbc6800-190b-410e-849a-ce665e6bf87d" containerName="main"
Sep 11 21:52:05.273307 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.273137    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbc6800-190b-410e-849a-ce665e6bf87d" containerName="main"
Sep 11 21:52:05.273436 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.273319    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbc6800-190b-410e-849a-ce665e6bf87d" containerName="main"
Sep 11 21:52:05.273436 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.273341    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="841a675f-50b8-42d4-a015-efd6cae16c6a" containerName="maas-api"
Sep 11 21:52:05.278782 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.278762    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.281275 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.281255    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-7d7821-serving-cert\""
Sep 11 21:52:05.288755 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.288731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"]
Sep 11 21:52:05.366586 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.366553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.366740 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.366635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbzth\" (UniqueName: \"kubernetes.io/projected/caf9067e-0bc7-4258-9d04-8fed45528542-kube-api-access-lbzth\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.366740 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.366673    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.366813 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.366779    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf9067e-0bc7-4258-9d04-8fed45528542-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.467375 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.467342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf9067e-0bc7-4258-9d04-8fed45528542-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.467585 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.467417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.467585 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.467519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbzth\" (UniqueName: \"kubernetes.io/projected/caf9067e-0bc7-4258-9d04-8fed45528542-kube-api-access-lbzth\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.467585 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.467578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.467764 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:52:05.467725    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-serving-cert: secret "maas-api-e2e-shared-a-w3-7d7821-serving-cert" not found
Sep 11 21:52:05.467826 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:52:05.467789    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-maas-api-tls podName:caf9067e-0bc7-4258-9d04-8fed45528542 nodeName:}" failed. No retries permitted until 2026-09-11 21:52:05.967773912 +0000 UTC m=+1280.625337655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-maas-api-tls") pod "maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps" (UID: "caf9067e-0bc7-4258-9d04-8fed45528542") : secret "maas-api-e2e-shared-a-w3-7d7821-serving-cert" not found
Sep 11 21:52:05.468061 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.468042    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf9067e-0bc7-4258-9d04-8fed45528542-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.470035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.470015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.476792 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.476769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbzth\" (UniqueName: \"kubernetes.io/projected/caf9067e-0bc7-4258-9d04-8fed45528542-kube-api-access-lbzth\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.972226 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.972191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:05.974816 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:05.974791    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:06.193231 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:06.193199    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:06.482885 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:06.482862    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"]
Sep 11 21:52:06.484898 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:52:06.484867    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf9067e_0bc7_4258_9d04_8fed45528542.slice/crio-9b0d653d4a7aafe2dac61da43c012e804ff914f73261c2762cb934b4b3017805 WatchSource:0}: Error finding container 9b0d653d4a7aafe2dac61da43c012e804ff914f73261c2762cb934b4b3017805: Status 404 returned error can't find the container with id 9b0d653d4a7aafe2dac61da43c012e804ff914f73261c2762cb934b4b3017805
Sep 11 21:52:06.916616 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:06.916585    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps" event={"ID":"caf9067e-0bc7-4258-9d04-8fed45528542","Type":"ContainerStarted","Data":"9b0d653d4a7aafe2dac61da43c012e804ff914f73261c2762cb934b4b3017805"}
Sep 11 21:52:07.924721 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:07.924682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps" event={"ID":"caf9067e-0bc7-4258-9d04-8fed45528542","Type":"ContainerStarted","Data":"88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8"}
Sep 11 21:52:07.925109 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:07.924765    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:07.943289 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:07.943239    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps" podStartSLOduration=2.46987293 podStartE2EDuration="2.94322415s" totalImagesPullingTime="473.35122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:52:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:52:07.940890289 +0000 UTC m=+1282.598454054" watchObservedRunningTime="2026-09-11 21:52:07.94322415 +0000 UTC m=+1282.600787957"
Sep 11 21:52:13.938592 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:13.938550    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 21:52:39.804356 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:39.804320    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"]
Sep 11 21:52:39.808783 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:39.808761    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:39.811317 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:39.811298    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-4e0323-serving-cert\""
Sep 11 21:52:39.821423 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:39.821395    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"]
Sep 11 21:52:39.931391 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:39.931357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:39.931595 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:39.931415    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v27z\" (UniqueName: \"kubernetes.io/projected/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-kube-api-access-7v27z\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:39.931595 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:39.931523    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:39.931595 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:39.931564    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.033117 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.033081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.033314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.033151    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v27z\" (UniqueName: \"kubernetes.io/projected/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-kube-api-access-7v27z\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.033314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.033193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.033314 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.033218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.033945 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.033923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.035824 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.035793    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.035948 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.035925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.041719 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.041691    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v27z\" (UniqueName: \"kubernetes.io/projected/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-kube-api-access-7v27z\") pod \"maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.121199 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.121106    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:40.403422 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:40.403393    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"]
Sep 11 21:52:40.405077 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:52:40.405036    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c40eaf_b3f6_48c9_b15b_7d27dbdff376.slice/crio-bac304342841a66638f139eef6f0662fa9d8ad777ecc08ab4817363133179605 WatchSource:0}: Error finding container bac304342841a66638f139eef6f0662fa9d8ad777ecc08ab4817363133179605: Status 404 returned error can't find the container with id bac304342841a66638f139eef6f0662fa9d8ad777ecc08ab4817363133179605
Sep 11 21:52:41.177130 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:41.177084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n" event={"ID":"55c40eaf-b3f6-48c9-b15b-7d27dbdff376","Type":"ContainerStarted","Data":"810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc"}
Sep 11 21:52:41.177565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:41.177154    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n" event={"ID":"55c40eaf-b3f6-48c9-b15b-7d27dbdff376","Type":"ContainerStarted","Data":"bac304342841a66638f139eef6f0662fa9d8ad777ecc08ab4817363133179605"}
Sep 11 21:52:41.177565 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:41.177183    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:52:41.195425 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:41.195375    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n" podStartSLOduration=1.7026990199999998 podStartE2EDuration="2.195359023s" totalImagesPullingTime="492.660003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:52:41.194992724 +0000 UTC m=+1315.852556500" watchObservedRunningTime="2026-09-11 21:52:41.195359023 +0000 UTC m=+1315.852922786"
Sep 11 21:52:47.189032 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:52:47.188997    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 21:53:00.337374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.337340    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"]
Sep 11 21:53:00.337931 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.337619    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk" podUID="9676c361-f1b8-49c0-b77e-8b0339587ac1" containerName="maas-api" containerID="cri-o://a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c" gracePeriod=30
Sep 11 21:53:00.602201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.602148    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:53:00.669569 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.669531    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljgdz\" (UniqueName: \"kubernetes.io/projected/9676c361-f1b8-49c0-b77e-8b0339587ac1-kube-api-access-ljgdz\") pod \"9676c361-f1b8-49c0-b77e-8b0339587ac1\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") "
Sep 11 21:53:00.669760 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.669583    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-maas-api-tls\") pod \"9676c361-f1b8-49c0-b77e-8b0339587ac1\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") "
Sep 11 21:53:00.669760 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.669744    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-metrics-certs\") pod \"9676c361-f1b8-49c0-b77e-8b0339587ac1\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") "
Sep 11 21:53:00.669853 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.669774    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9676c361-f1b8-49c0-b77e-8b0339587ac1-openshift-service-ca\") pod \"9676c361-f1b8-49c0-b77e-8b0339587ac1\" (UID: \"9676c361-f1b8-49c0-b77e-8b0339587ac1\") "
Sep 11 21:53:00.670143 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.670118    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9676c361-f1b8-49c0-b77e-8b0339587ac1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9676c361-f1b8-49c0-b77e-8b0339587ac1" (UID: "9676c361-f1b8-49c0-b77e-8b0339587ac1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:53:00.670380 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.670249    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9676c361-f1b8-49c0-b77e-8b0339587ac1-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:53:00.671887 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.671863    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9676c361-f1b8-49c0-b77e-8b0339587ac1-kube-api-access-ljgdz" (OuterVolumeSpecName: "kube-api-access-ljgdz") pod "9676c361-f1b8-49c0-b77e-8b0339587ac1" (UID: "9676c361-f1b8-49c0-b77e-8b0339587ac1"). InnerVolumeSpecName "kube-api-access-ljgdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:53:00.671993 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.671901    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "9676c361-f1b8-49c0-b77e-8b0339587ac1" (UID: "9676c361-f1b8-49c0-b77e-8b0339587ac1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:53:00.672035 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.671992    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9676c361-f1b8-49c0-b77e-8b0339587ac1" (UID: "9676c361-f1b8-49c0-b77e-8b0339587ac1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:53:00.770964 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.770936    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:53:00.770964 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.770962    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljgdz\" (UniqueName: \"kubernetes.io/projected/9676c361-f1b8-49c0-b77e-8b0339587ac1-kube-api-access-ljgdz\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:53:00.770964 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:00.770972    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9676c361-f1b8-49c0-b77e-8b0339587ac1-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:53:01.314912 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.314881    2577 generic.go:356] "Generic (PLEG): container finished" podID="9676c361-f1b8-49c0-b77e-8b0339587ac1" containerID="a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c" exitCode=0
Sep 11 21:53:01.315080 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.314929    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"
Sep 11 21:53:01.315080 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.314947    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk" event={"ID":"9676c361-f1b8-49c0-b77e-8b0339587ac1","Type":"ContainerDied","Data":"a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c"}
Sep 11 21:53:01.315080 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.314995    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk" event={"ID":"9676c361-f1b8-49c0-b77e-8b0339587ac1","Type":"ContainerDied","Data":"0a8c1778266d48048122e3a5423b13600fcc8086c56fc4cbf98edfaf7b3ccc94"}
Sep 11 21:53:01.315080 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.315020    2577 scope.go:117] "RemoveContainer" containerID="a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c"
Sep 11 21:53:01.326281 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.326245    2577 scope.go:117] "RemoveContainer" containerID="a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c"
Sep 11 21:53:01.326573 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:53:01.326554    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c\": container with ID starting with a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c not found: ID does not exist" containerID="a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c"
Sep 11 21:53:01.326638 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.326582    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c"} err="failed to get container status \"a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c\": rpc error: code = NotFound desc = could not find container \"a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c\": container with ID starting with a50e56c4a6e8f9e2f39592110fe92b02bfd18c4b2fb8c72468a943e1f6601f5c not found: ID does not exist"
Sep 11 21:53:01.339414 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.339392    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"]
Sep 11 21:53:01.343266 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.343243    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9f68da5e-6f44996c56-mmsmk"]
Sep 11 21:53:01.761631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:53:01.761597    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9676c361-f1b8-49c0-b77e-8b0339587ac1" path="/var/lib/kubelet/pods/9676c361-f1b8-49c0-b77e-8b0339587ac1/volumes"
Sep 11 21:54:46.663375 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.663339    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"]
Sep 11 21:54:46.665931 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.663836    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9676c361-f1b8-49c0-b77e-8b0339587ac1" containerName="maas-api"
Sep 11 21:54:46.665931 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.663849    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9676c361-f1b8-49c0-b77e-8b0339587ac1" containerName="maas-api"
Sep 11 21:54:46.665931 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.663946    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9676c361-f1b8-49c0-b77e-8b0339587ac1" containerName="maas-api"
Sep 11 21:54:46.667043 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.667029    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.669895 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.669872    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-f12741\"/\"embedding-w0-f12741-kserve-self-signed-certs\""
Sep 11 21:54:46.676684 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.676663    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"]
Sep 11 21:54:46.855594 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.855560    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-model-cache\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.855764 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.855616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e905c221-d1f8-4109-843d-8b619e8c5683-tls-certs\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.855764 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.855706    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-home\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.855842 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.855815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-dshm\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.855889 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.855876    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-tmp-dir\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.855927 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.855895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpkzl\" (UniqueName: \"kubernetes.io/projected/e905c221-d1f8-4109-843d-8b619e8c5683-kube-api-access-dpkzl\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.956904 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.956872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-dshm\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.957087 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.956940    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-tmp-dir\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.957087 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.956957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpkzl\" (UniqueName: \"kubernetes.io/projected/e905c221-d1f8-4109-843d-8b619e8c5683-kube-api-access-dpkzl\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.957087 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.956977    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-model-cache\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.957087 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.957007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e905c221-d1f8-4109-843d-8b619e8c5683-tls-certs\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.957087 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.957047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-home\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.957385 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.957361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-model-cache\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.957452 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.957426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-tmp-dir\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.957608 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.957452    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-home\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.959364 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.959340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-dshm\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.959626 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.959611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e905c221-d1f8-4109-843d-8b619e8c5683-tls-certs\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.965740 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.965721    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpkzl\" (UniqueName: \"kubernetes.io/projected/e905c221-d1f8-4109-843d-8b619e8c5683-kube-api-access-dpkzl\") pod \"embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") " pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:46.977729 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:46.977710    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:47.260371 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:47.260344    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"]
Sep 11 21:54:47.262410 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:54:47.262387    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode905c221_d1f8_4109_843d_8b619e8c5683.slice/crio-f8146f0bf8e1116169d83ecd2008194e01125ea9a93d547d7b7e21de71823ed0 WatchSource:0}: Error finding container f8146f0bf8e1116169d83ecd2008194e01125ea9a93d547d7b7e21de71823ed0: Status 404 returned error can't find the container with id f8146f0bf8e1116169d83ecd2008194e01125ea9a93d547d7b7e21de71823ed0
Sep 11 21:54:48.002374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:48.002336    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6" event={"ID":"e905c221-d1f8-4109-843d-8b619e8c5683","Type":"ContainerStarted","Data":"7acd27b2efc9f694c2e4cf0860ac6146aaef17725c8254987ca519d94a567f12"}
Sep 11 21:54:48.002374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:48.002374    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6" event={"ID":"e905c221-d1f8-4109-843d-8b619e8c5683","Type":"ContainerStarted","Data":"f8146f0bf8e1116169d83ecd2008194e01125ea9a93d547d7b7e21de71823ed0"}
Sep 11 21:54:48.022555 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:48.022511    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6" podStartSLOduration=2.02249677 podStartE2EDuration="2.02249677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:54:48.019329549 +0000 UTC m=+1442.676893314" watchObservedRunningTime="2026-09-11 21:54:48.02249677 +0000 UTC m=+1442.680060531"
Sep 11 21:54:56.978538 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:56.978500    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:56.979111 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:56.978551    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:56.990723 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:56.990698    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:54:57.075457 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:54:57.075427    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:55:28.862697 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.862658    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"]
Sep 11 21:55:28.867478 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.867454    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.870147 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.870127    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-24efea-serving-cert\""
Sep 11 21:55:28.879200 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.879178    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"]
Sep 11 21:55:28.885232 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.885206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-metrics-certs\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.885390 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.885369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/286edee2-f3cb-4d4b-b144-7a3339d616e9-openshift-service-ca\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.885455 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.885418    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbpxr\" (UniqueName: \"kubernetes.io/projected/286edee2-f3cb-4d4b-b144-7a3339d616e9-kube-api-access-sbpxr\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.885538 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.885517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-maas-api-tls\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.986129 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.986093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/286edee2-f3cb-4d4b-b144-7a3339d616e9-openshift-service-ca\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.986311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.986148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbpxr\" (UniqueName: \"kubernetes.io/projected/286edee2-f3cb-4d4b-b144-7a3339d616e9-kube-api-access-sbpxr\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.986311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.986190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-maas-api-tls\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.986311 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.986252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-metrics-certs\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.986426 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:55:28.986380    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-serving-cert: secret "maas-api-e2e-api-b-24efea-serving-cert" not found
Sep 11 21:55:28.986462 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:55:28.986443    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-maas-api-tls podName:286edee2-f3cb-4d4b-b144-7a3339d616e9 nodeName:}" failed. No retries permitted until 2026-09-11 21:55:29.486428013 +0000 UTC m=+1484.143991771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-maas-api-tls") pod "maas-api-e2e-api-b-24efea-b9fff5867-ldsv2" (UID: "286edee2-f3cb-4d4b-b144-7a3339d616e9") : secret "maas-api-e2e-api-b-24efea-serving-cert" not found
Sep 11 21:55:28.986916 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.986895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/286edee2-f3cb-4d4b-b144-7a3339d616e9-openshift-service-ca\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.988928 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.988908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-metrics-certs\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:28.997271 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:28.997233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbpxr\" (UniqueName: \"kubernetes.io/projected/286edee2-f3cb-4d4b-b144-7a3339d616e9-kube-api-access-sbpxr\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:29.489981 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:29.489947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-maas-api-tls\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:29.492424 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:29.492399    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-maas-api-tls\") pod \"maas-api-e2e-api-b-24efea-b9fff5867-ldsv2\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:29.780426 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:29.780342    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:30.061016 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:30.060982    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"]
Sep 11 21:55:30.064452 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:55:30.064389    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod286edee2_f3cb_4d4b_b144_7a3339d616e9.slice/crio-040822fb88b61e8566480b1414c91c7a0ca11f535d5bde6937e7d1ec066cb9ac WatchSource:0}: Error finding container 040822fb88b61e8566480b1414c91c7a0ca11f535d5bde6937e7d1ec066cb9ac: Status 404 returned error can't find the container with id 040822fb88b61e8566480b1414c91c7a0ca11f535d5bde6937e7d1ec066cb9ac
Sep 11 21:55:30.065400 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:30.065381    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 21:55:30.280534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:30.280499    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2" event={"ID":"286edee2-f3cb-4d4b-b144-7a3339d616e9","Type":"ContainerStarted","Data":"040822fb88b61e8566480b1414c91c7a0ca11f535d5bde6937e7d1ec066cb9ac"}
Sep 11 21:55:31.288801 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:31.288706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2" event={"ID":"286edee2-f3cb-4d4b-b144-7a3339d616e9","Type":"ContainerStarted","Data":"471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12"}
Sep 11 21:55:31.289203 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:31.288810    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:31.308980 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:31.308935    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2" podStartSLOduration=2.878482191 podStartE2EDuration="3.30892099s" totalImagesPullingTime="430.438799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:55:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:55:31.30763223 +0000 UTC m=+1485.965195995" watchObservedRunningTime="2026-09-11 21:55:31.30892099 +0000 UTC m=+1485.966484750"
Sep 11 21:55:31.487769 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:31.487736    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm" podUID="4597f207-acb0-4742-a559-4c0eccc3c236" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.53:8081/readyz\": dial tcp 10.134.0.53:8081: connect: connection refused"
Sep 11 21:55:32.296347 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:32.296312    2577 generic.go:356] "Generic (PLEG): container finished" podID="4597f207-acb0-4742-a559-4c0eccc3c236" containerID="89a17f1a29dcf8d8be17ffc1b20633e9785363fea088be4908a523633dbb5f57" exitCode=137
Sep 11 21:55:32.296740 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:32.296381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm" event={"ID":"4597f207-acb0-4742-a559-4c0eccc3c236","Type":"ContainerDied","Data":"89a17f1a29dcf8d8be17ffc1b20633e9785363fea088be4908a523633dbb5f57"}
Sep 11 21:55:32.296836 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:32.296813    2577 scope.go:117] "RemoveContainer" containerID="89a17f1a29dcf8d8be17ffc1b20633e9785363fea088be4908a523633dbb5f57"
Sep 11 21:55:33.305923 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:33.305871    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm" event={"ID":"4597f207-acb0-4742-a559-4c0eccc3c236","Type":"ContainerStarted","Data":"630d3285c0367800f6a4ce2ce87560881354123065e80bfe8ca068e3a66e1d5c"}
Sep 11 21:55:33.306401 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:33.306127    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:55:37.302428 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:37.302401    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:55:44.315524 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:44.315495    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 21:55:45.916350 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:45.916322    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:55:45.919583 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:55:45.919561    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 21:56:32.612784 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:32.612746    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"]
Sep 11 21:56:32.622703 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:32.622429    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"]
Sep 11 21:56:35.812156 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:35.812123    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"]
Sep 11 21:56:35.813088 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:35.813058    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2" podUID="286edee2-f3cb-4d4b-b144-7a3339d616e9" containerName="maas-api" containerID="cri-o://471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12" gracePeriod=30
Sep 11 21:56:36.070486 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.070411    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:56:36.165842 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.165806    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-maas-api-tls\") pod \"286edee2-f3cb-4d4b-b144-7a3339d616e9\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") "
Sep 11 21:56:36.166041 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.165865    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbpxr\" (UniqueName: \"kubernetes.io/projected/286edee2-f3cb-4d4b-b144-7a3339d616e9-kube-api-access-sbpxr\") pod \"286edee2-f3cb-4d4b-b144-7a3339d616e9\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") "
Sep 11 21:56:36.166041 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.165887    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/286edee2-f3cb-4d4b-b144-7a3339d616e9-openshift-service-ca\") pod \"286edee2-f3cb-4d4b-b144-7a3339d616e9\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") "
Sep 11 21:56:36.166041 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.165944    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-metrics-certs\") pod \"286edee2-f3cb-4d4b-b144-7a3339d616e9\" (UID: \"286edee2-f3cb-4d4b-b144-7a3339d616e9\") "
Sep 11 21:56:36.166335 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.166308    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/286edee2-f3cb-4d4b-b144-7a3339d616e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "286edee2-f3cb-4d4b-b144-7a3339d616e9" (UID: "286edee2-f3cb-4d4b-b144-7a3339d616e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:56:36.168089 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.168065    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "286edee2-f3cb-4d4b-b144-7a3339d616e9" (UID: "286edee2-f3cb-4d4b-b144-7a3339d616e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:56:36.168203 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.168181    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "286edee2-f3cb-4d4b-b144-7a3339d616e9" (UID: "286edee2-f3cb-4d4b-b144-7a3339d616e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:56:36.168251 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.168210    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/286edee2-f3cb-4d4b-b144-7a3339d616e9-kube-api-access-sbpxr" (OuterVolumeSpecName: "kube-api-access-sbpxr") pod "286edee2-f3cb-4d4b-b144-7a3339d616e9" (UID: "286edee2-f3cb-4d4b-b144-7a3339d616e9"). InnerVolumeSpecName "kube-api-access-sbpxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:56:36.267593 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.267567    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:36.267593 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.267590    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbpxr\" (UniqueName: \"kubernetes.io/projected/286edee2-f3cb-4d4b-b144-7a3339d616e9-kube-api-access-sbpxr\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:36.267593 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.267598    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/286edee2-f3cb-4d4b-b144-7a3339d616e9-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:36.267826 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.267607    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/286edee2-f3cb-4d4b-b144-7a3339d616e9-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:36.743727 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.743695    2577 generic.go:356] "Generic (PLEG): container finished" podID="286edee2-f3cb-4d4b-b144-7a3339d616e9" containerID="471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12" exitCode=0
Sep 11 21:56:36.743926 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.743742    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"
Sep 11 21:56:36.743926 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.743781    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2" event={"ID":"286edee2-f3cb-4d4b-b144-7a3339d616e9","Type":"ContainerDied","Data":"471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12"}
Sep 11 21:56:36.743926 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.743835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2" event={"ID":"286edee2-f3cb-4d4b-b144-7a3339d616e9","Type":"ContainerDied","Data":"040822fb88b61e8566480b1414c91c7a0ca11f535d5bde6937e7d1ec066cb9ac"}
Sep 11 21:56:36.743926 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.743856    2577 scope.go:117] "RemoveContainer" containerID="471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12"
Sep 11 21:56:36.755005 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.754988    2577 scope.go:117] "RemoveContainer" containerID="471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12"
Sep 11 21:56:36.755285 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:56:36.755265    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12\": container with ID starting with 471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12 not found: ID does not exist" containerID="471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12"
Sep 11 21:56:36.755359 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.755296    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12"} err="failed to get container status \"471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12\": rpc error: code = NotFound desc = could not find container \"471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12\": container with ID starting with 471a1594e7b3d0609777bd324f32834f352ecca4bf325815d31ea7671ee33a12 not found: ID does not exist"
Sep 11 21:56:36.771331 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.771299    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"]
Sep 11 21:56:36.774715 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:36.774691    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-24efea-b9fff5867-ldsv2"]
Sep 11 21:56:37.763123 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:37.763079    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="286edee2-f3cb-4d4b-b144-7a3339d616e9" path="/var/lib/kubelet/pods/286edee2-f3cb-4d4b-b144-7a3339d616e9/volumes"
Sep 11 21:56:45.248003 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.247961    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"]
Sep 11 21:56:45.248646 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.248250    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42" podUID="f0c39023-7b08-42dc-89f8-5a59d061b854" containerName="maas-api" containerID="cri-o://85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557" gracePeriod=30
Sep 11 21:56:45.379899 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.379837    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42" podUID="f0c39023-7b08-42dc-89f8-5a59d061b854" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.67:8443/health\": dial tcp 10.134.0.67:8443: connect: connection refused"
Sep 11 21:56:45.516741 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.516676    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:56:45.668535 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.668497    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqfht\" (UniqueName: \"kubernetes.io/projected/f0c39023-7b08-42dc-89f8-5a59d061b854-kube-api-access-gqfht\") pod \"f0c39023-7b08-42dc-89f8-5a59d061b854\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") "
Sep 11 21:56:45.668771 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.668572    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-maas-api-tls\") pod \"f0c39023-7b08-42dc-89f8-5a59d061b854\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") "
Sep 11 21:56:45.668771 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.668653    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-metrics-certs\") pod \"f0c39023-7b08-42dc-89f8-5a59d061b854\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") "
Sep 11 21:56:45.668771 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.668739    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0c39023-7b08-42dc-89f8-5a59d061b854-openshift-service-ca\") pod \"f0c39023-7b08-42dc-89f8-5a59d061b854\" (UID: \"f0c39023-7b08-42dc-89f8-5a59d061b854\") "
Sep 11 21:56:45.669124 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.669095    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0c39023-7b08-42dc-89f8-5a59d061b854-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f0c39023-7b08-42dc-89f8-5a59d061b854" (UID: "f0c39023-7b08-42dc-89f8-5a59d061b854"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:56:45.670963 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.670936    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0c39023-7b08-42dc-89f8-5a59d061b854-kube-api-access-gqfht" (OuterVolumeSpecName: "kube-api-access-gqfht") pod "f0c39023-7b08-42dc-89f8-5a59d061b854" (UID: "f0c39023-7b08-42dc-89f8-5a59d061b854"). InnerVolumeSpecName "kube-api-access-gqfht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:56:45.671401 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.671378    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f0c39023-7b08-42dc-89f8-5a59d061b854" (UID: "f0c39023-7b08-42dc-89f8-5a59d061b854"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:56:45.671516 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.671399    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f0c39023-7b08-42dc-89f8-5a59d061b854" (UID: "f0c39023-7b08-42dc-89f8-5a59d061b854"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:56:45.769913 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.769888    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:45.770031 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.769919    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0c39023-7b08-42dc-89f8-5a59d061b854-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:45.770031 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.769931    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f0c39023-7b08-42dc-89f8-5a59d061b854-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:45.770031 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.769939    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqfht\" (UniqueName: \"kubernetes.io/projected/f0c39023-7b08-42dc-89f8-5a59d061b854-kube-api-access-gqfht\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:45.809630 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.809600    2577 generic.go:356] "Generic (PLEG): container finished" podID="f0c39023-7b08-42dc-89f8-5a59d061b854" containerID="85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557" exitCode=0
Sep 11 21:56:45.809811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.809637    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42" event={"ID":"f0c39023-7b08-42dc-89f8-5a59d061b854","Type":"ContainerDied","Data":"85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557"}
Sep 11 21:56:45.809811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.809640    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"
Sep 11 21:56:45.809811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.809677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42" event={"ID":"f0c39023-7b08-42dc-89f8-5a59d061b854","Type":"ContainerDied","Data":"0bd620f23d2d92316b6af7e7f5a4888b8f35fe0dd42df48cc15f3780af82d7f7"}
Sep 11 21:56:45.809811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.809705    2577 scope.go:117] "RemoveContainer" containerID="85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557"
Sep 11 21:56:45.819860 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.819841    2577 scope.go:117] "RemoveContainer" containerID="85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557"
Sep 11 21:56:45.820135 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:56:45.820116    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557\": container with ID starting with 85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557 not found: ID does not exist" containerID="85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557"
Sep 11 21:56:45.820199 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.820144    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557"} err="failed to get container status \"85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557\": rpc error: code = NotFound desc = could not find container \"85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557\": container with ID starting with 85481f7006a4edb43d0f0a284a3c66d8309e53e3b58638d464b1f29b67425557 not found: ID does not exist"
Sep 11 21:56:45.828808 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.828786    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"]
Sep 11 21:56:45.833559 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:45.833539    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w0-f12741-69f69c79d8-vmj42"]
Sep 11 21:56:47.635536 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.635465    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4" podUID="7f692355-6dc2-4829-9cb5-a9d84601cc09" containerName="main" containerID="cri-o://fb3eb20dc0a5ab0791e994fbc49c495793d906aa70d3068f8de83b272635273f" gracePeriod=45
Sep 11 21:56:47.643847 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.643801    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6" podUID="e905c221-d1f8-4109-843d-8b619e8c5683" containerName="main" containerID="cri-o://7acd27b2efc9f694c2e4cf0860ac6146aaef17725c8254987ca519d94a567f12" gracePeriod=45
Sep 11 21:56:47.771992 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.771956    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0c39023-7b08-42dc-89f8-5a59d061b854" path="/var/lib/kubelet/pods/f0c39023-7b08-42dc-89f8-5a59d061b854/volumes"
Sep 11 21:56:47.829187 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.828999    2577 generic.go:356] "Generic (PLEG): container finished" podID="e905c221-d1f8-4109-843d-8b619e8c5683" containerID="7acd27b2efc9f694c2e4cf0860ac6146aaef17725c8254987ca519d94a567f12" exitCode=0
Sep 11 21:56:47.829187 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.829041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6" event={"ID":"e905c221-d1f8-4109-843d-8b619e8c5683","Type":"ContainerDied","Data":"7acd27b2efc9f694c2e4cf0860ac6146aaef17725c8254987ca519d94a567f12"}
Sep 11 21:56:47.831061 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.831041    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f692355-6dc2-4829-9cb5-a9d84601cc09" containerID="fb3eb20dc0a5ab0791e994fbc49c495793d906aa70d3068f8de83b272635273f" exitCode=0
Sep 11 21:56:47.831202 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.831139    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4" event={"ID":"7f692355-6dc2-4829-9cb5-a9d84601cc09","Type":"ContainerDied","Data":"fb3eb20dc0a5ab0791e994fbc49c495793d906aa70d3068f8de83b272635273f"}
Sep 11 21:56:47.942681 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.942654    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:56:47.946348 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.946329    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:56:47.990558 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990529    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mfjq\" (UniqueName: \"kubernetes.io/projected/7f692355-6dc2-4829-9cb5-a9d84601cc09-kube-api-access-5mfjq\") pod \"7f692355-6dc2-4829-9cb5-a9d84601cc09\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") "
Sep 11 21:56:47.990717 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990580    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-model-cache\") pod \"e905c221-d1f8-4109-843d-8b619e8c5683\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") "
Sep 11 21:56:47.990717 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990616    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-home\") pod \"e905c221-d1f8-4109-843d-8b619e8c5683\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") "
Sep 11 21:56:47.990829 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990741    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-model-cache\") pod \"7f692355-6dc2-4829-9cb5-a9d84601cc09\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") "
Sep 11 21:56:47.990829 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990809    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-tmp-dir\") pod \"e905c221-d1f8-4109-843d-8b619e8c5683\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") "
Sep 11 21:56:47.990937 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990851    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dpkzl\" (UniqueName: \"kubernetes.io/projected/e905c221-d1f8-4109-843d-8b619e8c5683-kube-api-access-dpkzl\") pod \"e905c221-d1f8-4109-843d-8b619e8c5683\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") "
Sep 11 21:56:47.990937 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990887    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-dshm\") pod \"7f692355-6dc2-4829-9cb5-a9d84601cc09\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") "
Sep 11 21:56:47.990937 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990909    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-home" (OuterVolumeSpecName: "home") pod "e905c221-d1f8-4109-843d-8b619e8c5683" (UID: "e905c221-d1f8-4109-843d-8b619e8c5683"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:47.990937 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990922    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-model-cache" (OuterVolumeSpecName: "model-cache") pod "e905c221-d1f8-4109-843d-8b619e8c5683" (UID: "e905c221-d1f8-4109-843d-8b619e8c5683"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:47.991210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990933    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e905c221-d1f8-4109-843d-8b619e8c5683-tls-certs\") pod \"e905c221-d1f8-4109-843d-8b619e8c5683\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") "
Sep 11 21:56:47.991210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.990981    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-home\") pod \"7f692355-6dc2-4829-9cb5-a9d84601cc09\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") "
Sep 11 21:56:47.991210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991048    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-model-cache" (OuterVolumeSpecName: "model-cache") pod "7f692355-6dc2-4829-9cb5-a9d84601cc09" (UID: "7f692355-6dc2-4829-9cb5-a9d84601cc09"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:47.991210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991084    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f692355-6dc2-4829-9cb5-a9d84601cc09-tls-certs\") pod \"7f692355-6dc2-4829-9cb5-a9d84601cc09\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") "
Sep 11 21:56:47.991210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991109    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-tmp-dir\") pod \"7f692355-6dc2-4829-9cb5-a9d84601cc09\" (UID: \"7f692355-6dc2-4829-9cb5-a9d84601cc09\") "
Sep 11 21:56:47.991210 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991180    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-dshm\") pod \"e905c221-d1f8-4109-843d-8b619e8c5683\" (UID: \"e905c221-d1f8-4109-843d-8b619e8c5683\") "
Sep 11 21:56:47.991572 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991413    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e905c221-d1f8-4109-843d-8b619e8c5683" (UID: "e905c221-d1f8-4109-843d-8b619e8c5683"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:47.991726 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991702    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-model-cache\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:47.991884 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991869    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-home\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:47.991986 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991974    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-model-cache\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:47.992098 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.992087    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-tmp-dir\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:47.992194 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991738    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7f692355-6dc2-4829-9cb5-a9d84601cc09" (UID: "7f692355-6dc2-4829-9cb5-a9d84601cc09"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:47.992303 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.991984    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-home" (OuterVolumeSpecName: "home") pod "7f692355-6dc2-4829-9cb5-a9d84601cc09" (UID: "7f692355-6dc2-4829-9cb5-a9d84601cc09"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:47.993748 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.993714    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f692355-6dc2-4829-9cb5-a9d84601cc09-kube-api-access-5mfjq" (OuterVolumeSpecName: "kube-api-access-5mfjq") pod "7f692355-6dc2-4829-9cb5-a9d84601cc09" (UID: "7f692355-6dc2-4829-9cb5-a9d84601cc09"). InnerVolumeSpecName "kube-api-access-5mfjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:56:47.994800 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.994583    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-dshm" (OuterVolumeSpecName: "dshm") pod "e905c221-d1f8-4109-843d-8b619e8c5683" (UID: "e905c221-d1f8-4109-843d-8b619e8c5683"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:47.994800 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.994637    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e905c221-d1f8-4109-843d-8b619e8c5683-kube-api-access-dpkzl" (OuterVolumeSpecName: "kube-api-access-dpkzl") pod "e905c221-d1f8-4109-843d-8b619e8c5683" (UID: "e905c221-d1f8-4109-843d-8b619e8c5683"). InnerVolumeSpecName "kube-api-access-dpkzl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:56:47.994800 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.994749    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f692355-6dc2-4829-9cb5-a9d84601cc09-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7f692355-6dc2-4829-9cb5-a9d84601cc09" (UID: "7f692355-6dc2-4829-9cb5-a9d84601cc09"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:56:47.995181 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.994803    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-dshm" (OuterVolumeSpecName: "dshm") pod "7f692355-6dc2-4829-9cb5-a9d84601cc09" (UID: "7f692355-6dc2-4829-9cb5-a9d84601cc09"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:47.995181 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:47.994822    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e905c221-d1f8-4109-843d-8b619e8c5683-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e905c221-d1f8-4109-843d-8b619e8c5683" (UID: "e905c221-d1f8-4109-843d-8b619e8c5683"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:56:48.092982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.092940    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mfjq\" (UniqueName: \"kubernetes.io/projected/7f692355-6dc2-4829-9cb5-a9d84601cc09-kube-api-access-5mfjq\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:48.092982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.092977    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpkzl\" (UniqueName: \"kubernetes.io/projected/e905c221-d1f8-4109-843d-8b619e8c5683-kube-api-access-dpkzl\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:48.092982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.092986    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-dshm\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:48.092982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.092995    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e905c221-d1f8-4109-843d-8b619e8c5683-tls-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:48.093245 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.093003    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-home\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:48.093245 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.093011    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f692355-6dc2-4829-9cb5-a9d84601cc09-tls-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:48.093245 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.093018    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f692355-6dc2-4829-9cb5-a9d84601cc09-tmp-dir\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:48.093245 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.093025    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e905c221-d1f8-4109-843d-8b619e8c5683-dshm\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:48.839736 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.839699    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"
Sep 11 21:56:48.839736 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.839718    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6" event={"ID":"e905c221-d1f8-4109-843d-8b619e8c5683","Type":"ContainerDied","Data":"f8146f0bf8e1116169d83ecd2008194e01125ea9a93d547d7b7e21de71823ed0"}
Sep 11 21:56:48.840284 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.839772    2577 scope.go:117] "RemoveContainer" containerID="7acd27b2efc9f694c2e4cf0860ac6146aaef17725c8254987ca519d94a567f12"
Sep 11 21:56:48.841538 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.841505    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4" event={"ID":"7f692355-6dc2-4829-9cb5-a9d84601cc09","Type":"ContainerDied","Data":"fbace5d7a38064668a91f2f7007430a654e7057f34c959e9f9d82e7bf02671fe"}
Sep 11 21:56:48.841538 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.841531    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"
Sep 11 21:56:48.851196 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.851178    2577 scope.go:117] "RemoveContainer" containerID="fb3eb20dc0a5ab0791e994fbc49c495793d906aa70d3068f8de83b272635273f"
Sep 11 21:56:48.873886 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.873863    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"]
Sep 11 21:56:48.881567 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.881544    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/embedding-w0-f12741-kserve-57fc8dbc9f-jkpq6"]
Sep 11 21:56:48.891801 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.891780    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"]
Sep 11 21:56:48.898736 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:48.898715    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-f12741/distinct-w0-f12741-kserve-5d9987946-hbvx4"]
Sep 11 21:56:49.762856 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:49.762827    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f692355-6dc2-4829-9cb5-a9d84601cc09" path="/var/lib/kubelet/pods/7f692355-6dc2-4829-9cb5-a9d84601cc09/volumes"
Sep 11 21:56:49.763278 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:49.763260    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e905c221-d1f8-4109-843d-8b619e8c5683" path="/var/lib/kubelet/pods/e905c221-d1f8-4109-843d-8b619e8c5683/volumes"
Sep 11 21:56:52.221114 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:52.221074    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"]
Sep 11 21:56:52.221625 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:52.221344    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy" containerID="cri-o://70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e" gracePeriod=30
Sep 11 21:56:55.311503 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:55.311450    2577 patch_prober.go:28] interesting pod/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 21:56:55.311902 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:55.311520    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 21:56:57.472962 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.472928    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:56:57.586646 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586566    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-certs\") pod \"3095797f-510f-4081-938d-eef8cec363d8\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") "
Sep 11 21:56:57.586646 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586641    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-data\") pod \"3095797f-510f-4081-938d-eef8cec363d8\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") "
Sep 11 21:56:57.586845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586680    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-socket\") pod \"3095797f-510f-4081-938d-eef8cec363d8\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") "
Sep 11 21:56:57.586845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586711    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3095797f-510f-4081-938d-eef8cec363d8-istio-podinfo\") pod \"3095797f-510f-4081-938d-eef8cec363d8\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") "
Sep 11 21:56:57.586845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586746    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-envoy\") pod \"3095797f-510f-4081-938d-eef8cec363d8\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") "
Sep 11 21:56:57.586845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586784    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3095797f-510f-4081-938d-eef8cec363d8-istiod-ca-cert\") pod \"3095797f-510f-4081-938d-eef8cec363d8\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") "
Sep 11 21:56:57.586845 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586833    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-istio-token\") pod \"3095797f-510f-4081-938d-eef8cec363d8\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") "
Sep 11 21:56:57.587094 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586866    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-credential-socket\") pod \"3095797f-510f-4081-938d-eef8cec363d8\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") "
Sep 11 21:56:57.587094 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586845    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3095797f-510f-4081-938d-eef8cec363d8" (UID: "3095797f-510f-4081-938d-eef8cec363d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:57.587094 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586909    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92hmq\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-kube-api-access-92hmq\") pod \"3095797f-510f-4081-938d-eef8cec363d8\" (UID: \"3095797f-510f-4081-938d-eef8cec363d8\") "
Sep 11 21:56:57.587094 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586921    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "3095797f-510f-4081-938d-eef8cec363d8" (UID: "3095797f-510f-4081-938d-eef8cec363d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:57.587094 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.586974    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3095797f-510f-4081-938d-eef8cec363d8" (UID: "3095797f-510f-4081-938d-eef8cec363d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:57.587363 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.587113    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3095797f-510f-4081-938d-eef8cec363d8" (UID: "3095797f-510f-4081-938d-eef8cec363d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:57.587427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.587352    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3095797f-510f-4081-938d-eef8cec363d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3095797f-510f-4081-938d-eef8cec363d8" (UID: "3095797f-510f-4081-938d-eef8cec363d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:56:57.587427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.587368    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:57.587427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.587390    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-credential-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:57.587427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.587408    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-workload-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:57.587427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.587421    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-data\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:57.589170 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.589147    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-kube-api-access-92hmq" (OuterVolumeSpecName: "kube-api-access-92hmq") pod "3095797f-510f-4081-938d-eef8cec363d8" (UID: "3095797f-510f-4081-938d-eef8cec363d8"). InnerVolumeSpecName "kube-api-access-92hmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:56:57.589170 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.589159    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3095797f-510f-4081-938d-eef8cec363d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3095797f-510f-4081-938d-eef8cec363d8" (UID: "3095797f-510f-4081-938d-eef8cec363d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:56:57.589631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.589615    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "3095797f-510f-4081-938d-eef8cec363d8" (UID: "3095797f-510f-4081-938d-eef8cec363d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:56:57.589682 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.589657    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3095797f-510f-4081-938d-eef8cec363d8" (UID: "3095797f-510f-4081-938d-eef8cec363d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:56:57.688990 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.688952    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-istio-token\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:57.688990 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.688986    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92hmq\" (UniqueName: \"kubernetes.io/projected/3095797f-510f-4081-938d-eef8cec363d8-kube-api-access-92hmq\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:57.689171 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.689003    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3095797f-510f-4081-938d-eef8cec363d8-istio-podinfo\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:57.689171 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.689014    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3095797f-510f-4081-938d-eef8cec363d8-istio-envoy\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:57.689171 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.689025    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3095797f-510f-4081-938d-eef8cec363d8-istiod-ca-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:56:57.915002 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.914969    2577 generic.go:356] "Generic (PLEG): container finished" podID="3095797f-510f-4081-938d-eef8cec363d8" containerID="70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e" exitCode=0
Sep 11 21:56:57.915159 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.915026    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"
Sep 11 21:56:57.915159 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.915068    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" event={"ID":"3095797f-510f-4081-938d-eef8cec363d8","Type":"ContainerDied","Data":"70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e"}
Sep 11 21:56:57.915159 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.915132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn" event={"ID":"3095797f-510f-4081-938d-eef8cec363d8","Type":"ContainerDied","Data":"f9539f75f89018b58ee3939c1196513a79de25fa1b73c8733411a087ef010835"}
Sep 11 21:56:57.915159 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.915156    2577 scope.go:117] "RemoveContainer" containerID="70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e"
Sep 11 21:56:57.925124 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.925107    2577 scope.go:117] "RemoveContainer" containerID="48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903"
Sep 11 21:56:57.933971 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.933950    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"]
Sep 11 21:56:57.935678 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.935660    2577 scope.go:117] "RemoveContainer" containerID="70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e"
Sep 11 21:56:57.936000 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:56:57.935977    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e\": container with ID starting with 70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e not found: ID does not exist" containerID="70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e"
Sep 11 21:56:57.936095 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.936008    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e"} err="failed to get container status \"70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e\": rpc error: code = NotFound desc = could not find container \"70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e\": container with ID starting with 70ea9b61592c4012270b74c427a72368a09c731c290f0fd5b8ad6e28cb0b546e not found: ID does not exist"
Sep 11 21:56:57.936095 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.936025    2577 scope.go:117] "RemoveContainer" containerID="48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903"
Sep 11 21:56:57.936301 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:56:57.936285    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903\": container with ID starting with 48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903 not found: ID does not exist" containerID="48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903"
Sep 11 21:56:57.936370 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.936306    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903"} err="failed to get container status \"48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903\": rpc error: code = NotFound desc = could not find container \"48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903\": container with ID starting with 48a787b58d869e6df43110103a3dafe740bfcf0dd9d70d8ab35026a0555a2903 not found: ID does not exist"
Sep 11 21:56:57.938782 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:57.938760    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f12741-openshift-default-656cd87cbb-nt9gn"]
Sep 11 21:56:59.762678 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:56:59.762646    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3095797f-510f-4081-938d-eef8cec363d8" path="/var/lib/kubelet/pods/3095797f-510f-4081-938d-eef8cec363d8/volumes"
Sep 11 21:57:00.873373 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:00.873341    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"]
Sep 11 21:57:00.873860 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:00.873643    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy" containerID="cri-o://22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b" gracePeriod=30
Sep 11 21:57:06.122636 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.122610    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:57:06.177003 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.176978    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-token\") pod \"c98dd113-5eac-49ed-b741-d6d66a01beb4\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") "
Sep 11 21:57:06.177164 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177018    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-certs\") pod \"c98dd113-5eac-49ed-b741-d6d66a01beb4\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") "
Sep 11 21:57:06.177164 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177048    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-envoy\") pod \"c98dd113-5eac-49ed-b741-d6d66a01beb4\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") "
Sep 11 21:57:06.177164 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177072    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-podinfo\") pod \"c98dd113-5eac-49ed-b741-d6d66a01beb4\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") "
Sep 11 21:57:06.177164 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177117    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hcst\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-kube-api-access-7hcst\") pod \"c98dd113-5eac-49ed-b741-d6d66a01beb4\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") "
Sep 11 21:57:06.177370 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177270    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-socket\") pod \"c98dd113-5eac-49ed-b741-d6d66a01beb4\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") "
Sep 11 21:57:06.177370 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177287    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c98dd113-5eac-49ed-b741-d6d66a01beb4" (UID: "c98dd113-5eac-49ed-b741-d6d66a01beb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:57:06.177370 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177309    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-data\") pod \"c98dd113-5eac-49ed-b741-d6d66a01beb4\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") "
Sep 11 21:57:06.177561 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177358    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-credential-socket\") pod \"c98dd113-5eac-49ed-b741-d6d66a01beb4\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") "
Sep 11 21:57:06.177561 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177409    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98dd113-5eac-49ed-b741-d6d66a01beb4-istiod-ca-cert\") pod \"c98dd113-5eac-49ed-b741-d6d66a01beb4\" (UID: \"c98dd113-5eac-49ed-b741-d6d66a01beb4\") "
Sep 11 21:57:06.177561 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177547    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c98dd113-5eac-49ed-b741-d6d66a01beb4" (UID: "c98dd113-5eac-49ed-b741-d6d66a01beb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:57:06.177782 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177579    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "c98dd113-5eac-49ed-b741-d6d66a01beb4" (UID: "c98dd113-5eac-49ed-b741-d6d66a01beb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:57:06.177782 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177699    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c98dd113-5eac-49ed-b741-d6d66a01beb4" (UID: "c98dd113-5eac-49ed-b741-d6d66a01beb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:57:06.177871 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.177790    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c98dd113-5eac-49ed-b741-d6d66a01beb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c98dd113-5eac-49ed-b741-d6d66a01beb4" (UID: "c98dd113-5eac-49ed-b741-d6d66a01beb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:57:06.178164 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.178142    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:06.178201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.178171    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-data\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:06.178201 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.178186    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-credential-socket\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:06.178265 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.178200    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c98dd113-5eac-49ed-b741-d6d66a01beb4-istiod-ca-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:06.178265 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.178213    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-workload-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:06.179426 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.179400    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c98dd113-5eac-49ed-b741-d6d66a01beb4" (UID: "c98dd113-5eac-49ed-b741-d6d66a01beb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 21:57:06.179543 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.179447    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-kube-api-access-7hcst" (OuterVolumeSpecName: "kube-api-access-7hcst") pod "c98dd113-5eac-49ed-b741-d6d66a01beb4" (UID: "c98dd113-5eac-49ed-b741-d6d66a01beb4"). InnerVolumeSpecName "kube-api-access-7hcst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:57:06.179804 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.179786    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c98dd113-5eac-49ed-b741-d6d66a01beb4" (UID: "c98dd113-5eac-49ed-b741-d6d66a01beb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 21:57:06.180083 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.180068    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "c98dd113-5eac-49ed-b741-d6d66a01beb4" (UID: "c98dd113-5eac-49ed-b741-d6d66a01beb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:57:06.279538 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.279510    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-token\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:06.279538 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.279538    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-envoy\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:06.279538 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.279547    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c98dd113-5eac-49ed-b741-d6d66a01beb4-istio-podinfo\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:06.279760 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.279560    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hcst\" (UniqueName: \"kubernetes.io/projected/c98dd113-5eac-49ed-b741-d6d66a01beb4-kube-api-access-7hcst\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:06.977611 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.977574    2577 generic.go:356] "Generic (PLEG): container finished" podID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerID="22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b" exitCode=0
Sep 11 21:57:06.977777 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.977618    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"
Sep 11 21:57:06.977777 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.977661    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" event={"ID":"c98dd113-5eac-49ed-b741-d6d66a01beb4","Type":"ContainerDied","Data":"22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b"}
Sep 11 21:57:06.977777 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.977714    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn" event={"ID":"c98dd113-5eac-49ed-b741-d6d66a01beb4","Type":"ContainerDied","Data":"6e71ea98ce06c13dca9fc782b70de8b2c9bb7b4afdbc4c56d493a4c2a3e13baa"}
Sep 11 21:57:06.977777 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.977739    2577 scope.go:117] "RemoveContainer" containerID="22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b"
Sep 11 21:57:06.987840 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.987824    2577 scope.go:117] "RemoveContainer" containerID="9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709"
Sep 11 21:57:06.996441 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.996285    2577 scope.go:117] "RemoveContainer" containerID="22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b"
Sep 11 21:57:06.996594 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:57:06.996576    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b\": container with ID starting with 22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b not found: ID does not exist" containerID="22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b"
Sep 11 21:57:06.996635 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.996603    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b"} err="failed to get container status \"22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b\": rpc error: code = NotFound desc = could not find container \"22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b\": container with ID starting with 22cde0c80210bd478cf1c5643f148b20d3792f12c0959f86f8896a14765b5c4b not found: ID does not exist"
Sep 11 21:57:06.996635 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.996619    2577 scope.go:117] "RemoveContainer" containerID="9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709"
Sep 11 21:57:06.996873 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:57:06.996847    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709\": container with ID starting with 9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709 not found: ID does not exist" containerID="9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709"
Sep 11 21:57:06.996922 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:06.996879    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709"} err="failed to get container status \"9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709\": rpc error: code = NotFound desc = could not find container \"9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709\": container with ID starting with 9629d57e2b3ca1d82337fd73dcc671da44108c0fb4aea68e091175941a07f709 not found: ID does not exist"
Sep 11 21:57:07.001735 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:07.001708    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"]
Sep 11 21:57:07.004655 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:07.004635    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-5cb5f4-openshift-default-64d6dfbbcb-c5kxn"]
Sep 11 21:57:07.762605 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:07.762571    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" path="/var/lib/kubelet/pods/c98dd113-5eac-49ed-b741-d6d66a01beb4/volumes"
Sep 11 21:57:09.500445 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.500412    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"]
Sep 11 21:57:09.500956 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.500803    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s" podUID="7a198872-bc11-4d12-8381-d253ff32ca13" containerName="maas-api" containerID="cri-o://f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b" gracePeriod=30
Sep 11 21:57:09.797154 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.797128    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:57:09.924208 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.924179    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-maas-api-tls\") pod \"7a198872-bc11-4d12-8381-d253ff32ca13\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") "
Sep 11 21:57:09.924396 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.924248    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-metrics-certs\") pod \"7a198872-bc11-4d12-8381-d253ff32ca13\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") "
Sep 11 21:57:09.924396 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.924297    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a198872-bc11-4d12-8381-d253ff32ca13-openshift-service-ca\") pod \"7a198872-bc11-4d12-8381-d253ff32ca13\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") "
Sep 11 21:57:09.924396 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.924369    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdzbd\" (UniqueName: \"kubernetes.io/projected/7a198872-bc11-4d12-8381-d253ff32ca13-kube-api-access-rdzbd\") pod \"7a198872-bc11-4d12-8381-d253ff32ca13\" (UID: \"7a198872-bc11-4d12-8381-d253ff32ca13\") "
Sep 11 21:57:09.925282 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.925248    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a198872-bc11-4d12-8381-d253ff32ca13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a198872-bc11-4d12-8381-d253ff32ca13" (UID: "7a198872-bc11-4d12-8381-d253ff32ca13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:57:09.926744 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.926715    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7a198872-bc11-4d12-8381-d253ff32ca13" (UID: "7a198872-bc11-4d12-8381-d253ff32ca13"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:57:09.926744 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.926732    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a198872-bc11-4d12-8381-d253ff32ca13" (UID: "7a198872-bc11-4d12-8381-d253ff32ca13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:57:09.926860 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.926746    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a198872-bc11-4d12-8381-d253ff32ca13-kube-api-access-rdzbd" (OuterVolumeSpecName: "kube-api-access-rdzbd") pod "7a198872-bc11-4d12-8381-d253ff32ca13" (UID: "7a198872-bc11-4d12-8381-d253ff32ca13"). InnerVolumeSpecName "kube-api-access-rdzbd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:57:09.999400 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.999369    2577 generic.go:356] "Generic (PLEG): container finished" podID="7a198872-bc11-4d12-8381-d253ff32ca13" containerID="f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b" exitCode=0
Sep 11 21:57:09.999533 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.999423    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"
Sep 11 21:57:09.999533 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.999448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s" event={"ID":"7a198872-bc11-4d12-8381-d253ff32ca13","Type":"ContainerDied","Data":"f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b"}
Sep 11 21:57:09.999533 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.999517    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s" event={"ID":"7a198872-bc11-4d12-8381-d253ff32ca13","Type":"ContainerDied","Data":"8c777a99caa043953ce00aa777ad75dc2c8f24dd7e9c9f41c1b5e046811c75ab"}
Sep 11 21:57:09.999683 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:09.999541    2577 scope.go:117] "RemoveContainer" containerID="f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b"
Sep 11 21:57:10.012423 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:10.012400    2577 scope.go:117] "RemoveContainer" containerID="f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b"
Sep 11 21:57:10.012842 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:57:10.012807    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b\": container with ID starting with f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b not found: ID does not exist" containerID="f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b"
Sep 11 21:57:10.012958 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:10.012851    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b"} err="failed to get container status \"f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b\": rpc error: code = NotFound desc = could not find container \"f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b\": container with ID starting with f32ef581ce1f4321aa4be0d9f3a1125a8a99b5a898eb4cecbedddb7d74f8b05b not found: ID does not exist"
Sep 11 21:57:10.025185 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:10.025154    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"]
Sep 11 21:57:10.025589 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:10.025567    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:10.025650 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:10.025596    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a198872-bc11-4d12-8381-d253ff32ca13-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:10.025650 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:10.025607    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a198872-bc11-4d12-8381-d253ff32ca13-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:10.025650 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:10.025617    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdzbd\" (UniqueName: \"kubernetes.io/projected/7a198872-bc11-4d12-8381-d253ff32ca13-kube-api-access-rdzbd\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:10.032387 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:10.032335    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-35e777-54dcc4d59c-gdm8s"]
Sep 11 21:57:11.762810 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:11.762774    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a198872-bc11-4d12-8381-d253ff32ca13" path="/var/lib/kubelet/pods/7a198872-bc11-4d12-8381-d253ff32ca13/volumes"
Sep 11 21:57:12.439388 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.439356    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"]
Sep 11 21:57:12.439675 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.439633    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc" podUID="d44e0192-b4f3-4b31-908f-94eb38437fe0" containerName="maas-api" containerID="cri-o://1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad" gracePeriod=30
Sep 11 21:57:12.708882 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.708845    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:57:12.854161 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.854123    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44e0192-b4f3-4b31-908f-94eb38437fe0-openshift-service-ca\") pod \"d44e0192-b4f3-4b31-908f-94eb38437fe0\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") "
Sep 11 21:57:12.854672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.854181    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-metrics-certs\") pod \"d44e0192-b4f3-4b31-908f-94eb38437fe0\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") "
Sep 11 21:57:12.854672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.854249    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-maas-api-tls\") pod \"d44e0192-b4f3-4b31-908f-94eb38437fe0\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") "
Sep 11 21:57:12.854672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.854274    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85pg5\" (UniqueName: \"kubernetes.io/projected/d44e0192-b4f3-4b31-908f-94eb38437fe0-kube-api-access-85pg5\") pod \"d44e0192-b4f3-4b31-908f-94eb38437fe0\" (UID: \"d44e0192-b4f3-4b31-908f-94eb38437fe0\") "
Sep 11 21:57:12.854672 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.854510    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d44e0192-b4f3-4b31-908f-94eb38437fe0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d44e0192-b4f3-4b31-908f-94eb38437fe0" (UID: "d44e0192-b4f3-4b31-908f-94eb38437fe0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 21:57:12.854929 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.854694    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d44e0192-b4f3-4b31-908f-94eb38437fe0-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:12.856631 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.856604    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d44e0192-b4f3-4b31-908f-94eb38437fe0-kube-api-access-85pg5" (OuterVolumeSpecName: "kube-api-access-85pg5") pod "d44e0192-b4f3-4b31-908f-94eb38437fe0" (UID: "d44e0192-b4f3-4b31-908f-94eb38437fe0"). InnerVolumeSpecName "kube-api-access-85pg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:57:12.856763 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.856640    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d44e0192-b4f3-4b31-908f-94eb38437fe0" (UID: "d44e0192-b4f3-4b31-908f-94eb38437fe0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:57:12.856921 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.856905    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d44e0192-b4f3-4b31-908f-94eb38437fe0" (UID: "d44e0192-b4f3-4b31-908f-94eb38437fe0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 21:57:12.955730 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.955643    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:12.955730 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.955674    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d44e0192-b4f3-4b31-908f-94eb38437fe0-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:12.955730 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:12.955686    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85pg5\" (UniqueName: \"kubernetes.io/projected/d44e0192-b4f3-4b31-908f-94eb38437fe0-kube-api-access-85pg5\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:57:13.023258 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.023211    2577 generic.go:356] "Generic (PLEG): container finished" podID="d44e0192-b4f3-4b31-908f-94eb38437fe0" containerID="1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad" exitCode=0
Sep 11 21:57:13.023408 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.023323    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"
Sep 11 21:57:13.023408 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.023346    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc" event={"ID":"d44e0192-b4f3-4b31-908f-94eb38437fe0","Type":"ContainerDied","Data":"1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad"}
Sep 11 21:57:13.023408 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.023397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc" event={"ID":"d44e0192-b4f3-4b31-908f-94eb38437fe0","Type":"ContainerDied","Data":"01bab6ea421d93dd91b4e5d6fd452e7ed140de33e5fced884d35eef1b3945efb"}
Sep 11 21:57:13.023544 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.023418    2577 scope.go:117] "RemoveContainer" containerID="1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad"
Sep 11 21:57:13.039449 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.039424    2577 scope.go:117] "RemoveContainer" containerID="1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad"
Sep 11 21:57:13.039866 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:57:13.039841    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad\": container with ID starting with 1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad not found: ID does not exist" containerID="1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad"
Sep 11 21:57:13.040005 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.039871    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad"} err="failed to get container status \"1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad\": rpc error: code = NotFound desc = could not find container \"1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad\": container with ID starting with 1157393bccf8b92b957baf092ea5ca4b74c7c4cb53149ae4ee7218e87fce61ad not found: ID does not exist"
Sep 11 21:57:13.053056 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.053035    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"]
Sep 11 21:57:13.060595 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.060574    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-afd794-55796db9f6-fprrc"]
Sep 11 21:57:13.761496 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:57:13.761434    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d44e0192-b4f3-4b31-908f-94eb38437fe0" path="/var/lib/kubelet/pods/d44e0192-b4f3-4b31-908f-94eb38437fe0/volumes"
Sep 11 21:58:02.921043 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921013    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7971-61e4ca"]
Sep 11 21:58:02.921711 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921691    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921713    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921723    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f692355-6dc2-4829-9cb5-a9d84601cc09" containerName="main"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921730    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f692355-6dc2-4829-9cb5-a9d84601cc09" containerName="main"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921746    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921754    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921764    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44e0192-b4f3-4b31-908f-94eb38437fe0" containerName="maas-api"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921773    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44e0192-b4f3-4b31-908f-94eb38437fe0" containerName="maas-api"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921785    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e905c221-d1f8-4109-843d-8b619e8c5683" containerName="main"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921794    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e905c221-d1f8-4109-843d-8b619e8c5683" containerName="main"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921804    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy"
Sep 11 21:58:02.921811 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921812    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921821    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="286edee2-f3cb-4d4b-b144-7a3339d616e9" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921829    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="286edee2-f3cb-4d4b-b144-7a3339d616e9" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921845    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921854    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921865    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a198872-bc11-4d12-8381-d253ff32ca13" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921873    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a198872-bc11-4d12-8381-d253ff32ca13" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921881    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0c39023-7b08-42dc-89f8-5a59d061b854" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.921889    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0c39023-7b08-42dc-89f8-5a59d061b854" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.922002    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d44e0192-b4f3-4b31-908f-94eb38437fe0" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.922015    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f692355-6dc2-4829-9cb5-a9d84601cc09" containerName="main"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.922022    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0c39023-7b08-42dc-89f8-5a59d061b854" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.922033    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.922041    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="286edee2-f3cb-4d4b-b144-7a3339d616e9" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.922049    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a198872-bc11-4d12-8381-d253ff32ca13" containerName="maas-api"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.922060    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e905c221-d1f8-4109-843d-8b619e8c5683" containerName="main"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.922067    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy"
Sep 11 21:58:02.922346 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.922075    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3095797f-510f-4081-938d-eef8cec363d8" containerName="istio-proxy"
Sep 11 21:58:02.927073 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.927048    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-61e4ca"
Sep 11 21:58:02.930059 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.929758    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x6r4k\""
Sep 11 21:58:02.930208 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.930184    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7971-61e4ca"]
Sep 11 21:58:02.952401 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:02.952378    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgzhv\" (UniqueName: \"kubernetes.io/projected/ef7a801f-d17d-44d0-8db4-275d6c73090a-kube-api-access-wgzhv\") pod \"test-curl-7971-61e4ca\" (UID: \"ef7a801f-d17d-44d0-8db4-275d6c73090a\") " pod="opendatahub/test-curl-7971-61e4ca"
Sep 11 21:58:03.053576 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:03.053537    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgzhv\" (UniqueName: \"kubernetes.io/projected/ef7a801f-d17d-44d0-8db4-275d6c73090a-kube-api-access-wgzhv\") pod \"test-curl-7971-61e4ca\" (UID: \"ef7a801f-d17d-44d0-8db4-275d6c73090a\") " pod="opendatahub/test-curl-7971-61e4ca"
Sep 11 21:58:03.062831 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:03.062803    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgzhv\" (UniqueName: \"kubernetes.io/projected/ef7a801f-d17d-44d0-8db4-275d6c73090a-kube-api-access-wgzhv\") pod \"test-curl-7971-61e4ca\" (UID: \"ef7a801f-d17d-44d0-8db4-275d6c73090a\") " pod="opendatahub/test-curl-7971-61e4ca"
Sep 11 21:58:03.238365 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:03.238282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-61e4ca"
Sep 11 21:58:03.512188 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:03.512163    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7971-61e4ca"]
Sep 11 21:58:03.514610 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:58:03.514577    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef7a801f_d17d_44d0_8db4_275d6c73090a.slice/crio-a63ef19badd6384856dbb0f64752f9c25862b13144f9ee84d8cecc469a358fe3 WatchSource:0}: Error finding container a63ef19badd6384856dbb0f64752f9c25862b13144f9ee84d8cecc469a358fe3: Status 404 returned error can't find the container with id a63ef19badd6384856dbb0f64752f9c25862b13144f9ee84d8cecc469a358fe3
Sep 11 21:58:04.354535 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:04.354501    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7971-61e4ca" event={"ID":"ef7a801f-d17d-44d0-8db4-275d6c73090a","Type":"ContainerStarted","Data":"d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9"}
Sep 11 21:58:04.354535 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:04.354540    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7971-61e4ca" event={"ID":"ef7a801f-d17d-44d0-8db4-275d6c73090a","Type":"ContainerStarted","Data":"a63ef19badd6384856dbb0f64752f9c25862b13144f9ee84d8cecc469a358fe3"}
Sep 11 21:58:04.371572 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:04.371522    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7971-61e4ca" podStartSLOduration=2.371507582 podStartE2EDuration="2.371507582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:58:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:58:04.36875164 +0000 UTC m=+1639.026315405" watchObservedRunningTime="2026-09-11 21:58:04.371507582 +0000 UTC m=+1639.029071345"
Sep 11 21:58:04.979689 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:04.979646    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7971-61e4ca"]
Sep 11 21:58:04.982937 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:04.982907    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7971-61e4ca"]
Sep 11 21:58:05.361576 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:58:05.361543    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7971-61e4ca" container="test-curl-7971-61e4ca"
Sep 11 21:58:06.367253 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:06.367195    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7971-61e4ca" podUID="ef7a801f-d17d-44d0-8db4-275d6c73090a" containerName="test-curl-7971-61e4ca" containerID="cri-o://d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9" gracePeriod=2
Sep 11 21:58:08.556636 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:08.556611    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-61e4ca"
Sep 11 21:58:08.605146 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:08.605122    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgzhv\" (UniqueName: \"kubernetes.io/projected/ef7a801f-d17d-44d0-8db4-275d6c73090a-kube-api-access-wgzhv\") pod \"ef7a801f-d17d-44d0-8db4-275d6c73090a\" (UID: \"ef7a801f-d17d-44d0-8db4-275d6c73090a\") "
Sep 11 21:58:08.607375 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:08.607340    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef7a801f-d17d-44d0-8db4-275d6c73090a-kube-api-access-wgzhv" (OuterVolumeSpecName: "kube-api-access-wgzhv") pod "ef7a801f-d17d-44d0-8db4-275d6c73090a" (UID: "ef7a801f-d17d-44d0-8db4-275d6c73090a"). InnerVolumeSpecName "kube-api-access-wgzhv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:58:08.706194 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:08.706165    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgzhv\" (UniqueName: \"kubernetes.io/projected/ef7a801f-d17d-44d0-8db4-275d6c73090a-kube-api-access-wgzhv\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:58:09.387192 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:09.387155    2577 generic.go:356] "Generic (PLEG): container finished" podID="ef7a801f-d17d-44d0-8db4-275d6c73090a" containerID="d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9" exitCode=137
Sep 11 21:58:09.387402 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:09.387206    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-61e4ca"
Sep 11 21:58:09.387402 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:09.387238    2577 scope.go:117] "RemoveContainer" containerID="d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9"
Sep 11 21:58:09.397450 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:09.397431    2577 scope.go:117] "RemoveContainer" containerID="d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9"
Sep 11 21:58:09.397738 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:58:09.397720    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9\": container with ID starting with d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9 not found: ID does not exist" containerID="d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9"
Sep 11 21:58:09.397780 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:09.397748    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9"} err="failed to get container status \"d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9\": rpc error: code = NotFound desc = could not find container \"d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9\": container with ID starting with d0b1a302eb2e2a093535616fec455dbbcfc175a1e0e96f5748348a9ef1460db9 not found: ID does not exist"
Sep 11 21:58:09.398419 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:58:09.398397    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7971-61e4ca\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="ef7a801f-d17d-44d0-8db4-275d6c73090a" pod="opendatahub/test-curl-7971-61e4ca"
Sep 11 21:58:09.761823 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:58:09.761787    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef7a801f-d17d-44d0-8db4-275d6c73090a" path="/var/lib/kubelet/pods/ef7a801f-d17d-44d0-8db4-275d6c73090a/volumes"
Sep 11 21:59:10.415186 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.415105    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7971-2dd560"]
Sep 11 21:59:10.415843 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.415824    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef7a801f-d17d-44d0-8db4-275d6c73090a" containerName="test-curl-7971-61e4ca"
Sep 11 21:59:10.415889 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.415847    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef7a801f-d17d-44d0-8db4-275d6c73090a" containerName="test-curl-7971-61e4ca"
Sep 11 21:59:10.415947 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.415936    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c98dd113-5eac-49ed-b741-d6d66a01beb4" containerName="istio-proxy"
Sep 11 21:59:10.415982 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.415953    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef7a801f-d17d-44d0-8db4-275d6c73090a" containerName="test-curl-7971-61e4ca"
Sep 11 21:59:10.419245 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.419227    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-2dd560"
Sep 11 21:59:10.422028 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.421998    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x6r4k\""
Sep 11 21:59:10.424534 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.424508    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7971-2dd560"]
Sep 11 21:59:10.577598 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.577568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6mqt\" (UniqueName: \"kubernetes.io/projected/5ba5d0c1-4df1-4c35-a88e-13b5cafd3443-kube-api-access-d6mqt\") pod \"test-curl-7971-2dd560\" (UID: \"5ba5d0c1-4df1-4c35-a88e-13b5cafd3443\") " pod="opendatahub/test-curl-7971-2dd560"
Sep 11 21:59:10.678374 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.678300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6mqt\" (UniqueName: \"kubernetes.io/projected/5ba5d0c1-4df1-4c35-a88e-13b5cafd3443-kube-api-access-d6mqt\") pod \"test-curl-7971-2dd560\" (UID: \"5ba5d0c1-4df1-4c35-a88e-13b5cafd3443\") " pod="opendatahub/test-curl-7971-2dd560"
Sep 11 21:59:10.686202 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.686181    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6mqt\" (UniqueName: \"kubernetes.io/projected/5ba5d0c1-4df1-4c35-a88e-13b5cafd3443-kube-api-access-d6mqt\") pod \"test-curl-7971-2dd560\" (UID: \"5ba5d0c1-4df1-4c35-a88e-13b5cafd3443\") " pod="opendatahub/test-curl-7971-2dd560"
Sep 11 21:59:10.729633 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:10.729612    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-2dd560"
Sep 11 21:59:11.000761 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:11.000737    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7971-2dd560"]
Sep 11 21:59:11.002459 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:59:11.002438    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ba5d0c1_4df1_4c35_a88e_13b5cafd3443.slice/crio-256ff8924ce2cfd81ad4a1471361609b61d872dcb81d22e43ec009692744ff1b WatchSource:0}: Error finding container 256ff8924ce2cfd81ad4a1471361609b61d872dcb81d22e43ec009692744ff1b: Status 404 returned error can't find the container with id 256ff8924ce2cfd81ad4a1471361609b61d872dcb81d22e43ec009692744ff1b
Sep 11 21:59:11.783050 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:11.783015    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7971-2dd560" event={"ID":"5ba5d0c1-4df1-4c35-a88e-13b5cafd3443","Type":"ContainerStarted","Data":"6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7"}
Sep 11 21:59:11.783050 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:11.783053    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7971-2dd560" event={"ID":"5ba5d0c1-4df1-4c35-a88e-13b5cafd3443","Type":"ContainerStarted","Data":"256ff8924ce2cfd81ad4a1471361609b61d872dcb81d22e43ec009692744ff1b"}
Sep 11 21:59:11.799926 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:11.799871    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7971-2dd560" podStartSLOduration=1.7998529250000002 podStartE2EDuration="1.799852925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:59:11.79776702 +0000 UTC m=+1706.455330785" watchObservedRunningTime="2026-09-11 21:59:11.799852925 +0000 UTC m=+1706.457416690"
Sep 11 21:59:12.377309 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.377276    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7971-2dd560"]
Sep 11 21:59:12.381609 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.381582    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7971-2dd560"]
Sep 11 21:59:12.515799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.515712    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7971-ae7cde"]
Sep 11 21:59:12.516263 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.516243    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba5d0c1-4df1-4c35-a88e-13b5cafd3443" containerName="test-curl-7971-2dd560"
Sep 11 21:59:12.516357 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.516266    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba5d0c1-4df1-4c35-a88e-13b5cafd3443" containerName="test-curl-7971-2dd560"
Sep 11 21:59:12.516413 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.516381    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ba5d0c1-4df1-4c35-a88e-13b5cafd3443" containerName="test-curl-7971-2dd560"
Sep 11 21:59:12.519578 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.519558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-ae7cde"
Sep 11 21:59:12.525080 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.525055    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7971-ae7cde"]
Sep 11 21:59:12.708153 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.708117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjshc\" (UniqueName: \"kubernetes.io/projected/d8a74857-e8de-49b6-b0a2-92ec0617348a-kube-api-access-pjshc\") pod \"test-curl-7971-ae7cde\" (UID: \"d8a74857-e8de-49b6-b0a2-92ec0617348a\") " pod="opendatahub/test-curl-7971-ae7cde"
Sep 11 21:59:12.788589 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:59:12.788517    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7971-2dd560" container="test-curl-7971-2dd560"
Sep 11 21:59:12.809591 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.809562    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjshc\" (UniqueName: \"kubernetes.io/projected/d8a74857-e8de-49b6-b0a2-92ec0617348a-kube-api-access-pjshc\") pod \"test-curl-7971-ae7cde\" (UID: \"d8a74857-e8de-49b6-b0a2-92ec0617348a\") " pod="opendatahub/test-curl-7971-ae7cde"
Sep 11 21:59:12.818172 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.818145    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjshc\" (UniqueName: \"kubernetes.io/projected/d8a74857-e8de-49b6-b0a2-92ec0617348a-kube-api-access-pjshc\") pod \"test-curl-7971-ae7cde\" (UID: \"d8a74857-e8de-49b6-b0a2-92ec0617348a\") " pod="opendatahub/test-curl-7971-ae7cde"
Sep 11 21:59:12.831135 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:12.831116    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-ae7cde"
Sep 11 21:59:13.104162 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:13.104134    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7971-ae7cde"]
Sep 11 21:59:13.105784 ip-10-0-137-44 kubenswrapper[2577]: W0911 21:59:13.105749    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8a74857_e8de_49b6_b0a2_92ec0617348a.slice/crio-e253ed9c1b66a33471813b90b45fbcbd79948ab12d11eb97f467b2f63d061385 WatchSource:0}: Error finding container e253ed9c1b66a33471813b90b45fbcbd79948ab12d11eb97f467b2f63d061385: Status 404 returned error can't find the container with id e253ed9c1b66a33471813b90b45fbcbd79948ab12d11eb97f467b2f63d061385
Sep 11 21:59:13.794937 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:13.794902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7971-ae7cde" event={"ID":"d8a74857-e8de-49b6-b0a2-92ec0617348a","Type":"ContainerStarted","Data":"844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d"}
Sep 11 21:59:13.794937 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:13.794938    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7971-ae7cde" event={"ID":"d8a74857-e8de-49b6-b0a2-92ec0617348a","Type":"ContainerStarted","Data":"e253ed9c1b66a33471813b90b45fbcbd79948ab12d11eb97f467b2f63d061385"}
Sep 11 21:59:13.795427 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:13.795123    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7971-2dd560" podUID="5ba5d0c1-4df1-4c35-a88e-13b5cafd3443" containerName="test-curl-7971-2dd560" containerID="cri-o://6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7" gracePeriod=2
Sep 11 21:59:13.811903 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:13.811849    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7971-ae7cde" podStartSLOduration=1.811829945 podStartE2EDuration="1.811829945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 21:59:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 21:59:13.80858917 +0000 UTC m=+1708.466152935" watchObservedRunningTime="2026-09-11 21:59:13.811829945 +0000 UTC m=+1708.469393710"
Sep 11 21:59:14.403428 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:14.401856    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7971-ae7cde"]
Sep 11 21:59:14.406423 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:14.406339    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7971-ae7cde"]
Sep 11 21:59:14.801798 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:59:14.801771    2577 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7971-ae7cde" container="test-curl-7971-ae7cde"
Sep 11 21:59:15.807676 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:15.807644    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7971-ae7cde" podUID="d8a74857-e8de-49b6-b0a2-92ec0617348a" containerName="test-curl-7971-ae7cde" containerID="cri-o://844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d" gracePeriod=2
Sep 11 21:59:15.946812 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:15.946790    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-2dd560"
Sep 11 21:59:16.141743 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:16.141664    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6mqt\" (UniqueName: \"kubernetes.io/projected/5ba5d0c1-4df1-4c35-a88e-13b5cafd3443-kube-api-access-d6mqt\") pod \"5ba5d0c1-4df1-4c35-a88e-13b5cafd3443\" (UID: \"5ba5d0c1-4df1-4c35-a88e-13b5cafd3443\") "
Sep 11 21:59:16.143718 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:16.143690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ba5d0c1-4df1-4c35-a88e-13b5cafd3443-kube-api-access-d6mqt" (OuterVolumeSpecName: "kube-api-access-d6mqt") pod "5ba5d0c1-4df1-4c35-a88e-13b5cafd3443" (UID: "5ba5d0c1-4df1-4c35-a88e-13b5cafd3443"). InnerVolumeSpecName "kube-api-access-d6mqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:59:16.243140 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:16.243116    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6mqt\" (UniqueName: \"kubernetes.io/projected/5ba5d0c1-4df1-4c35-a88e-13b5cafd3443-kube-api-access-d6mqt\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:59:16.815880 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:16.815841    2577 generic.go:356] "Generic (PLEG): container finished" podID="5ba5d0c1-4df1-4c35-a88e-13b5cafd3443" containerID="6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7" exitCode=137
Sep 11 21:59:16.815880 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:16.815873    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-2dd560"
Sep 11 21:59:16.816350 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:16.815937    2577 scope.go:117] "RemoveContainer" containerID="6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7"
Sep 11 21:59:16.829288 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:16.829269    2577 scope.go:117] "RemoveContainer" containerID="6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7"
Sep 11 21:59:16.829599 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:59:16.829573    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7971-2dd560\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="5ba5d0c1-4df1-4c35-a88e-13b5cafd3443" pod="opendatahub/test-curl-7971-2dd560"
Sep 11 21:59:16.829599 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:59:16.829579    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7\": container with ID starting with 6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7 not found: ID does not exist" containerID="6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7"
Sep 11 21:59:16.829731 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:16.829615    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7"} err="failed to get container status \"6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7\": rpc error: code = NotFound desc = could not find container \"6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7\": container with ID starting with 6ddfce616e8fc51e85b815391f30e587a80f0c11e71aa8b4a6a63aedb6694cb7 not found: ID does not exist"
Sep 11 21:59:17.761579 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:17.761538    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ba5d0c1-4df1-4c35-a88e-13b5cafd3443" path="/var/lib/kubelet/pods/5ba5d0c1-4df1-4c35-a88e-13b5cafd3443/volumes"
Sep 11 21:59:17.987716 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:17.987692    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-ae7cde"
Sep 11 21:59:18.056341 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:18.056239    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjshc\" (UniqueName: \"kubernetes.io/projected/d8a74857-e8de-49b6-b0a2-92ec0617348a-kube-api-access-pjshc\") pod \"d8a74857-e8de-49b6-b0a2-92ec0617348a\" (UID: \"d8a74857-e8de-49b6-b0a2-92ec0617348a\") "
Sep 11 21:59:18.058571 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:18.058545    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8a74857-e8de-49b6-b0a2-92ec0617348a-kube-api-access-pjshc" (OuterVolumeSpecName: "kube-api-access-pjshc") pod "d8a74857-e8de-49b6-b0a2-92ec0617348a" (UID: "d8a74857-e8de-49b6-b0a2-92ec0617348a"). InnerVolumeSpecName "kube-api-access-pjshc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 21:59:18.157429 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:18.157398    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjshc\" (UniqueName: \"kubernetes.io/projected/d8a74857-e8de-49b6-b0a2-92ec0617348a-kube-api-access-pjshc\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 21:59:18.832628 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:18.832595    2577 generic.go:356] "Generic (PLEG): container finished" podID="d8a74857-e8de-49b6-b0a2-92ec0617348a" containerID="844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d" exitCode=137
Sep 11 21:59:18.832799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:18.832657    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7971-ae7cde"
Sep 11 21:59:18.832799 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:18.832695    2577 scope.go:117] "RemoveContainer" containerID="844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d"
Sep 11 21:59:18.842013 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:18.841997    2577 scope.go:117] "RemoveContainer" containerID="844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d"
Sep 11 21:59:18.842271 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:59:18.842253    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d\": container with ID starting with 844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d not found: ID does not exist" containerID="844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d"
Sep 11 21:59:18.842316 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:18.842280    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d"} err="failed to get container status \"844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d\": rpc error: code = NotFound desc = could not find container \"844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d\": container with ID starting with 844375e50952001f7a44a4258cfedd2769d2b8666b300ac64cbfbb6702e9366d not found: ID does not exist"
Sep 11 21:59:18.843055 ip-10-0-137-44 kubenswrapper[2577]: E0911 21:59:18.843039    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7971-ae7cde\" is forbidden: User \"system:node:ip-10-0-137-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-44.ec2.internal' and this object" podUID="d8a74857-e8de-49b6-b0a2-92ec0617348a" pod="opendatahub/test-curl-7971-ae7cde"
Sep 11 21:59:19.761112 ip-10-0-137-44 kubenswrapper[2577]: I0911 21:59:19.761079    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8a74857-e8de-49b6-b0a2-92ec0617348a" path="/var/lib/kubelet/pods/d8a74857-e8de-49b6-b0a2-92ec0617348a/volumes"
Sep 11 22:00:45.967177 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:00:45.967151    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 22:00:45.970208 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:00:45.970186    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 22:01:23.665876 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.665845    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"]
Sep 11 22:01:23.666396 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.666376    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8a74857-e8de-49b6-b0a2-92ec0617348a" containerName="test-curl-7971-ae7cde"
Sep 11 22:01:23.666445 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.666402    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8a74857-e8de-49b6-b0a2-92ec0617348a" containerName="test-curl-7971-ae7cde"
Sep 11 22:01:23.666563 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.666550    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8a74857-e8de-49b6-b0a2-92ec0617348a" containerName="test-curl-7971-ae7cde"
Sep 11 22:01:23.669720 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.669702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.672434 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.672408    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-6a5690-serving-cert\""
Sep 11 22:01:23.678353 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.678293    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"]
Sep 11 22:01:23.755849 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.755817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-metrics-certs\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.756011 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.755856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.756011 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.755964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99c9cf82-afe7-45c8-bb95-9df0b2431914-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.756011 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.756003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t29wb\" (UniqueName: \"kubernetes.io/projected/99c9cf82-afe7-45c8-bb95-9df0b2431914-kube-api-access-t29wb\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.857334 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.857298    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-metrics-certs\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.857550 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.857342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.857550 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.857452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99c9cf82-afe7-45c8-bb95-9df0b2431914-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.857702 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.857668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t29wb\" (UniqueName: \"kubernetes.io/projected/99c9cf82-afe7-45c8-bb95-9df0b2431914-kube-api-access-t29wb\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.858264 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.858243    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99c9cf82-afe7-45c8-bb95-9df0b2431914-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.860498 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.860460    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-metrics-certs\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.860596 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.860563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-maas-api-tls\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.866503 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.866449    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t29wb\" (UniqueName: \"kubernetes.io/projected/99c9cf82-afe7-45c8-bb95-9df0b2431914-kube-api-access-t29wb\") pod \"maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:23.983876 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:23.983805    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:24.269761 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:24.269729    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"]
Sep 11 22:01:24.270248 ip-10-0-137-44 kubenswrapper[2577]: W0911 22:01:24.270225    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c9cf82_afe7_45c8_bb95_9df0b2431914.slice/crio-d13d7e4d71e6a7051af270b8346217ee694436e3c5c29e112304fcacc769481b WatchSource:0}: Error finding container d13d7e4d71e6a7051af270b8346217ee694436e3c5c29e112304fcacc769481b: Status 404 returned error can't find the container with id d13d7e4d71e6a7051af270b8346217ee694436e3c5c29e112304fcacc769481b
Sep 11 22:01:24.272042 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:24.272020    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 22:01:24.591604 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:24.591518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6" event={"ID":"99c9cf82-afe7-45c8-bb95-9df0b2431914","Type":"ContainerStarted","Data":"d13d7e4d71e6a7051af270b8346217ee694436e3c5c29e112304fcacc769481b"}
Sep 11 22:01:25.600363 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:25.600325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6" event={"ID":"99c9cf82-afe7-45c8-bb95-9df0b2431914","Type":"ContainerStarted","Data":"c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1"}
Sep 11 22:01:25.600772 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:25.600403    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:01:25.620849 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:25.620801    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6" podStartSLOduration=2.174527028 podStartE2EDuration="2.620786597s" totalImagesPullingTime="446.259569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 22:01:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 22:01:25.620290264 +0000 UTC m=+1840.277854028" watchObservedRunningTime="2026-09-11 22:01:25.620786597 +0000 UTC m=+1840.278350360"
Sep 11 22:01:31.616599 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:01:31.616567    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:02:20.694522 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:02:20.694427    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tfpz_1f0e7cf0-40f5-4689-a946-f62eb479307c/payload-processing/0.log"
Sep 11 22:02:56.786267 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:02:56.786232    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tfpz_1f0e7cf0-40f5-4689-a946-f62eb479307c/payload-processing/0.log"
Sep 11 22:03:03.063151 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.063116    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"]
Sep 11 22:03:03.066801 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.066784    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.069565 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.069538    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-3b9cac-serving-cert\""
Sep 11 22:03:03.077619 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.077595    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"]
Sep 11 22:03:03.203924 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.203888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdr42\" (UniqueName: \"kubernetes.io/projected/7aa60a7b-9233-4356-b273-e0e10694e2e9-kube-api-access-bdr42\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.204124 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.203991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.204124 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.204044    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.204124 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.204068    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aa60a7b-9233-4356-b273-e0e10694e2e9-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.305417 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.305381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.305637 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.305448    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.305637 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.305484    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aa60a7b-9233-4356-b273-e0e10694e2e9-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.305637 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.305543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdr42\" (UniqueName: \"kubernetes.io/projected/7aa60a7b-9233-4356-b273-e0e10694e2e9-kube-api-access-bdr42\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.305637 ip-10-0-137-44 kubenswrapper[2577]: E0911 22:03:03.305556    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-serving-cert: secret "maas-api-e2e-ipp-cleanup-3b9cac-serving-cert" not found
Sep 11 22:03:03.305867 ip-10-0-137-44 kubenswrapper[2577]: E0911 22:03:03.305664    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-maas-api-tls podName:7aa60a7b-9233-4356-b273-e0e10694e2e9 nodeName:}" failed. No retries permitted until 2026-09-11 22:03:03.805642693 +0000 UTC m=+1938.463206434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp" (UID: "7aa60a7b-9233-4356-b273-e0e10694e2e9") : secret "maas-api-e2e-ipp-cleanup-3b9cac-serving-cert" not found
Sep 11 22:03:03.306374 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.306351    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aa60a7b-9233-4356-b273-e0e10694e2e9-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.308250 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.308219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.314319 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.314252    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdr42\" (UniqueName: \"kubernetes.io/projected/7aa60a7b-9233-4356-b273-e0e10694e2e9-kube-api-access-bdr42\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.811454 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.811419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.814322 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.814295    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:03.980487 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:03.980440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:04.258169 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:04.258138    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"]
Sep 11 22:03:04.259522 ip-10-0-137-44 kubenswrapper[2577]: W0911 22:03:04.259494    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aa60a7b_9233_4356_b273_e0e10694e2e9.slice/crio-c2df8d9fe48ece8de094747851e0777e8bc2003141d68b617b2a014b0a8040dd WatchSource:0}: Error finding container c2df8d9fe48ece8de094747851e0777e8bc2003141d68b617b2a014b0a8040dd: Status 404 returned error can't find the container with id c2df8d9fe48ece8de094747851e0777e8bc2003141d68b617b2a014b0a8040dd
Sep 11 22:03:05.234143 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:05.234109    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp" event={"ID":"7aa60a7b-9233-4356-b273-e0e10694e2e9","Type":"ContainerStarted","Data":"0f80000e578a0b85f5d0716dc62446d4fb76a3b32630bebd1cc1b79cfb7b3084"}
Sep 11 22:03:05.234307 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:05.234170    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp" event={"ID":"7aa60a7b-9233-4356-b273-e0e10694e2e9","Type":"ContainerStarted","Data":"c2df8d9fe48ece8de094747851e0777e8bc2003141d68b617b2a014b0a8040dd"}
Sep 11 22:03:05.234350 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:05.234322    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:05.252586 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:05.252540    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp" podStartSLOduration=1.8161888670000002 podStartE2EDuration="2.252524698s" totalImagesPullingTime="436.335831ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 22:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 22:03:05.250669605 +0000 UTC m=+1939.908233370" watchObservedRunningTime="2026-09-11 22:03:05.252524698 +0000 UTC m=+1939.910088462"
Sep 11 22:03:11.246026 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:11.245993    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:32.159665 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.159615    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"]
Sep 11 22:03:32.160209 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.159853    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp" podUID="7aa60a7b-9233-4356-b273-e0e10694e2e9" containerName="maas-api" containerID="cri-o://0f80000e578a0b85f5d0716dc62446d4fb76a3b32630bebd1cc1b79cfb7b3084" gracePeriod=30
Sep 11 22:03:32.415680 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.415647    2577 generic.go:356] "Generic (PLEG): container finished" podID="7aa60a7b-9233-4356-b273-e0e10694e2e9" containerID="0f80000e578a0b85f5d0716dc62446d4fb76a3b32630bebd1cc1b79cfb7b3084" exitCode=0
Sep 11 22:03:32.415849 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.415675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp" event={"ID":"7aa60a7b-9233-4356-b273-e0e10694e2e9","Type":"ContainerDied","Data":"0f80000e578a0b85f5d0716dc62446d4fb76a3b32630bebd1cc1b79cfb7b3084"}
Sep 11 22:03:32.415849 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.415746    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp" event={"ID":"7aa60a7b-9233-4356-b273-e0e10694e2e9","Type":"ContainerDied","Data":"c2df8d9fe48ece8de094747851e0777e8bc2003141d68b617b2a014b0a8040dd"}
Sep 11 22:03:32.415849 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.415772    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2df8d9fe48ece8de094747851e0777e8bc2003141d68b617b2a014b0a8040dd"
Sep 11 22:03:32.433663 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.433638    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:32.481851 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.481805    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-maas-api-tls\") pod \"7aa60a7b-9233-4356-b273-e0e10694e2e9\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") "
Sep 11 22:03:32.482661 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.481971    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aa60a7b-9233-4356-b273-e0e10694e2e9-openshift-service-ca\") pod \"7aa60a7b-9233-4356-b273-e0e10694e2e9\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") "
Sep 11 22:03:32.483547 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.483093    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-metrics-certs\") pod \"7aa60a7b-9233-4356-b273-e0e10694e2e9\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") "
Sep 11 22:03:32.483547 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.483174    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdr42\" (UniqueName: \"kubernetes.io/projected/7aa60a7b-9233-4356-b273-e0e10694e2e9-kube-api-access-bdr42\") pod \"7aa60a7b-9233-4356-b273-e0e10694e2e9\" (UID: \"7aa60a7b-9233-4356-b273-e0e10694e2e9\") "
Sep 11 22:03:32.485310 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.484642    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7aa60a7b-9233-4356-b273-e0e10694e2e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7aa60a7b-9233-4356-b273-e0e10694e2e9" (UID: "7aa60a7b-9233-4356-b273-e0e10694e2e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 22:03:32.495865 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.495835    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7aa60a7b-9233-4356-b273-e0e10694e2e9" (UID: "7aa60a7b-9233-4356-b273-e0e10694e2e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:03:32.498197 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.498162    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7aa60a7b-9233-4356-b273-e0e10694e2e9-kube-api-access-bdr42" (OuterVolumeSpecName: "kube-api-access-bdr42") pod "7aa60a7b-9233-4356-b273-e0e10694e2e9" (UID: "7aa60a7b-9233-4356-b273-e0e10694e2e9"). InnerVolumeSpecName "kube-api-access-bdr42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 22:03:32.501052 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.500988    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7aa60a7b-9233-4356-b273-e0e10694e2e9" (UID: "7aa60a7b-9233-4356-b273-e0e10694e2e9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:03:32.586348 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.586317    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdr42\" (UniqueName: \"kubernetes.io/projected/7aa60a7b-9233-4356-b273-e0e10694e2e9-kube-api-access-bdr42\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:03:32.586348 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.586347    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:03:32.586572 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.586359    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7aa60a7b-9233-4356-b273-e0e10694e2e9-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:03:32.586572 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:32.586370    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7aa60a7b-9233-4356-b273-e0e10694e2e9-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:03:33.423040 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:33.423000    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"
Sep 11 22:03:33.445930 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:33.445901    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"]
Sep 11 22:03:33.448400 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:33.448376    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-3b9cac-6d9cdb578d-t9vxp"]
Sep 11 22:03:33.761895 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:33.761799    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7aa60a7b-9233-4356-b273-e0e10694e2e9" path="/var/lib/kubelet/pods/7aa60a7b-9233-4356-b273-e0e10694e2e9/volumes"
Sep 11 22:03:58.155348 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.155229    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"]
Sep 11 22:03:58.155835 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.155534    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6" podUID="99c9cf82-afe7-45c8-bb95-9df0b2431914" containerName="maas-api" containerID="cri-o://c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1" gracePeriod=30
Sep 11 22:03:58.426238 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.426217    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:03:58.536623 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.536588    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99c9cf82-afe7-45c8-bb95-9df0b2431914-openshift-service-ca\") pod \"99c9cf82-afe7-45c8-bb95-9df0b2431914\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") "
Sep 11 22:03:58.536820 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.536656    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-maas-api-tls\") pod \"99c9cf82-afe7-45c8-bb95-9df0b2431914\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") "
Sep 11 22:03:58.536820 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.536779    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-metrics-certs\") pod \"99c9cf82-afe7-45c8-bb95-9df0b2431914\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") "
Sep 11 22:03:58.536976 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.536815    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t29wb\" (UniqueName: \"kubernetes.io/projected/99c9cf82-afe7-45c8-bb95-9df0b2431914-kube-api-access-t29wb\") pod \"99c9cf82-afe7-45c8-bb95-9df0b2431914\" (UID: \"99c9cf82-afe7-45c8-bb95-9df0b2431914\") "
Sep 11 22:03:58.537037 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.536976    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99c9cf82-afe7-45c8-bb95-9df0b2431914-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "99c9cf82-afe7-45c8-bb95-9df0b2431914" (UID: "99c9cf82-afe7-45c8-bb95-9df0b2431914"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 22:03:58.537268 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.537237    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/99c9cf82-afe7-45c8-bb95-9df0b2431914-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:03:58.539135 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.539105    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "99c9cf82-afe7-45c8-bb95-9df0b2431914" (UID: "99c9cf82-afe7-45c8-bb95-9df0b2431914"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:03:58.539255 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.539171    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "99c9cf82-afe7-45c8-bb95-9df0b2431914" (UID: "99c9cf82-afe7-45c8-bb95-9df0b2431914"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:03:58.539539 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.539508    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99c9cf82-afe7-45c8-bb95-9df0b2431914-kube-api-access-t29wb" (OuterVolumeSpecName: "kube-api-access-t29wb") pod "99c9cf82-afe7-45c8-bb95-9df0b2431914" (UID: "99c9cf82-afe7-45c8-bb95-9df0b2431914"). InnerVolumeSpecName "kube-api-access-t29wb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 22:03:58.581973 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.581929    2577 generic.go:356] "Generic (PLEG): container finished" podID="99c9cf82-afe7-45c8-bb95-9df0b2431914" containerID="c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1" exitCode=0
Sep 11 22:03:58.582140 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.581980    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"
Sep 11 22:03:58.582140 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.582019    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6" event={"ID":"99c9cf82-afe7-45c8-bb95-9df0b2431914","Type":"ContainerDied","Data":"c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1"}
Sep 11 22:03:58.582140 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.582072    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6" event={"ID":"99c9cf82-afe7-45c8-bb95-9df0b2431914","Type":"ContainerDied","Data":"d13d7e4d71e6a7051af270b8346217ee694436e3c5c29e112304fcacc769481b"}
Sep 11 22:03:58.582140 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.582094    2577 scope.go:117] "RemoveContainer" containerID="c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1"
Sep 11 22:03:58.592764 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.592746    2577 scope.go:117] "RemoveContainer" containerID="c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1"
Sep 11 22:03:58.593063 ip-10-0-137-44 kubenswrapper[2577]: E0911 22:03:58.593045    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1\": container with ID starting with c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1 not found: ID does not exist" containerID="c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1"
Sep 11 22:03:58.593121 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.593071    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1"} err="failed to get container status \"c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1\": rpc error: code = NotFound desc = could not find container \"c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1\": container with ID starting with c657416f26237ebea2256f8bba977c51d8b8555318fdf329e8ac1503791863b1 not found: ID does not exist"
Sep 11 22:03:58.607202 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.607177    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"]
Sep 11 22:03:58.610298 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.610273    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-6a5690-6d6b98d745-sxgh6"]
Sep 11 22:03:58.638410 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.638381    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:03:58.638410 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.638402    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/99c9cf82-afe7-45c8-bb95-9df0b2431914-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:03:58.638410 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:58.638411    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t29wb\" (UniqueName: \"kubernetes.io/projected/99c9cf82-afe7-45c8-bb95-9df0b2431914-kube-api-access-t29wb\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:03:59.761398 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:03:59.761363    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99c9cf82-afe7-45c8-bb95-9df0b2431914" path="/var/lib/kubelet/pods/99c9cf82-afe7-45c8-bb95-9df0b2431914/volumes"
Sep 11 22:05:15.381890 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.381774    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"]
Sep 11 22:05:15.382377 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.382029    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps" podUID="caf9067e-0bc7-4258-9d04-8fed45528542" containerName="maas-api" containerID="cri-o://88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8" gracePeriod=30
Sep 11 22:05:15.641601 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.641541    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 22:05:15.759275 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.759247    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-metrics-certs\") pod \"caf9067e-0bc7-4258-9d04-8fed45528542\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") "
Sep 11 22:05:15.759275 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.759289    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbzth\" (UniqueName: \"kubernetes.io/projected/caf9067e-0bc7-4258-9d04-8fed45528542-kube-api-access-lbzth\") pod \"caf9067e-0bc7-4258-9d04-8fed45528542\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") "
Sep 11 22:05:15.759584 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.759331    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-maas-api-tls\") pod \"caf9067e-0bc7-4258-9d04-8fed45528542\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") "
Sep 11 22:05:15.759584 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.759447    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf9067e-0bc7-4258-9d04-8fed45528542-openshift-service-ca\") pod \"caf9067e-0bc7-4258-9d04-8fed45528542\" (UID: \"caf9067e-0bc7-4258-9d04-8fed45528542\") "
Sep 11 22:05:15.760280 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.760239    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caf9067e-0bc7-4258-9d04-8fed45528542-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "caf9067e-0bc7-4258-9d04-8fed45528542" (UID: "caf9067e-0bc7-4258-9d04-8fed45528542"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 22:05:15.761913 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.761876    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "caf9067e-0bc7-4258-9d04-8fed45528542" (UID: "caf9067e-0bc7-4258-9d04-8fed45528542"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:05:15.762051 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.762032    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "caf9067e-0bc7-4258-9d04-8fed45528542" (UID: "caf9067e-0bc7-4258-9d04-8fed45528542"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:05:15.762798 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.762769    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caf9067e-0bc7-4258-9d04-8fed45528542-kube-api-access-lbzth" (OuterVolumeSpecName: "kube-api-access-lbzth") pod "caf9067e-0bc7-4258-9d04-8fed45528542" (UID: "caf9067e-0bc7-4258-9d04-8fed45528542"). InnerVolumeSpecName "kube-api-access-lbzth". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 22:05:15.860701 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.860668    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:15.860701 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.860697    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbzth\" (UniqueName: \"kubernetes.io/projected/caf9067e-0bc7-4258-9d04-8fed45528542-kube-api-access-lbzth\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:15.860701 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.860706    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/caf9067e-0bc7-4258-9d04-8fed45528542-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:15.861019 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:15.860714    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/caf9067e-0bc7-4258-9d04-8fed45528542-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:16.059746 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:16.059714    2577 generic.go:356] "Generic (PLEG): container finished" podID="caf9067e-0bc7-4258-9d04-8fed45528542" containerID="88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8" exitCode=0
Sep 11 22:05:16.059913 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:16.059758    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"
Sep 11 22:05:16.059913 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:16.059798    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps" event={"ID":"caf9067e-0bc7-4258-9d04-8fed45528542","Type":"ContainerDied","Data":"88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8"}
Sep 11 22:05:16.059913 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:16.059858    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps" event={"ID":"caf9067e-0bc7-4258-9d04-8fed45528542","Type":"ContainerDied","Data":"9b0d653d4a7aafe2dac61da43c012e804ff914f73261c2762cb934b4b3017805"}
Sep 11 22:05:16.059913 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:16.059887    2577 scope.go:117] "RemoveContainer" containerID="88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8"
Sep 11 22:05:16.070241 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:16.070227    2577 scope.go:117] "RemoveContainer" containerID="88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8"
Sep 11 22:05:16.070514 ip-10-0-137-44 kubenswrapper[2577]: E0911 22:05:16.070496    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8\": container with ID starting with 88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8 not found: ID does not exist" containerID="88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8"
Sep 11 22:05:16.070581 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:16.070524    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8"} err="failed to get container status \"88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8\": rpc error: code = NotFound desc = could not find container \"88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8\": container with ID starting with 88046b6f1c0352317a6413569300d0d8af0096d1bc76290efaeb00e006d641e8 not found: ID does not exist"
Sep 11 22:05:16.083318 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:16.083282    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"]
Sep 11 22:05:16.087054 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:16.087032    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-7d7821-7d547d4dbb-ms4ps"]
Sep 11 22:05:17.762786 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:17.762754    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caf9067e-0bc7-4258-9d04-8fed45528542" path="/var/lib/kubelet/pods/caf9067e-0bc7-4258-9d04-8fed45528542/volumes"
Sep 11 22:05:32.797131 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:32.797093    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"]
Sep 11 22:05:32.797821 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:32.797787    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n" podUID="55c40eaf-b3f6-48c9-b15b-7d27dbdff376" containerName="maas-api" containerID="cri-o://810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc" gracePeriod=30
Sep 11 22:05:33.066398 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.066362    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 22:05:33.170962 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.170918    2577 generic.go:356] "Generic (PLEG): container finished" podID="55c40eaf-b3f6-48c9-b15b-7d27dbdff376" containerID="810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc" exitCode=0
Sep 11 22:05:33.170962 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.170961    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n" event={"ID":"55c40eaf-b3f6-48c9-b15b-7d27dbdff376","Type":"ContainerDied","Data":"810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc"}
Sep 11 22:05:33.171237 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.170974    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"
Sep 11 22:05:33.171237 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.171013    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n" event={"ID":"55c40eaf-b3f6-48c9-b15b-7d27dbdff376","Type":"ContainerDied","Data":"bac304342841a66638f139eef6f0662fa9d8ad777ecc08ab4817363133179605"}
Sep 11 22:05:33.171237 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.171037    2577 scope.go:117] "RemoveContainer" containerID="810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc"
Sep 11 22:05:33.182819 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.182796    2577 scope.go:117] "RemoveContainer" containerID="810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc"
Sep 11 22:05:33.183114 ip-10-0-137-44 kubenswrapper[2577]: E0911 22:05:33.183089    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc\": container with ID starting with 810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc not found: ID does not exist" containerID="810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc"
Sep 11 22:05:33.183164 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.183121    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc"} err="failed to get container status \"810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc\": rpc error: code = NotFound desc = could not find container \"810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc\": container with ID starting with 810583bf4dc00d1e27435d695eab753930b234f281470287f9723f3897c6fdfc not found: ID does not exist"
Sep 11 22:05:33.228974 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.228944    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-maas-api-tls\") pod \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") "
Sep 11 22:05:33.229141 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.229076    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-metrics-certs\") pod \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") "
Sep 11 22:05:33.229141 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.229108    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-openshift-service-ca\") pod \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") "
Sep 11 22:05:33.229257 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.229146    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v27z\" (UniqueName: \"kubernetes.io/projected/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-kube-api-access-7v27z\") pod \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\" (UID: \"55c40eaf-b3f6-48c9-b15b-7d27dbdff376\") "
Sep 11 22:05:33.229513 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.229483    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "55c40eaf-b3f6-48c9-b15b-7d27dbdff376" (UID: "55c40eaf-b3f6-48c9-b15b-7d27dbdff376"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 22:05:33.231204 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.231178    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "55c40eaf-b3f6-48c9-b15b-7d27dbdff376" (UID: "55c40eaf-b3f6-48c9-b15b-7d27dbdff376"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:05:33.231343 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.231325    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-kube-api-access-7v27z" (OuterVolumeSpecName: "kube-api-access-7v27z") pod "55c40eaf-b3f6-48c9-b15b-7d27dbdff376" (UID: "55c40eaf-b3f6-48c9-b15b-7d27dbdff376"). InnerVolumeSpecName "kube-api-access-7v27z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 22:05:33.231538 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.231506    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "55c40eaf-b3f6-48c9-b15b-7d27dbdff376" (UID: "55c40eaf-b3f6-48c9-b15b-7d27dbdff376"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:05:33.330114 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.330024    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:33.330114 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.330058    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:33.330114 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.330072    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v27z\" (UniqueName: \"kubernetes.io/projected/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-kube-api-access-7v27z\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:33.330114 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.330084    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/55c40eaf-b3f6-48c9-b15b-7d27dbdff376-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:33.493964 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.493929    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"]
Sep 11 22:05:33.499989 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.499963    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-4e0323-5c45cf9fc7-fsg9n"]
Sep 11 22:05:33.761450 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:33.761407    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55c40eaf-b3f6-48c9-b15b-7d27dbdff376" path="/var/lib/kubelet/pods/55c40eaf-b3f6-48c9-b15b-7d27dbdff376/volumes"
Sep 11 22:05:42.175461 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.175423    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-mdlk2"]
Sep 11 22:05:42.175907 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.175641    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f59564f6b-mdlk2" podUID="6de2186e-f915-494d-9510-49123ef054a4" containerName="manager" containerID="cri-o://4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3" gracePeriod=30
Sep 11 22:05:42.432876 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.432805    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 22:05:42.524261 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.524227    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6xwb\" (UniqueName: \"kubernetes.io/projected/6de2186e-f915-494d-9510-49123ef054a4-kube-api-access-m6xwb\") pod \"6de2186e-f915-494d-9510-49123ef054a4\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") "
Sep 11 22:05:42.524431 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.524276    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-metrics-certs\") pod \"6de2186e-f915-494d-9510-49123ef054a4\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") "
Sep 11 22:05:42.524431 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.524294    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-webhook-cert\") pod \"6de2186e-f915-494d-9510-49123ef054a4\" (UID: \"6de2186e-f915-494d-9510-49123ef054a4\") "
Sep 11 22:05:42.526531 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.526491    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6de2186e-f915-494d-9510-49123ef054a4" (UID: "6de2186e-f915-494d-9510-49123ef054a4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:05:42.526660 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.526543    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6de2186e-f915-494d-9510-49123ef054a4" (UID: "6de2186e-f915-494d-9510-49123ef054a4"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:05:42.526660 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.526555    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de2186e-f915-494d-9510-49123ef054a4-kube-api-access-m6xwb" (OuterVolumeSpecName: "kube-api-access-m6xwb") pod "6de2186e-f915-494d-9510-49123ef054a4" (UID: "6de2186e-f915-494d-9510-49123ef054a4"). InnerVolumeSpecName "kube-api-access-m6xwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 22:05:42.625313 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.625289    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6xwb\" (UniqueName: \"kubernetes.io/projected/6de2186e-f915-494d-9510-49123ef054a4-kube-api-access-m6xwb\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:42.625313 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.625312    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:42.625517 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:42.625322    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6de2186e-f915-494d-9510-49123ef054a4-webhook-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:05:43.232899 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.232861    2577 generic.go:356] "Generic (PLEG): container finished" podID="6de2186e-f915-494d-9510-49123ef054a4" containerID="4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3" exitCode=0
Sep 11 22:05:43.233315 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.232914    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f59564f6b-mdlk2"
Sep 11 22:05:43.233315 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.232943    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f59564f6b-mdlk2" event={"ID":"6de2186e-f915-494d-9510-49123ef054a4","Type":"ContainerDied","Data":"4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3"}
Sep 11 22:05:43.233315 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.232997    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f59564f6b-mdlk2" event={"ID":"6de2186e-f915-494d-9510-49123ef054a4","Type":"ContainerDied","Data":"198b861ce6f47179d0ff9a0baaa492bc1c4c546cf3f6ba986ad2c4db6d1af139"}
Sep 11 22:05:43.233315 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.233018    2577 scope.go:117] "RemoveContainer" containerID="4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3"
Sep 11 22:05:43.243573 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.243556    2577 scope.go:117] "RemoveContainer" containerID="4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3"
Sep 11 22:05:43.243863 ip-10-0-137-44 kubenswrapper[2577]: E0911 22:05:43.243844    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3\": container with ID starting with 4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3 not found: ID does not exist" containerID="4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3"
Sep 11 22:05:43.243923 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.243871    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3"} err="failed to get container status \"4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3\": rpc error: code = NotFound desc = could not find container \"4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3\": container with ID starting with 4c4b2aaa0e70f8fc6471196173d799a96ffd93716d460d5453a80365e6068fc3 not found: ID does not exist"
Sep 11 22:05:43.254900 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.254877    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-mdlk2"]
Sep 11 22:05:43.261699 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.261672    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-mdlk2"]
Sep 11 22:05:43.760798 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:43.760755    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6de2186e-f915-494d-9510-49123ef054a4" path="/var/lib/kubelet/pods/6de2186e-f915-494d-9510-49123ef054a4/volumes"
Sep 11 22:05:46.018042 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:46.018004    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 22:05:46.024627 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:05:46.024606    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 22:06:44.058567 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.058457    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f59564f6b-hbtzv"]
Sep 11 22:06:44.059224 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059207    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99c9cf82-afe7-45c8-bb95-9df0b2431914" containerName="maas-api"
Sep 11 22:06:44.059273 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059228    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="99c9cf82-afe7-45c8-bb95-9df0b2431914" containerName="maas-api"
Sep 11 22:06:44.059273 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059240    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c40eaf-b3f6-48c9-b15b-7d27dbdff376" containerName="maas-api"
Sep 11 22:06:44.059273 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059248    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c40eaf-b3f6-48c9-b15b-7d27dbdff376" containerName="maas-api"
Sep 11 22:06:44.059273 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059265    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6de2186e-f915-494d-9510-49123ef054a4" containerName="manager"
Sep 11 22:06:44.059422 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059274    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6de2186e-f915-494d-9510-49123ef054a4" containerName="manager"
Sep 11 22:06:44.059422 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059291    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caf9067e-0bc7-4258-9d04-8fed45528542" containerName="maas-api"
Sep 11 22:06:44.059422 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059299    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="caf9067e-0bc7-4258-9d04-8fed45528542" containerName="maas-api"
Sep 11 22:06:44.059422 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059315    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7aa60a7b-9233-4356-b273-e0e10694e2e9" containerName="maas-api"
Sep 11 22:06:44.059422 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059323    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7aa60a7b-9233-4356-b273-e0e10694e2e9" containerName="maas-api"
Sep 11 22:06:44.059422 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059412    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7aa60a7b-9233-4356-b273-e0e10694e2e9" containerName="maas-api"
Sep 11 22:06:44.059665 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059423    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6de2186e-f915-494d-9510-49123ef054a4" containerName="manager"
Sep 11 22:06:44.059665 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059432    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="caf9067e-0bc7-4258-9d04-8fed45528542" containerName="maas-api"
Sep 11 22:06:44.059665 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059444    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="99c9cf82-afe7-45c8-bb95-9df0b2431914" containerName="maas-api"
Sep 11 22:06:44.059665 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.059458    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c40eaf-b3f6-48c9-b15b-7d27dbdff376" containerName="maas-api"
Sep 11 22:06:44.062636 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.062621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.066272 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.066247    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wcldp\""
Sep 11 22:06:44.066272 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.066266    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 11 22:06:44.066463 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.066266    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 11 22:06:44.066463 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.066247    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 11 22:06:44.072170 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.072147    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-hbtzv"]
Sep 11 22:06:44.195913 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.195880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-webhook-cert\") pod \"maas-controller-5f59564f6b-hbtzv\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") " pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.196052 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.195920    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/a5439f0b-9524-4bc5-ac36-4fc003579af6-kube-api-access-ghk8w\") pod \"maas-controller-5f59564f6b-hbtzv\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") " pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.196052 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.195978    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-metrics-certs\") pod \"maas-controller-5f59564f6b-hbtzv\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") " pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.297117 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.297092    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-webhook-cert\") pod \"maas-controller-5f59564f6b-hbtzv\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") " pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.297245 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.297127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/a5439f0b-9524-4bc5-ac36-4fc003579af6-kube-api-access-ghk8w\") pod \"maas-controller-5f59564f6b-hbtzv\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") " pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.297245 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.297168    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-metrics-certs\") pod \"maas-controller-5f59564f6b-hbtzv\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") " pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.299691 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.299663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-metrics-certs\") pod \"maas-controller-5f59564f6b-hbtzv\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") " pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.299795 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.299717    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-webhook-cert\") pod \"maas-controller-5f59564f6b-hbtzv\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") " pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.304988 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.304971    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/a5439f0b-9524-4bc5-ac36-4fc003579af6-kube-api-access-ghk8w\") pod \"maas-controller-5f59564f6b-hbtzv\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") " pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.374234 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.374180    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:44.645904 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.645862    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-hbtzv"]
Sep 11 22:06:44.647141 ip-10-0-137-44 kubenswrapper[2577]: W0911 22:06:44.647110    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5439f0b_9524_4bc5_ac36_4fc003579af6.slice/crio-e1b84b82b948011520ee9be831dade8bb962e76c336f1b587f09ff3ac0de8029 WatchSource:0}: Error finding container e1b84b82b948011520ee9be831dade8bb962e76c336f1b587f09ff3ac0de8029: Status 404 returned error can't find the container with id e1b84b82b948011520ee9be831dade8bb962e76c336f1b587f09ff3ac0de8029
Sep 11 22:06:44.648674 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:44.648656    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 22:06:45.598124 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:45.598085    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f59564f6b-hbtzv" event={"ID":"a5439f0b-9524-4bc5-ac36-4fc003579af6","Type":"ContainerStarted","Data":"fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15"}
Sep 11 22:06:45.598532 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:45.598149    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f59564f6b-hbtzv" event={"ID":"a5439f0b-9524-4bc5-ac36-4fc003579af6","Type":"ContainerStarted","Data":"e1b84b82b948011520ee9be831dade8bb962e76c336f1b587f09ff3ac0de8029"}
Sep 11 22:06:45.598532 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:45.598309    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:06:45.617318 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:45.617270    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f59564f6b-hbtzv" podStartSLOduration=1.114061971 podStartE2EDuration="1.617257605s" totalImagesPullingTime="503.195634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 22:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 22:06:45.614100358 +0000 UTC m=+2160.271664123" watchObservedRunningTime="2026-09-11 22:06:45.617257605 +0000 UTC m=+2160.274821369"
Sep 11 22:06:56.606673 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:06:56.606642    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:07:08.086717 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.086655    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-hbtzv"]
Sep 11 22:07:08.087185 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.086900    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5f59564f6b-hbtzv" podUID="a5439f0b-9524-4bc5-ac36-4fc003579af6" containerName="manager" containerID="cri-o://fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15" gracePeriod=30
Sep 11 22:07:08.340152 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.340087    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:07:08.422763 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.422719    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-webhook-cert\") pod \"a5439f0b-9524-4bc5-ac36-4fc003579af6\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") "
Sep 11 22:07:08.422965 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.422824    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/a5439f0b-9524-4bc5-ac36-4fc003579af6-kube-api-access-ghk8w\") pod \"a5439f0b-9524-4bc5-ac36-4fc003579af6\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") "
Sep 11 22:07:08.422965 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.422863    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-metrics-certs\") pod \"a5439f0b-9524-4bc5-ac36-4fc003579af6\" (UID: \"a5439f0b-9524-4bc5-ac36-4fc003579af6\") "
Sep 11 22:07:08.425056 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.425020    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a5439f0b-9524-4bc5-ac36-4fc003579af6" (UID: "a5439f0b-9524-4bc5-ac36-4fc003579af6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:07:08.425235 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.425215    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5439f0b-9524-4bc5-ac36-4fc003579af6-kube-api-access-ghk8w" (OuterVolumeSpecName: "kube-api-access-ghk8w") pod "a5439f0b-9524-4bc5-ac36-4fc003579af6" (UID: "a5439f0b-9524-4bc5-ac36-4fc003579af6"). InnerVolumeSpecName "kube-api-access-ghk8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 22:07:08.425347 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.425328    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "a5439f0b-9524-4bc5-ac36-4fc003579af6" (UID: "a5439f0b-9524-4bc5-ac36-4fc003579af6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:07:08.523957 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.523920    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghk8w\" (UniqueName: \"kubernetes.io/projected/a5439f0b-9524-4bc5-ac36-4fc003579af6-kube-api-access-ghk8w\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:07:08.523957 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.523954    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:07:08.524140 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.523967    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a5439f0b-9524-4bc5-ac36-4fc003579af6-webhook-cert\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:07:08.736733 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.736700    2577 generic.go:356] "Generic (PLEG): container finished" podID="a5439f0b-9524-4bc5-ac36-4fc003579af6" containerID="fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15" exitCode=0
Sep 11 22:07:08.736944 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.736757    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f59564f6b-hbtzv"
Sep 11 22:07:08.736944 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.736778    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f59564f6b-hbtzv" event={"ID":"a5439f0b-9524-4bc5-ac36-4fc003579af6","Type":"ContainerDied","Data":"fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15"}
Sep 11 22:07:08.736944 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.736847    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f59564f6b-hbtzv" event={"ID":"a5439f0b-9524-4bc5-ac36-4fc003579af6","Type":"ContainerDied","Data":"e1b84b82b948011520ee9be831dade8bb962e76c336f1b587f09ff3ac0de8029"}
Sep 11 22:07:08.736944 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.736871    2577 scope.go:117] "RemoveContainer" containerID="fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15"
Sep 11 22:07:08.746802 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.746779    2577 scope.go:117] "RemoveContainer" containerID="fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15"
Sep 11 22:07:08.747095 ip-10-0-137-44 kubenswrapper[2577]: E0911 22:07:08.747076    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15\": container with ID starting with fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15 not found: ID does not exist" containerID="fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15"
Sep 11 22:07:08.747164 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.747102    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15"} err="failed to get container status \"fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15\": rpc error: code = NotFound desc = could not find container \"fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15\": container with ID starting with fe50e0ef9d9c0a463b30dc308c3785ad3101c1b93b41354d0315cf7f14f37a15 not found: ID does not exist"
Sep 11 22:07:08.759226 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.759203    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-hbtzv"]
Sep 11 22:07:08.762171 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:08.762150    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f59564f6b-hbtzv"]
Sep 11 22:07:09.760532 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:07:09.760500    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5439f0b-9524-4bc5-ac36-4fc003579af6" path="/var/lib/kubelet/pods/a5439f0b-9524-4bc5-ac36-4fc003579af6/volumes"
Sep 11 22:08:33.066232 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.066198    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"]
Sep 11 22:08:33.066752 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.066451    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm" podUID="4597f207-acb0-4742-a559-4c0eccc3c236" containerName="manager" containerID="cri-o://630d3285c0367800f6a4ce2ce87560881354123065e80bfe8ca068e3a66e1d5c" gracePeriod=10
Sep 11 22:08:33.250408 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.250373    2577 generic.go:356] "Generic (PLEG): container finished" podID="4597f207-acb0-4742-a559-4c0eccc3c236" containerID="630d3285c0367800f6a4ce2ce87560881354123065e80bfe8ca068e3a66e1d5c" exitCode=0
Sep 11 22:08:33.250560 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.250415    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm" event={"ID":"4597f207-acb0-4742-a559-4c0eccc3c236","Type":"ContainerDied","Data":"630d3285c0367800f6a4ce2ce87560881354123065e80bfe8ca068e3a66e1d5c"}
Sep 11 22:08:33.250560 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.250524    2577 scope.go:117] "RemoveContainer" containerID="89a17f1a29dcf8d8be17ffc1b20633e9785363fea088be4908a523633dbb5f57"
Sep 11 22:08:33.326424 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.326369    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 22:08:33.404571 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.404533    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j55td\" (UniqueName: \"kubernetes.io/projected/4597f207-acb0-4742-a559-4c0eccc3c236-kube-api-access-j55td\") pod \"4597f207-acb0-4742-a559-4c0eccc3c236\" (UID: \"4597f207-acb0-4742-a559-4c0eccc3c236\") "
Sep 11 22:08:33.404731 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.404647    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4597f207-acb0-4742-a559-4c0eccc3c236-extensions-socket-volume\") pod \"4597f207-acb0-4742-a559-4c0eccc3c236\" (UID: \"4597f207-acb0-4742-a559-4c0eccc3c236\") "
Sep 11 22:08:33.405001 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.404980    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4597f207-acb0-4742-a559-4c0eccc3c236-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4597f207-acb0-4742-a559-4c0eccc3c236" (UID: "4597f207-acb0-4742-a559-4c0eccc3c236"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 22:08:33.405072 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.405052    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4597f207-acb0-4742-a559-4c0eccc3c236-extensions-socket-volume\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:08:33.406686 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.406666    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4597f207-acb0-4742-a559-4c0eccc3c236-kube-api-access-j55td" (OuterVolumeSpecName: "kube-api-access-j55td") pod "4597f207-acb0-4742-a559-4c0eccc3c236" (UID: "4597f207-acb0-4742-a559-4c0eccc3c236"). InnerVolumeSpecName "kube-api-access-j55td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 22:08:33.505759 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:33.505735    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j55td\" (UniqueName: \"kubernetes.io/projected/4597f207-acb0-4742-a559-4c0eccc3c236-kube-api-access-j55td\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:08:34.258350 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:34.258317    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"
Sep 11 22:08:34.258819 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:34.258360    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm" event={"ID":"4597f207-acb0-4742-a559-4c0eccc3c236","Type":"ContainerDied","Data":"4012e76d54501e25f2d1526ef509335148322782edc497ca2254e1fadc1f1fff"}
Sep 11 22:08:34.258819 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:34.258416    2577 scope.go:117] "RemoveContainer" containerID="630d3285c0367800f6a4ce2ce87560881354123065e80bfe8ca068e3a66e1d5c"
Sep 11 22:08:34.278839 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:34.278814    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"]
Sep 11 22:08:34.282538 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:34.282517    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-xwtvm"]
Sep 11 22:08:35.761090 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:08:35.761052    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4597f207-acb0-4742-a559-4c0eccc3c236" path="/var/lib/kubelet/pods/4597f207-acb0-4742-a559-4c0eccc3c236/volumes"
Sep 11 22:09:33.747167 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747135    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"]
Sep 11 22:09:33.747669 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747591    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4597f207-acb0-4742-a559-4c0eccc3c236" containerName="manager"
Sep 11 22:09:33.747669 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747603    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4597f207-acb0-4742-a559-4c0eccc3c236" containerName="manager"
Sep 11 22:09:33.747669 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747618    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4597f207-acb0-4742-a559-4c0eccc3c236" containerName="manager"
Sep 11 22:09:33.747669 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747624    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4597f207-acb0-4742-a559-4c0eccc3c236" containerName="manager"
Sep 11 22:09:33.747669 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747654    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5439f0b-9524-4bc5-ac36-4fc003579af6" containerName="manager"
Sep 11 22:09:33.747669 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747659    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5439f0b-9524-4bc5-ac36-4fc003579af6" containerName="manager"
Sep 11 22:09:33.747915 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747726    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4597f207-acb0-4742-a559-4c0eccc3c236" containerName="manager"
Sep 11 22:09:33.747915 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747736    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4597f207-acb0-4742-a559-4c0eccc3c236" containerName="manager"
Sep 11 22:09:33.747915 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.747742    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5439f0b-9524-4bc5-ac36-4fc003579af6" containerName="manager"
Sep 11 22:09:33.750807 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.750791    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:33.753448 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.753409    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-9sjbw\""
Sep 11 22:09:33.763769 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.763714    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"]
Sep 11 22:09:33.850682 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.850649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqgm2\" (UniqueName: \"kubernetes.io/projected/2af13a88-953b-45c3-9c75-7f7c4bcdbf53-kube-api-access-qqgm2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fxfz5\" (UID: \"2af13a88-953b-45c3-9c75-7f7c4bcdbf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:33.850837 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.850721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2af13a88-953b-45c3-9c75-7f7c4bcdbf53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fxfz5\" (UID: \"2af13a88-953b-45c3-9c75-7f7c4bcdbf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:33.951698 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.951667    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2af13a88-953b-45c3-9c75-7f7c4bcdbf53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fxfz5\" (UID: \"2af13a88-953b-45c3-9c75-7f7c4bcdbf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:33.951855 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.951749    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqgm2\" (UniqueName: \"kubernetes.io/projected/2af13a88-953b-45c3-9c75-7f7c4bcdbf53-kube-api-access-qqgm2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fxfz5\" (UID: \"2af13a88-953b-45c3-9c75-7f7c4bcdbf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:33.952052 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.952032    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2af13a88-953b-45c3-9c75-7f7c4bcdbf53-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fxfz5\" (UID: \"2af13a88-953b-45c3-9c75-7f7c4bcdbf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:33.961267 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:33.961239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqgm2\" (UniqueName: \"kubernetes.io/projected/2af13a88-953b-45c3-9c75-7f7c4bcdbf53-kube-api-access-qqgm2\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fxfz5\" (UID: \"2af13a88-953b-45c3-9c75-7f7c4bcdbf53\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:34.062147 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:34.062078    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:34.337606 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:34.337583    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"]
Sep 11 22:09:34.339624 ip-10-0-137-44 kubenswrapper[2577]: W0911 22:09:34.339589    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af13a88_953b_45c3_9c75_7f7c4bcdbf53.slice/crio-f3cc1bb91cdeca899418bd18d5aa7525dd3c593e538f6b934effd74852af8fa2 WatchSource:0}: Error finding container f3cc1bb91cdeca899418bd18d5aa7525dd3c593e538f6b934effd74852af8fa2: Status 404 returned error can't find the container with id f3cc1bb91cdeca899418bd18d5aa7525dd3c593e538f6b934effd74852af8fa2
Sep 11 22:09:34.613706 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:34.613618    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5" event={"ID":"2af13a88-953b-45c3-9c75-7f7c4bcdbf53","Type":"ContainerStarted","Data":"8690a353b6a2d3d334c5902cad14d699dd0324734607a46b2fb7857e1f987681"}
Sep 11 22:09:34.613706 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:34.613669    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5" event={"ID":"2af13a88-953b-45c3-9c75-7f7c4bcdbf53","Type":"ContainerStarted","Data":"f3cc1bb91cdeca899418bd18d5aa7525dd3c593e538f6b934effd74852af8fa2"}
Sep 11 22:09:34.613908 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:34.613768    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:34.635558 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:34.635513    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5" podStartSLOduration=1.6354977019999999 podStartE2EDuration="1.635497702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 22:09:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 22:09:34.633257242 +0000 UTC m=+2329.290821006" watchObservedRunningTime="2026-09-11 22:09:34.635497702 +0000 UTC m=+2329.293061463"
Sep 11 22:09:45.623553 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:45.623521    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fxfz5"
Sep 11 22:09:46.246578 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:09:46.246546    2577 scope.go:117] "RemoveContainer" containerID="0f80000e578a0b85f5d0716dc62446d4fb76a3b32630bebd1cc1b79cfb7b3084"
Sep 11 22:10:46.061807 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:10:46.061768    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 22:10:46.069493 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:10:46.069448    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 22:11:26.071259 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.071162    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"]
Sep 11 22:11:26.075393 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.075364    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"]
Sep 11 22:11:26.075558 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.075504    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.203944 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.203912    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6912766-1362-4fd1-a2a2-cd584c6064ae-metrics-certs\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.204153 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.203997    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffscg\" (UniqueName: \"kubernetes.io/projected/a6912766-1362-4fd1-a2a2-cd584c6064ae-kube-api-access-ffscg\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.204153 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.204040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6912766-1362-4fd1-a2a2-cd584c6064ae-maas-api-tls\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.204153 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.204099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6912766-1362-4fd1-a2a2-cd584c6064ae-openshift-service-ca\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.305225 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.305191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffscg\" (UniqueName: \"kubernetes.io/projected/a6912766-1362-4fd1-a2a2-cd584c6064ae-kube-api-access-ffscg\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.305373 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.305233    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6912766-1362-4fd1-a2a2-cd584c6064ae-maas-api-tls\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.305373 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.305263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6912766-1362-4fd1-a2a2-cd584c6064ae-openshift-service-ca\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.305373 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.305325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6912766-1362-4fd1-a2a2-cd584c6064ae-metrics-certs\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.306084 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.306002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6912766-1362-4fd1-a2a2-cd584c6064ae-openshift-service-ca\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.307842 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.307821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a6912766-1362-4fd1-a2a2-cd584c6064ae-metrics-certs\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.307956 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.307858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6912766-1362-4fd1-a2a2-cd584c6064ae-maas-api-tls\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.312945 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.312921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffscg\" (UniqueName: \"kubernetes.io/projected/a6912766-1362-4fd1-a2a2-cd584c6064ae-kube-api-access-ffscg\") pod \"maas-api-5c564f7cc4-7j4c6\" (UID: \"a6912766-1362-4fd1-a2a2-cd584c6064ae\") " pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.387075 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.387015    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:26.659032 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:26.659003    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"]
Sep 11 22:11:26.661381 ip-10-0-137-44 kubenswrapper[2577]: W0911 22:11:26.661353    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6912766_1362_4fd1_a2a2_cd584c6064ae.slice/crio-a3805cb077e5754c0431b9e02f62fcb2df7dcf1c46cce8eb7f9f1eacce5976f5 WatchSource:0}: Error finding container a3805cb077e5754c0431b9e02f62fcb2df7dcf1c46cce8eb7f9f1eacce5976f5: Status 404 returned error can't find the container with id a3805cb077e5754c0431b9e02f62fcb2df7dcf1c46cce8eb7f9f1eacce5976f5
Sep 11 22:11:27.284341 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:27.284253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6" event={"ID":"a6912766-1362-4fd1-a2a2-cd584c6064ae","Type":"ContainerStarted","Data":"bbdae2b2b0c9f719b4dba365b15bcacdc4a320b2aebe9fa81c4297b11f4148a6"}
Sep 11 22:11:27.284341 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:27.284315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6" event={"ID":"a6912766-1362-4fd1-a2a2-cd584c6064ae","Type":"ContainerStarted","Data":"a3805cb077e5754c0431b9e02f62fcb2df7dcf1c46cce8eb7f9f1eacce5976f5"}
Sep 11 22:11:27.284759 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:27.284425    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:27.304553 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:27.304494    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6" podStartSLOduration=0.977944798 podStartE2EDuration="1.304460947s" totalImagesPullingTime="326.516149ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 22:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 22:11:27.300934051 +0000 UTC m=+2441.958497828" watchObservedRunningTime="2026-09-11 22:11:27.304460947 +0000 UTC m=+2441.962024744"
Sep 11 22:11:33.295902 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:33.295870    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5c564f7cc4-7j4c6"
Sep 11 22:11:33.343572 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:33.343534    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"]
Sep 11 22:11:33.343770 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:33.343734    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg" podUID="f1672317-e74e-4735-9039-0167625ad4c6" containerName="maas-api" containerID="cri-o://79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe" gracePeriod=30
Sep 11 22:11:34.592164 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.592142    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 22:11:34.678817 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.678726    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1672317-e74e-4735-9039-0167625ad4c6-openshift-service-ca\") pod \"f1672317-e74e-4735-9039-0167625ad4c6\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") "
Sep 11 22:11:34.678817 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.678776    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-maas-api-tls\") pod \"f1672317-e74e-4735-9039-0167625ad4c6\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") "
Sep 11 22:11:34.678817 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.678806    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-metrics-certs\") pod \"f1672317-e74e-4735-9039-0167625ad4c6\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") "
Sep 11 22:11:34.679167 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.679141    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1672317-e74e-4735-9039-0167625ad4c6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f1672317-e74e-4735-9039-0167625ad4c6" (UID: "f1672317-e74e-4735-9039-0167625ad4c6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 22:11:34.681045 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.681021    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f1672317-e74e-4735-9039-0167625ad4c6" (UID: "f1672317-e74e-4735-9039-0167625ad4c6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:11:34.681159 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.681057    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f1672317-e74e-4735-9039-0167625ad4c6" (UID: "f1672317-e74e-4735-9039-0167625ad4c6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 22:11:34.779672 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.779639    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfzp5\" (UniqueName: \"kubernetes.io/projected/f1672317-e74e-4735-9039-0167625ad4c6-kube-api-access-gfzp5\") pod \"f1672317-e74e-4735-9039-0167625ad4c6\" (UID: \"f1672317-e74e-4735-9039-0167625ad4c6\") "
Sep 11 22:11:34.779880 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.779869    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1672317-e74e-4735-9039-0167625ad4c6-openshift-service-ca\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:11:34.779931 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.779883    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-maas-api-tls\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:11:34.779931 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.779892    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1672317-e74e-4735-9039-0167625ad4c6-metrics-certs\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:11:34.781815 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.781792    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1672317-e74e-4735-9039-0167625ad4c6-kube-api-access-gfzp5" (OuterVolumeSpecName: "kube-api-access-gfzp5") pod "f1672317-e74e-4735-9039-0167625ad4c6" (UID: "f1672317-e74e-4735-9039-0167625ad4c6"). InnerVolumeSpecName "kube-api-access-gfzp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 22:11:34.880939 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:34.880904    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfzp5\" (UniqueName: \"kubernetes.io/projected/f1672317-e74e-4735-9039-0167625ad4c6-kube-api-access-gfzp5\") on node \"ip-10-0-137-44.ec2.internal\" DevicePath \"\""
Sep 11 22:11:35.332486 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.332430    2577 generic.go:356] "Generic (PLEG): container finished" podID="f1672317-e74e-4735-9039-0167625ad4c6" containerID="79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe" exitCode=0
Sep 11 22:11:35.332674 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.332498    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"
Sep 11 22:11:35.332674 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.332507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg" event={"ID":"f1672317-e74e-4735-9039-0167625ad4c6","Type":"ContainerDied","Data":"79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe"}
Sep 11 22:11:35.332674 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.332578    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg" event={"ID":"f1672317-e74e-4735-9039-0167625ad4c6","Type":"ContainerDied","Data":"2921e7a0f34eadde9ce233c82def16e71cf87cd7078bc3523f2c35e048932143"}
Sep 11 22:11:35.332674 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.332602    2577 scope.go:117] "RemoveContainer" containerID="79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe"
Sep 11 22:11:35.342547 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.342528    2577 scope.go:117] "RemoveContainer" containerID="79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe"
Sep 11 22:11:35.342808 ip-10-0-137-44 kubenswrapper[2577]: E0911 22:11:35.342789    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe\": container with ID starting with 79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe not found: ID does not exist" containerID="79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe"
Sep 11 22:11:35.342851 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.342816    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe"} err="failed to get container status \"79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe\": rpc error: code = NotFound desc = could not find container \"79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe\": container with ID starting with 79524c114c415fa578be9b1b7218f946e1f85ad074bf71bde70b55d2e9dfc4fe not found: ID does not exist"
Sep 11 22:11:35.355146 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.355122    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"]
Sep 11 22:11:35.360763 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.360740    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-85cff974b6-dnqjg"]
Sep 11 22:11:35.761934 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:35.761905    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1672317-e74e-4735-9039-0167625ad4c6" path="/var/lib/kubelet/pods/f1672317-e74e-4735-9039-0167625ad4c6/volumes"
Sep 11 22:11:54.518742 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:54.518708    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xf759_670ac9d9-a874-4259-8bf3-170a220c1d8f/manager/0.log"
Sep 11 22:11:54.643676 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:54.643646    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-25cqj_d5d6b4da-6c4b-49a2-867e-fea920943fe6/manager/0.log"
Sep 11 22:11:55.227277 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:55.227222    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595996979b-rgpjp_26cbeba0-0033-43cf-aebc-7527d6826403/copy-manifests/0.log"
Sep 11 22:11:55.245255 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:55.245230    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595996979b-rgpjp_26cbeba0-0033-43cf-aebc-7527d6826403/manager/0.log"
Sep 11 22:11:55.702443 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:55.702416    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5c564f7cc4-7j4c6_a6912766-1362-4fd1-a2a2-cd584c6064ae/maas-api/0.log"
Sep 11 22:11:56.135803 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:56.135727    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-7s8jh_1fc2f9b9-a8d2-410c-9bd3-047baa1d15f9/postgres/0.log"
Sep 11 22:11:57.038008 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:57.037979    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-k26vd_416925e6-86ac-4eff-9e55-5269696f6b1d/manager/0.log"
Sep 11 22:11:57.154711 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:57.154674    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-7sv7f_d757936c-2efc-416f-8cbe-7a3dc60e99a4/manager/0.log"
Sep 11 22:11:57.266397 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:57.266367    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-p7sc6_c60d121d-a891-4ff2-8caf-e9bbdd005f17/kuadrant-console-plugin/0.log"
Sep 11 22:11:57.395260 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:57.395185    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fxfz5_2af13a88-953b-45c3-9c75-7f7c4bcdbf53/manager/0.log"
Sep 11 22:11:57.641693 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:57.641661    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-5wpdd_cb5dff64-39d2-4956-a720-a26e17cfdbff/manager/0.log"
Sep 11 22:11:58.350858 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:58.350831    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57ddc9f5f6-m2j22_634570e3-f51b-472a-94c3-fe1319976d6c/kube-auth-proxy/0.log"
Sep 11 22:11:58.466430 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:58.466398    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t5pnb_e5fd29eb-c039-4b76-bd5e-c958a68dd71c/istio-proxy/1.log"
Sep 11 22:11:58.721672 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:58.721638    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tfpz_1f0e7cf0-40f5-4689-a946-f62eb479307c/payload-processing/0.log"
Sep 11 22:11:59.314702 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:59.314669    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-7d96c_e2332545-7b51-4de1-910f-0350a05d7517/main/0.log"
Sep 11 22:11:59.669369 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:11:59.669335    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f5b7w5_59e5022c-74ae-44d8-9ffb-57f33b69a464/main/0.log"
Sep 11 22:12:08.420159 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:08.420121    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2njxc_c5c7b2cc-2002-4017-abc7-48c1210d57d4/global-pull-secret-syncer/0.log"
Sep 11 22:12:08.641067 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:08.641035    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kb4d7_6e75675d-b276-422e-a340-463e6d926733/konnectivity-agent/0.log"
Sep 11 22:12:08.662587 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:08.662565    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-44.ec2.internal_76a1d0169b7ad52781e0506059c05051/haproxy/0.log"
Sep 11 22:12:13.735657 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:13.735611    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-k26vd_416925e6-86ac-4eff-9e55-5269696f6b1d/manager/0.log"
Sep 11 22:12:13.759666 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:13.759625    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-7sv7f_d757936c-2efc-416f-8cbe-7a3dc60e99a4/manager/0.log"
Sep 11 22:12:13.785121 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:13.785097    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-p7sc6_c60d121d-a891-4ff2-8caf-e9bbdd005f17/kuadrant-console-plugin/0.log"
Sep 11 22:12:13.833076 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:13.833048    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-fxfz5_2af13a88-953b-45c3-9c75-7f7c4bcdbf53/manager/0.log"
Sep 11 22:12:13.959998 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:13.959969    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-5wpdd_cb5dff64-39d2-4956-a720-a26e17cfdbff/manager/0.log"
Sep 11 22:12:15.396294 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.396265    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa3930e-2cef-45cf-85db-91c1e2feca7b/alertmanager/0.log"
Sep 11 22:12:15.417377 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.417355    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa3930e-2cef-45cf-85db-91c1e2feca7b/config-reloader/0.log"
Sep 11 22:12:15.436956 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.436932    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa3930e-2cef-45cf-85db-91c1e2feca7b/kube-rbac-proxy-web/0.log"
Sep 11 22:12:15.455446 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.455424    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa3930e-2cef-45cf-85db-91c1e2feca7b/kube-rbac-proxy/0.log"
Sep 11 22:12:15.475250 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.475231    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa3930e-2cef-45cf-85db-91c1e2feca7b/kube-rbac-proxy-metric/0.log"
Sep 11 22:12:15.502941 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.502919    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa3930e-2cef-45cf-85db-91c1e2feca7b/prom-label-proxy/0.log"
Sep 11 22:12:15.525869 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.525850    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_caa3930e-2cef-45cf-85db-91c1e2feca7b/init-config-reloader/0.log"
Sep 11 22:12:15.611077 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.611046    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-g2bf9_b29c9789-741d-4b48-9c86-cc8101209e2d/kube-state-metrics/0.log"
Sep 11 22:12:15.624507 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.624464    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-g2bf9_b29c9789-741d-4b48-9c86-cc8101209e2d/kube-rbac-proxy-main/0.log"
Sep 11 22:12:15.642363 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.642343    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-g2bf9_b29c9789-741d-4b48-9c86-cc8101209e2d/kube-rbac-proxy-self/0.log"
Sep 11 22:12:15.665415 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.665389    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bd5645c6d-7ftm2_6f90d420-5199-4a9c-b3a4-08356b049c3a/metrics-server/0.log"
Sep 11 22:12:15.687409 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.687386    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-dwhcx_f06fb64c-bca1-4f19-bb00-3954239d1632/monitoring-plugin/0.log"
Sep 11 22:12:15.869138 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.869108    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vjdvw_d57c8e7a-638e-418f-abc9-b8fba855151a/node-exporter/0.log"
Sep 11 22:12:15.916380 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.916294    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vjdvw_d57c8e7a-638e-418f-abc9-b8fba855151a/kube-rbac-proxy/0.log"
Sep 11 22:12:15.937450 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.937426    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vjdvw_d57c8e7a-638e-418f-abc9-b8fba855151a/init-textfile/0.log"
Sep 11 22:12:15.977845 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:15.977820    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-sfrbk_e12c8cad-9f43-4741-9851-a45bd620459c/kube-rbac-proxy-main/0.log"
Sep 11 22:12:16.006251 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:16.006231    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-sfrbk_e12c8cad-9f43-4741-9851-a45bd620459c/kube-rbac-proxy-self/0.log"
Sep 11 22:12:16.031788 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:16.031763    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-67dcf8c979-sfrbk_e12c8cad-9f43-4741-9851-a45bd620459c/openshift-state-metrics/0.log"
Sep 11 22:12:16.310027 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:16.309940    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8657f4855f-kp67p_0b858fe3-eb3f-4b31-b6d4-89261648db02/telemeter-client/0.log"
Sep 11 22:12:16.329362 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:16.329337    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8657f4855f-kp67p_0b858fe3-eb3f-4b31-b6d4-89261648db02/reload/0.log"
Sep 11 22:12:16.350613 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:16.350588    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-8657f4855f-kp67p_0b858fe3-eb3f-4b31-b6d4-89261648db02/kube-rbac-proxy/0.log"
Sep 11 22:12:18.487727 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.487700    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/1.log"
Sep 11 22:12:18.497594 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.497563    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-68j49_5db6f14e-085e-4e88-8478-9fcd12a4ada3/console-operator/2.log"
Sep 11 22:12:18.738967 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.738890    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"]
Sep 11 22:12:18.739554 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.739538    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1672317-e74e-4735-9039-0167625ad4c6" containerName="maas-api"
Sep 11 22:12:18.739608 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.739558    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1672317-e74e-4735-9039-0167625ad4c6" containerName="maas-api"
Sep 11 22:12:18.739659 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.739648    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1672317-e74e-4735-9039-0167625ad4c6" containerName="maas-api"
Sep 11 22:12:18.744267 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.744242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.747041 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.747015    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlxlj\"/\"kube-root-ca.crt\""
Sep 11 22:12:18.748017 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.747994    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wlxlj\"/\"openshift-service-ca.crt\""
Sep 11 22:12:18.748144 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.748021    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wlxlj\"/\"default-dockercfg-rq6g6\""
Sep 11 22:12:18.751631 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.751515    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"]
Sep 11 22:12:18.792870 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.792844    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-lib-modules\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.792980 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.792880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-sys\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.792980 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.792902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv6nj\" (UniqueName: \"kubernetes.io/projected/a51b8788-71ab-4d00-a162-00063d1e3921-kube-api-access-zv6nj\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.793054 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.792978    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-proc\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.793054 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.793034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-podres\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.894049 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.894020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-lib-modules\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.894167 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.894060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-sys\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.894167 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.894083    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv6nj\" (UniqueName: \"kubernetes.io/projected/a51b8788-71ab-4d00-a162-00063d1e3921-kube-api-access-zv6nj\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.894167 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.894108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-proc\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.894167 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.894140    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-podres\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.894167 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.894152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-sys\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.894338 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.894174    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-lib-modules\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.894338 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.894218    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-proc\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.894338 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.894250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a51b8788-71ab-4d00-a162-00063d1e3921-podres\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:18.902444 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:18.902415    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv6nj\" (UniqueName: \"kubernetes.io/projected/a51b8788-71ab-4d00-a162-00063d1e3921-kube-api-access-zv6nj\") pod \"perf-node-gather-daemonset-pwnqx\" (UID: \"a51b8788-71ab-4d00-a162-00063d1e3921\") " pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:19.055210 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:19.055118    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:19.085049 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:19.085024    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c5bbc9d79-jt78h_0d48d188-b2aa-4a3f-9fde-4ca3034f819a/console/0.log"
Sep 11 22:12:19.137482 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:19.137450    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-fm7wj_77d36878-31ac-4fa1-93f8-208f7b5b7be5/download-server/0.log"
Sep 11 22:12:19.329853 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:19.329816    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"]
Sep 11 22:12:19.331664 ip-10-0-137-44 kubenswrapper[2577]: W0911 22:12:19.331638    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda51b8788_71ab_4d00_a162_00063d1e3921.slice/crio-016830137d9e91046c88b68be916f674ce8ed60f5f34f44e4b3a1caa8956e4e8 WatchSource:0}: Error finding container 016830137d9e91046c88b68be916f674ce8ed60f5f34f44e4b3a1caa8956e4e8: Status 404 returned error can't find the container with id 016830137d9e91046c88b68be916f674ce8ed60f5f34f44e4b3a1caa8956e4e8
Sep 11 22:12:19.608045 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:19.607946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx" event={"ID":"a51b8788-71ab-4d00-a162-00063d1e3921","Type":"ContainerStarted","Data":"2eb6d59851d82264fdfa7f3969e17f08cd58c47870cc153ccbe80561c17bcd26"}
Sep 11 22:12:19.608045 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:19.608009    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx" event={"ID":"a51b8788-71ab-4d00-a162-00063d1e3921","Type":"ContainerStarted","Data":"016830137d9e91046c88b68be916f674ce8ed60f5f34f44e4b3a1caa8956e4e8"}
Sep 11 22:12:19.608045 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:19.608036    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:19.626238 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:19.626188    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx" podStartSLOduration=1.626171651 podStartE2EDuration="1.626171651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 22:12:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 22:12:19.624208502 +0000 UTC m=+2494.281772293" watchObservedRunningTime="2026-09-11 22:12:19.626171651 +0000 UTC m=+2494.283735414"
Sep 11 22:12:19.776908 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:19.776866    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-8mcdd_c8a57eed-da5e-4c48-b65c-f0e8cd2870f4/volume-data-source-validator/0.log"
Sep 11 22:12:20.885353 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:20.885318    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvtpj_37d16b56-27f1-401b-a3f4-a389d0c47db2/dns/0.log"
Sep 11 22:12:20.962001 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:20.961974    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qvtpj_37d16b56-27f1-401b-a3f4-a389d0c47db2/kube-rbac-proxy/0.log"
Sep 11 22:12:21.099088 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:21.099061    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qk2kp_df3c63c2-3ae5-4590-b4b3-4dd8d0711c6a/dns-node-resolver/0.log"
Sep 11 22:12:21.605780 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:21.605753    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-b4f9b6787-nfmhg_ce310f77-4a97-4b8a-bdfb-390c9d741ffd/registry/0.log"
Sep 11 22:12:21.626806 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:21.626774    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-44hdm_0203e501-dc3f-4bee-9548-4fceb0ff9093/node-ca/0.log"
Sep 11 22:12:23.465168 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:23.465140    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57ddc9f5f6-m2j22_634570e3-f51b-472a-94c3-fe1319976d6c/kube-auth-proxy/0.log"
Sep 11 22:12:23.492657 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:23.492625    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t5pnb_e5fd29eb-c039-4b76-bd5e-c958a68dd71c/istio-proxy/0.log"
Sep 11 22:12:23.497429 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:23.497407    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t5pnb_e5fd29eb-c039-4b76-bd5e-c958a68dd71c/istio-proxy/1.log"
Sep 11 22:12:23.574171 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:23.574140    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tfpz_1f0e7cf0-40f5-4689-a946-f62eb479307c/payload-processing/0.log"
Sep 11 22:12:24.436585 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:24.436530    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2tffz_e14323f8-b148-472b-90a1-a435a41d7cd9/serve-healthcheck-canary/0.log"
Sep 11 22:12:25.029206 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:25.029173    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dg6h_7d3e45c2-175b-4a26-a246-d234a868430c/kube-rbac-proxy/0.log"
Sep 11 22:12:25.047530 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:25.047504    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dg6h_7d3e45c2-175b-4a26-a246-d234a868430c/exporter/0.log"
Sep 11 22:12:25.066289 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:25.066262    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8dg6h_7d3e45c2-175b-4a26-a246-d234a868430c/extractor/0.log"
Sep 11 22:12:25.624735 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:25.624709    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wlxlj/perf-node-gather-daemonset-pwnqx"
Sep 11 22:12:27.183267 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:27.183233    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xf759_670ac9d9-a874-4259-8bf3-170a220c1d8f/manager/0.log"
Sep 11 22:12:27.674453 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:27.674424    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-25cqj_d5d6b4da-6c4b-49a2-867e-fea920943fe6/manager/0.log"
Sep 11 22:12:28.080739 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:28.080704    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595996979b-rgpjp_26cbeba0-0033-43cf-aebc-7527d6826403/manager/0.log"
Sep 11 22:12:28.095595 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:28.095572    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-595996979b-rgpjp_26cbeba0-0033-43cf-aebc-7527d6826403/copy-manifests/0.log"
Sep 11 22:12:29.697455 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:29.697424    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57ddc9f5f6-m2j22_634570e3-f51b-472a-94c3-fe1319976d6c/kube-auth-proxy/0.log"
Sep 11 22:12:29.715207 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:29.715173    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t5pnb_e5fd29eb-c039-4b76-bd5e-c958a68dd71c/istio-proxy/0.log"
Sep 11 22:12:29.721998 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:29.721974    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t5pnb_e5fd29eb-c039-4b76-bd5e-c958a68dd71c/istio-proxy/1.log"
Sep 11 22:12:29.784156 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:29.784130    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tfpz_1f0e7cf0-40f5-4689-a946-f62eb479307c/payload-processing/0.log"
Sep 11 22:12:32.219431 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:32.219401    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57ddc9f5f6-m2j22_634570e3-f51b-472a-94c3-fe1319976d6c/kube-auth-proxy/0.log"
Sep 11 22:12:32.248129 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:32.248101    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t5pnb_e5fd29eb-c039-4b76-bd5e-c958a68dd71c/istio-proxy/0.log"
Sep 11 22:12:32.254042 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:32.254012    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-t5pnb_e5fd29eb-c039-4b76-bd5e-c958a68dd71c/istio-proxy/1.log"
Sep 11 22:12:32.317423 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:32.317398    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-9tfpz_1f0e7cf0-40f5-4689-a946-f62eb479307c/payload-processing/0.log"
Sep 11 22:12:34.363409 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:34.363368    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-jkz5m_3ab48ac4-cc66-4d2a-ac9a-90582d43876a/migrator/0.log"
Sep 11 22:12:34.381729 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:34.381706    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-jkz5m_3ab48ac4-cc66-4d2a-ac9a-90582d43876a/graceful-termination/0.log"
Sep 11 22:12:34.741944 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:34.741912    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-b84fl_d0aba8ef-4c48-4e84-a846-5c3265089c47/kube-storage-version-migrator-operator/1.log"
Sep 11 22:12:34.743499 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:34.743459    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-b84fl_d0aba8ef-4c48-4e84-a846-5c3265089c47/kube-storage-version-migrator-operator/0.log"
Sep 11 22:12:36.076968 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:36.076939    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wg5r2_260ab03b-1ce0-477b-976d-8da2806c4f3d/kube-multus-additional-cni-plugins/0.log"
Sep 11 22:12:36.095363 ip-10-0-137-44 kubenswrapper[2577]: I0911 22:12:36.095341    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wg5r2_260ab03b-1ce0-477b-976d-8da2806c4f3d/egress-router-binary-copy/0.log"