Jul 29 01:10:23.239616 ip-10-0-139-204 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 01:10:23.621504 ip-10-0-139-204 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:10:23.621504 ip-10-0-139-204 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 01:10:23.621504 ip-10-0-139-204 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:10:23.621504 ip-10-0-139-204 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 01:10:23.621504 ip-10-0-139-204 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 01:10:23.622513 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.622433    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 01:10:23.627586 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627571    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:23.627586 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627586    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627590    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627593    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627596    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627599    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627601    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627604    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627607    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627609    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627618    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627622    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627624    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627628    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627631    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627634    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627637    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627640    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627643    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627645    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:23.627645 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627648    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627651    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627654    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627657    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627659    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627662    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627664    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627666    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627669    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627671    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627673    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627676    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627678    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627680    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627683    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627685    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627687    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627690    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627697    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627700    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:23.628078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627702    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627705    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627707    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627709    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627711    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627714    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627716    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627718    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627721    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627724    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627726    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627728    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627731    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627734    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627737    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627740    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627743    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627745    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627747    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627750    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:23.628557 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627752    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627755    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627758    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627760    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627762    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627765    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627767    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627770    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627772    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627774    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627777    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627779    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627782    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627786    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627789    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627792    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627795    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627798    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627800    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:23.629060 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627803    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627806    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627808    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627811    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627813    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627816    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627818    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627821    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627824    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627826    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627828    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627831    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627833    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627836    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627838    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627840    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627842    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627845    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627847    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:23.629517 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.627850    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:23.630375 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630363    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:23.630375 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630374    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630378    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630381    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630383    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630387    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630390    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630392    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630395    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630397    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630399    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630402    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630404    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630407    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630409    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630412    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630414    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630417    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630419    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630422    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630424    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:23.630432 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630426    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630430    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630434    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630437    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630440    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630442    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630445    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630448    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630450    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630453    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630455    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630457    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630460    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630462    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630464    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630467    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630469    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630472    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630474    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:23.630909 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630476    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630479    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630481    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630483    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630486    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630488    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630491    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630493    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630495    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630502    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630505    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630507    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630509    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630512    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630514    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630518    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630521    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630523    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630526    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630528    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:23.631366 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630531    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630533    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630536    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630538    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630540    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630543    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630546    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630548    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630550    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630552    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630555    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630563    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630565    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630567    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630570    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630573    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630575    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630579    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630583    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630585    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:23.631845 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630587    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630590    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630592    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630595    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630597    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630600    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630603    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630605    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630607    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630610    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630612    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630615    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630617    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630619    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630623    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630626    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630630    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630632    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.630635    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631038    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:23.632342 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631046    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631051    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631055    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631059    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631062    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631066    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631070    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631073    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631075    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631078    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631081    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631083    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631086    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631088    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631091    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631094    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631096    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631099    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631101    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631104    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:23.632799 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631107    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631109    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631113    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631117    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631121    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631125    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631130    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631132    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631135    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631138    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631140    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631144    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631146    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631149    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631151    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631153    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631157    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631159    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631161    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631164    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:23.633271 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631166    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631168    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631170    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631173    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631175    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631177    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631180    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631182    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631185    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631188    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631190    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631194    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631198    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631216    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631220    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631224    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631226    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631228    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631231    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631233    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:23.633748 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631235    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631238    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631240    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631243    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631245    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631247    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631250    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631252    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631255    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631258    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631260    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631263    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631265    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631267    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631271    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631274    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631276    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631280    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631284    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:23.634253 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631289    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631293    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631298    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631301    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631315    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631319    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631322    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631325    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631328    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631331    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631334    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631336    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631338    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631341    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631343    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631345    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631348    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631350    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.631352    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631420    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 01:10:23.634704 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631433    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631440    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631447    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631455    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631460    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631464    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631468    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631471    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631474    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631477    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631480    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631483    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631486    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631488    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631491    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631494    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631497    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631501    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631504    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631506    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631509    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631512    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631515    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 01:10:23.635175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631518    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631523    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631529    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631533    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631538    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631541    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631544    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631546    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631550    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631555    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631557    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631561    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631563    2565 flags.go:64] FLAG: --enable-server="true"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631566    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631570    2565 flags.go:64] FLAG: --event-burst="100"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631573    2565 flags.go:64] FLAG: --event-qps="50"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631576    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631579    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631581    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631590    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631593    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631597    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631601    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631606    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631610    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 01:10:23.635726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631615    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631619    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631622    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631625    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631627    2565 flags.go:64] FLAG: --feature-gates=""
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631631    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631634    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631637    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631639    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631642    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631645    2565 flags.go:64] FLAG: --help="false"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631648    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-139-204.ec2.internal"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631651    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631653    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631656    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631659    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631663    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631666    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631669    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631671    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631674    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631677    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631681    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631685    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 29 01:10:23.636337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631690    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631695    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631699    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631702    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631705    2565 flags.go:64] FLAG: --lock-file=""
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631708    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631711    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631714    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631719    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631721    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631724    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631727    2565 flags.go:64] FLAG: --logging-format="text"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631729    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631732    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631735    2565 flags.go:64] FLAG: --manifest-url=""
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631737    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631741    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631744    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631748    2565 flags.go:64] FLAG: --max-pods="110"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631751    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631753    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631756    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631759    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631763    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631768    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 01:10:23.636898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631773    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631782    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631785    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631788    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631790    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631793    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631798    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631801    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631804    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631806    2565 flags.go:64] FLAG: --port="10250"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631809    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631812    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0025ff2f5dc8a4b7b"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631817    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631820    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631823    2565 flags.go:64] FLAG: --register-node="true"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631825    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631829    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631831    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631834    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631837    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631841    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631845    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631850    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631855    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631859    2565 flags.go:64] FLAG: --runonce="false"
Jul 29 01:10:23.637574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631862    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631865    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631867    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631870    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631872    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631875    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631879    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631882    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631884    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631887    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631890    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631892    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631895    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631906    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631909    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631914    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631916    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631920    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631925    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631931    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631936    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631940    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631942    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631945    2565 flags.go:64] FLAG: --v="2"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631949    2565 flags.go:64] FLAG: --version="false"
Jul 29 01:10:23.638194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631953    2565 flags.go:64] FLAG: --vmodule=""
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631956    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.631959    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632093    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632099    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632101    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632104    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632106    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632109    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632112    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632114    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632117    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632119    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632122    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632125    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632127    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632130    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632132    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632134    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632137    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:23.638788 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632139    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632147    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632150    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632152    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632155    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632157    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632163    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632167    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632171    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632175    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632180    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632182    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632185    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632187    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632190    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632192    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632194    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632198    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632201    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:23.639266 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632204    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632207    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632209    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632211    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632213    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632216    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632220    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632222    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632225    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632227    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632230    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632233    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632236    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632239    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632243    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632258    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632263    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632266    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632268    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:23.639762 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632272    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632284    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632287    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632289    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632292    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632294    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632296    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632299    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632301    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632315    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632318    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632321    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632324    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632328    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632332    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632336    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632340    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632345    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632347    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632353    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:23.640193 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632356    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632360    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632362    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632365    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632368    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632370    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632373    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632376    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632378    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632381    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632384    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632387    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632390    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632392    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632395    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632397    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632399    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632402    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632405    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632409    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:23.640675 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632413    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:23.641134 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632417    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:23.641134 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632421    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:23.641134 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.632424    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:23.641134 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.633115    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:10:23.641134 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.640695    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 01:10:23.641134 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.640709    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 01:10:23.641420 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.641410    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 01:10:23.641458 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.641421    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 01:10:23.641484 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641472    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:23.641484 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641477    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:23.641484 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641480    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:23.641484 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641484    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641488    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641492    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641494    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641498    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641500    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641503    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641506    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641508    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641512    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641514    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641517    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641519    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641522    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641524    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641527    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641529    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641531    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641534    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:23.641580 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641536    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641538    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641542    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641545    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641548    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641550    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641553    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641555    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641558    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641560    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641562    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641564    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641567    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641569    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641572    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641575    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641577    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641580    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641582    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641585    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:23.642020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641588    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641590    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641592    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641595    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641598    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641600    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641602    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641604    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641606    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641609    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641611    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641614    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641616    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641618    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641621    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641623    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641626    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641628    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641630    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641632    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:23.642502 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641635    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641638    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641642    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641644    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641647    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641649    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641652    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641655    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641658    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641660    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641663    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641665    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641668    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641670    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641673    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641675    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641678    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641680    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641682    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:23.643017 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641685    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641687    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641689    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641691    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641694    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641696    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641698    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641701    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641703    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641705    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641707    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641710    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641712    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641715    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641717    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641719    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641722    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:23.643613 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641724    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.641729    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641832    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641837    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641840    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641843    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641846    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641848    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641850    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641853    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641855    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641857    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641860    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641863    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 01:10:23.644003 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641865    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641867    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641870    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641872    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641874    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641876    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641879    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641881    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641883    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641886    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641888    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641890    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641893    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641895    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641897    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641900    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641902    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641904    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641906    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641908    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 01:10:23.644361 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641911    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641914    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641916    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641920    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641923    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641926    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641929    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641932    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641934    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641938    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641941    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641944    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641947    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641950    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641952    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641955    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641957    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641959    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641962    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 01:10:23.644821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641965    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641967    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641969    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641971    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641974    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641977    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641979    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641981    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641984    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641986    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641988    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641991    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641993    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641995    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.641998    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642000    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642003    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642005    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642007    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642010    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 01:10:23.645263 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642012    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642015    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642017    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642020    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642022    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642024    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642027    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642030    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642032    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642034    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642038    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642040    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642043    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642045    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642048    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642050    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642052    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642055    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642057    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642059    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 01:10:23.645749 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642062    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642064    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642066    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642069    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642071    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642073    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642076    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:23.642079    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.642084    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.642168    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.644212    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.645648    2565 server.go:1019] "Starting client certificate rotation"
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.645749    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:10:23.646236 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.645788    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 01:10:23.648551 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.648524    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:10:23.653139 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.653117    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 01:10:23.660697 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.660681    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 29 01:10:23.662900 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.662884    2565 log.go:25] "Validated CRI v1 image API"
Jul 29 01:10:23.664743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.664726    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 01:10:23.666917 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.666899    2565 fs.go:135] Filesystem UUIDs: map[506f19f7-82de-42b8-b256-7414003b90f1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a8023fe1-84e5-4a5e-9a62-bb64fd0bcad7:/dev/nvme0n1p3]
Jul 29 01:10:23.666974 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.666915    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 01:10:23.671728 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.671628    2565 manager.go:216] Machine: {Timestamp:2026-07-29 01:10:23.670270607 +0000 UTC m=+0.309367410 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3192125 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ee3b04bf0e402f2907e3d4781361f SystemUUID:ec2ee3b0-4bf0-e402-f290-7e3d4781361f BootID:5344a3b8-d2c4-44f1-a844-ec3a208b19b6 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2e:b5:da:cb:3f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2e:b5:da:cb:3f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:bd:27:1a:65:06 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 01:10:23.671728 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.671722    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 01:10:23.671838 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.671787    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 01:10:23.673196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.673179    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:10:23.674929 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.674897    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 01:10:23.675063 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.674931    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-204.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 01:10:23.675606 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.675597    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 01:10:23.675641 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.675609    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 01:10:23.675641 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.675616    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:10:23.676282 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.676274    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 01:10:23.677426 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.677417    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 01:10:23.679199 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.679189    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:10:23.679320 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.679298    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 01:10:23.679358 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.679346    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 01:10:23.679388 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.679365    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 01:10:23.679388 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.679379    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 01:10:23.679388 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.679388    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 29 01:10:23.679461 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.679395    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 01:10:23.679732 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.679716    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:10:23.679732 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.679735    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 01:10:23.681779 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.681764    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 01:10:23.683727 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.683714    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 01:10:23.683766 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.683743    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 01:10:23.685547 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685535    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 01:10:23.685592 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685553    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 01:10:23.685592 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685559    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 01:10:23.685592 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685565    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 01:10:23.685592 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685579    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 01:10:23.685592 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685587    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 01:10:23.685751 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685596    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 01:10:23.685751 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685602    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 01:10:23.685828 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685771    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 01:10:23.685887 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685796    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 01:10:23.685930 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685887    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 01:10:23.685930 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.685898    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 01:10:23.686643 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.686629    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 01:10:23.686703 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.686647    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 01:10:23.689840 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.689814    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-204.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 01:10:23.689938 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.689919    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 01:10:23.689983 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.689963    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 01:10:23.690084 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.690072    2565 server.go:1268] "Started kubelet"
Jul 29 01:10:23.690162 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.690141    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 01:10:23.690262 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.690209    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 01:10:23.690332 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.690284    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 01:10:23.690921 ip-10-0-139-204 systemd[1]: Started Kubernetes Kubelet.
Jul 29 01:10:23.692145 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.692123    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 01:10:23.694933 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.694916    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 01:10:23.695537 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.695516    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 01:10:23.696388 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.695415    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-204.ec2.internal.18c69d73f7047c2a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-204.ec2.internal,UID:ip-10-0-139-204.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-204.ec2.internal,},FirstTimestamp:2026-07-29 01:10:23.690046506 +0000 UTC m=+0.329143307,LastTimestamp:2026-07-29 01:10:23.690046506 +0000 UTC m=+0.329143307,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-204.ec2.internal,}"
Jul 29 01:10:23.699103 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.699090    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zckdk"
Jul 29 01:10:23.704544 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.704527    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zckdk"
Jul 29 01:10:23.706905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.706892    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 01:10:23.706968 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.706897    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 01:10:23.707092 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.707073    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:23.707577 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.707563    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 01:10:23.707577 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.707574    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 01:10:23.707884 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.707589    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 01:10:23.707884 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.707716    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 01:10:23.707973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.707875    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 01:10:23.707973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.707845    2565 factory.go:55] Registering systemd factory
Jul 29 01:10:23.707973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.707912    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 29 01:10:23.708126 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.708108    2565 factory.go:153] Registering CRI-O factory
Jul 29 01:10:23.708195 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.708129    2565 factory.go:223] Registration of the crio container factory successfully
Jul 29 01:10:23.708195 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.708178    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 01:10:23.708285 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.708203    2565 factory.go:103] Registering Raw factory
Jul 29 01:10:23.708285 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.708215    2565 manager.go:1196] Started watching for new ooms in manager
Jul 29 01:10:23.708841 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.708827    2565 manager.go:349] Starting recovery of all containers
Jul 29 01:10:23.709234 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.709211    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 01:10:23.709332 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.709285    2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-204.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 01:10:23.718767 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.718668    2565 manager.go:354] Recovery completed
Jul 29 01:10:23.724371 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.724355    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:23.726110 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.726094    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:23.726177 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.726122    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:23.726177 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.726132    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:23.726723 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.726706    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 01:10:23.726723 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.726719    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 01:10:23.726848 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.726733    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 01:10:23.726848 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.726734    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:23.727416 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.727399    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:23.727479 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.727432    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:23.727479 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.727443    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:23.728196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.728182    2565 policy_none.go:49] "None policy: Start"
Jul 29 01:10:23.728235 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.728204    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 01:10:23.728235 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.728218    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 01:10:23.729470 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.729459    2565 policy_none.go:47] "Start"
Jul 29 01:10:23.770213 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.770202    2565 manager.go:337] "Starting Device Plugin manager"
Jul 29 01:10:23.770262 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.770228    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 01:10:23.770262 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.770239    2565 server.go:87] "Starting device plugin registration server"
Jul 29 01:10:23.770477 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.770465    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 01:10:23.770539 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.770480    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 01:10:23.770586 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.770565    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 01:10:23.770658 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.770645    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 01:10:23.770658 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.770658    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 01:10:23.771088 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.771069    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 01:10:23.771164 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.771123    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:23.871534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.871487    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:23.873281 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.873132    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:23.873281 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.873167    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:23.873281 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.873182    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:23.873281 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.873214    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-204.ec2.internal"
Jul 29 01:10:23.878478 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.878464    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-204.ec2.internal"
Jul 29 01:10:23.878530 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.878484    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-204.ec2.internal\": node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:23.895953 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.895932    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:23.908473 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.908441    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 01:10:23.909740 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.909717    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 01:10:23.909836 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.909747    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 01:10:23.909836 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.909764    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 01:10:23.909836 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.909797    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 01:10:23.911853 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:23.911835    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:23.996992 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:23.996969    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.010336 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.010300    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"]
Jul 29 01:10:24.010422 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.010384    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:24.012402 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.012379    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:24.012495 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.012412    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:24.012495 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.012426    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:24.013891 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.013876    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:24.014004 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.013989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.014053 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.014020    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:24.014548 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.014529    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:24.014626 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.014556    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:24.014626 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.014560    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:24.014626 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.014573    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:24.014626 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.014574    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:24.014626 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.014582    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:24.015864 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.015848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.015938 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.015873    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 01:10:24.016495 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.016468    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 01:10:24.016575 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.016500    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 01:10:24.016575 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.016512    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeHasSufficientPID"
Jul 29 01:10:24.042849 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.042826    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-204.ec2.internal\" not found" node="ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.046946 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.046930    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-204.ec2.internal\" not found" node="ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.097141 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.097125    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.109836 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.109819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b3cbdd2dda476557f7e86204a599843-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9b3cbdd2dda476557f7e86204a599843\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.109880 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.109842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b3cbdd2dda476557f7e86204a599843-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9b3cbdd2dda476557f7e86204a599843\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.109880 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.109859    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15a642e5dbdb7944579e1ac85ffb4c8a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-204.ec2.internal\" (UID: \"15a642e5dbdb7944579e1ac85ffb4c8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.198257 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.198205    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.210630 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.210610    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b3cbdd2dda476557f7e86204a599843-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9b3cbdd2dda476557f7e86204a599843\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.210680 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.210637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b3cbdd2dda476557f7e86204a599843-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9b3cbdd2dda476557f7e86204a599843\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.210680 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.210653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15a642e5dbdb7944579e1ac85ffb4c8a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-204.ec2.internal\" (UID: \"15a642e5dbdb7944579e1ac85ffb4c8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.210741 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.210697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15a642e5dbdb7944579e1ac85ffb4c8a-config\") pod \"kube-apiserver-proxy-ip-10-0-139-204.ec2.internal\" (UID: \"15a642e5dbdb7944579e1ac85ffb4c8a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.210741 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.210709    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9b3cbdd2dda476557f7e86204a599843-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9b3cbdd2dda476557f7e86204a599843\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.210741 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.210704    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9b3cbdd2dda476557f7e86204a599843-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal\" (UID: \"9b3cbdd2dda476557f7e86204a599843\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.298816 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.298779    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.346253 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.346223    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.351865 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.351838    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:24.399704 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.399680    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.500183 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.500138    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.566475 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.566459    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:24.600575 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.600558    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.644991 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.644973    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 01:10:24.645398 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.645067    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:10:24.645398 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.645111    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 01:10:24.701611 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.701590    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.713351 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.713324    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 01:05:24 +0000 UTC" deadline="2028-03-28 11:33:10.720091043 +0000 UTC"
Jul 29 01:10:24.713351 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.713347    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14602h22m46.006746575s"
Jul 29 01:10:24.756507 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.756466    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:24.802494 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.802469    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.903539 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:24.903516    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-204.ec2.internal\" not found"
Jul 29 01:10:24.908935 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:24.908905    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b3cbdd2dda476557f7e86204a599843.slice/crio-33fa7aeb2999f024de1a830abd5a059706fe7e1e36978eb119c0a83851248cbb WatchSource:0}: Error finding container 33fa7aeb2999f024de1a830abd5a059706fe7e1e36978eb119c0a83851248cbb: Status 404 returned error can't find the container with id 33fa7aeb2999f024de1a830abd5a059706fe7e1e36978eb119c0a83851248cbb
Jul 29 01:10:24.912893 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.912875    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:10:24.913152 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.913108    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal" event={"ID":"9b3cbdd2dda476557f7e86204a599843","Type":"ContainerStarted","Data":"33fa7aeb2999f024de1a830abd5a059706fe7e1e36978eb119c0a83851248cbb"}
Jul 29 01:10:24.919540 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:24.919524    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:25.007705 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.007653    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:25.019527 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.019509    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:10:25.020580 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.020567    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal"
Jul 29 01:10:25.026757 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.026741    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 01:10:25.583836 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.583810    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:25.681196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.681170    2565 apiserver.go:52] "Watching apiserver"
Jul 29 01:10:25.688776 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.687817    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 01:10:25.688776 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.688334    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-tjfzp","kube-system/global-pull-secret-syncer-2k7wg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal","openshift-network-diagnostics/network-check-target-rbcnr","openshift-network-operator/iptables-alerter-dm5gq","openshift-ovn-kubernetes/ovnkube-node-thlhl","kube-system/konnectivity-agent-p9484","kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal","openshift-cluster-node-tuning-operator/tuned-4gb26","openshift-dns/node-resolver-lfbss","openshift-image-registry/node-ca-s8bh7","openshift-multus/multus-additional-cni-plugins-xg8vw","openshift-multus/multus-ff4bq"]
Jul 29 01:10:25.690302 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.690275    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.692228 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.692203    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.693367 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.693317    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:10:25.693367 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.693349    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kq67x\""
Jul 29 01:10:25.693636 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.693586    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.693636 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.693626    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 01:10:25.694705 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.694654    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 01:10:25.695175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.694878    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 01:10:25.695175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.694911    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.695175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.694978    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 01:10:25.695175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.695000    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2bckl\""
Jul 29 01:10:25.695533 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.695183    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 01:10:25.695533 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.695230    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 01:10:25.696074 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.696053    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 01:10:25.696205 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.696111    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hhnpr\""
Jul 29 01:10:25.696205 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.696141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 01:10:25.696465 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.696447    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:25.696583 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.696553    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:25.696649 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.696592    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 01:10:25.697148 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.697123    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 01:10:25.697459 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.697439    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5vqsc\""
Jul 29 01:10:25.697988 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.697970    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.700122 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.699904    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:25.701066 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.700867    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.701927 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.701548    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:10:25.701927 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.701765    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 01:10:25.702172 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.702074    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b688l\""
Jul 29 01:10:25.702248 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.702175    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 01:10:25.702652 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.702406    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 01:10:25.702744 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.702661    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 01:10:25.702744 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.702707    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:25.702844 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.702769    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:25.703764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.703045    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 01:10:25.703764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.703075    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l5f5k\""
Jul 29 01:10:25.703764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.703294    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 01:10:25.703764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.703560    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 01:10:25.703764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.703579    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 01:10:25.704039 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.703884    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:25.704039 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.703940    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:25.704039 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.704005    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 01:10:25.704190 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.704119    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 01:10:25.704190 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.704157    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-m72nq\""
Jul 29 01:10:25.706485 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.706263    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.708105 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.708085    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 01:10:25.708209 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.708169    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.709796 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.709775    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 01:10:25.710275 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.710249    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 01:10:25.710591 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.710573    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8mnnn\""
Jul 29 01:10:25.711088 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.711070    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 01:10:25.711627 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.711601    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 01:10:25.711961 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.711942    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 01:10:25.712033 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.711960    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vhg2c\""
Jul 29 01:10:25.714727 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.714706    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 01:10:25.716946 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.716928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.717224 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717166    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11070fc4-a765-4b3c-9491-06a78e7def55-ovnkube-config\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.717363 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717346    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.717450 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717378    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bwml\" (UniqueName: \"kubernetes.io/projected/0e8f9521-62b0-466a-bce8-29da863f6032-kube-api-access-6bwml\") pod \"node-resolver-lfbss\" (UID: \"0e8f9521-62b0-466a-bce8-29da863f6032\") " pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.717450 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48eb1cb9-59b2-4872-af62-482f69ebdb68-host\") pod \"node-ca-s8bh7\" (UID: \"48eb1cb9-59b2-4872-af62-482f69ebdb68\") " pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.717450 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717444    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-systemd\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.717611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-cnibin\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.717611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717493    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-etc-openvswitch\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.717611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-cni-netd\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.717611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11070fc4-a765-4b3c-9491-06a78e7def55-ovn-node-metrics-cert\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.717611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8f9521-62b0-466a-bce8-29da863f6032-tmp-dir\") pod \"node-resolver-lfbss\" (UID: \"0e8f9521-62b0-466a-bce8-29da863f6032\") " pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.717611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-sys-fs\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.717896 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-var-lib-kubelet\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.717896 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-sys\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.717896 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717692    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-lib-modules\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.717896 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4afb73a-7200-4331-b5f4-b57811d9f15a-tmp\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.717896 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee55e08f-e1c2-43dc-8b57-d721089f17ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.717896 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee55e08f-e1c2-43dc-8b57-d721089f17ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.717896 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-registration-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717907    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-device-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-etc-kubernetes\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-run-netns\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.717989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-cni-dir\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718023    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-run-k8s-cni-cncf-io\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d8fea53-2115-402f-84be-8e34194e4320-host-slash\") pod \"iptables-alerter-dm5gq\" (UID: \"0d8fea53-2115-402f-84be-8e34194e4320\") " pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-host\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee55e08f-e1c2-43dc-8b57-d721089f17ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718176    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-run-openvswitch\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718207    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-log-socket\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:25.718292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718265    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/893f315a-1489-4167-b2f0-e41ac01d4301-konnectivity-ca\") pod \"konnectivity-agent-p9484\" (UID: \"893f315a-1489-4167-b2f0-e41ac01d4301\") " pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718300    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-run-systemd\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718376    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-var-lib-openvswitch\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718419    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-cni-bin\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718445    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11070fc4-a765-4b3c-9491-06a78e7def55-env-overrides\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-run-multus-certs\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxjz\" (UniqueName: \"kubernetes.io/projected/0d8fea53-2115-402f-84be-8e34194e4320-kube-api-access-4zxjz\") pod \"iptables-alerter-dm5gq\" (UID: \"0d8fea53-2115-402f-84be-8e34194e4320\") " pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718569    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-tuned\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-os-release\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-socket-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-conf-dir\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718733    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gklzf\" (UniqueName: \"kubernetes.io/projected/2f3cb094-98ec-4214-8874-0b05c397d9cd-kube-api-access-gklzf\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.718787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718760    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d8fea53-2115-402f-84be-8e34194e4320-iptables-alerter-script\") pod \"iptables-alerter-dm5gq\" (UID: \"0d8fea53-2115-402f-84be-8e34194e4320\") " pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718794    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/438c0d21-3d37-4f76-b8b8-a80944438de8-kubelet-config\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718818    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbbjl\" (UniqueName: \"kubernetes.io/projected/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-kube-api-access-pbbjl\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718918    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/438c0d21-3d37-4f76-b8b8-a80944438de8-dbus\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-sysctl-conf\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718970    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-run\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.718992    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-kubelet\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719017    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkfgw\" (UniqueName: \"kubernetes.io/projected/6288de98-2d84-4ea7-a916-d25e13c68c7a-kube-api-access-gkfgw\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719040    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-run-netns\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-var-lib-cni-multus\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-kubernetes\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw5t7\" (UniqueName: \"kubernetes.io/projected/ee55e08f-e1c2-43dc-8b57-d721089f17ab-kube-api-access-zw5t7\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfrbz\" (UniqueName: \"kubernetes.io/projected/11070fc4-a765-4b3c-9491-06a78e7def55-kube-api-access-dfrbz\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719188    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-system-cni-dir\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.719215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-socket-dir-parent\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-slash\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-node-log\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-var-lib-cni-bin\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719425    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719452    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-run-ovn\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719485    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-cnibin\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719508    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-var-lib-kubelet\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kg8jc\" (UniqueName: \"kubernetes.io/projected/c4afb73a-7200-4331-b5f4-b57811d9f15a-kube-api-access-kg8jc\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719607    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/893f315a-1489-4167-b2f0-e41ac01d4301-agent-certs\") pod \"konnectivity-agent-p9484\" (UID: \"893f315a-1489-4167-b2f0-e41ac01d4301\") " pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11070fc4-a765-4b3c-9491-06a78e7def55-ovnkube-script-lib\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f3cb094-98ec-4214-8874-0b05c397d9cd-cni-binary-copy\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719751    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e8f9521-62b0-466a-bce8-29da863f6032-hosts-file\") pod \"node-resolver-lfbss\" (UID: \"0e8f9521-62b0-466a-bce8-29da863f6032\") " pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719778    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9nc5\" (UniqueName: \"kubernetes.io/projected/48eb1cb9-59b2-4872-af62-482f69ebdb68-kube-api-access-f9nc5\") pod \"node-ca-s8bh7\" (UID: \"48eb1cb9-59b2-4872-af62-482f69ebdb68\") " pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.719916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719809    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-sysctl-d\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-systemd-units\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-run-ovn-kubernetes\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719857    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-os-release\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719877    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-hostroot\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-daemon-config\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-sysconfig\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/48eb1cb9-59b2-4872-af62-482f69ebdb68-serviceca\") pod \"node-ca-s8bh7\" (UID: \"48eb1cb9-59b2-4872-af62-482f69ebdb68\") " pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719936    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-modprobe-d\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.719951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-system-cni-dir\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.720743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.720224    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 01:10:25.739494 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.739474    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q6nkv"
Jul 29 01:10:25.747241 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.747148    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q6nkv"
Jul 29 01:10:25.820943 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.820915    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-socket-dir-parent\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.821089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.820954    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-slash\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.821089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.820978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-node-log\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.821089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.820999    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.821089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-var-lib-cni-bin\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.821089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821045    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.821089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-socket-dir-parent\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.821089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-node-log\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821103    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-run-ovn\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-slash\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821105    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-var-lib-cni-bin\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-run-ovn\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821155    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-cnibin\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821206    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-cnibin\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-var-lib-kubelet\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kg8jc\" (UniqueName: \"kubernetes.io/projected/c4afb73a-7200-4331-b5f4-b57811d9f15a-kube-api-access-kg8jc\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/893f315a-1489-4167-b2f0-e41ac01d4301-agent-certs\") pod \"konnectivity-agent-p9484\" (UID: \"893f315a-1489-4167-b2f0-e41ac01d4301\") " pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11070fc4-a765-4b3c-9491-06a78e7def55-ovnkube-script-lib\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821358    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f3cb094-98ec-4214-8874-0b05c397d9cd-cni-binary-copy\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821366    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-var-lib-kubelet\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821382    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:25.821488 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.821462    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.821554    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret podName:438c0d21-3d37-4f76-b8b8-a80944438de8 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:26.321508768 +0000 UTC m=+2.960605581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret") pod "global-pull-secret-syncer-2k7wg" (UID: "438c0d21-3d37-4f76-b8b8-a80944438de8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821574    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e8f9521-62b0-466a-bce8-29da863f6032-hosts-file\") pod \"node-resolver-lfbss\" (UID: \"0e8f9521-62b0-466a-bce8-29da863f6032\") " pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821601    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9nc5\" (UniqueName: \"kubernetes.io/projected/48eb1cb9-59b2-4872-af62-482f69ebdb68-kube-api-access-f9nc5\") pod \"node-ca-s8bh7\" (UID: \"48eb1cb9-59b2-4872-af62-482f69ebdb68\") " pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-sysctl-d\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-systemd-units\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0e8f9521-62b0-466a-bce8-29da863f6032-hosts-file\") pod \"node-resolver-lfbss\" (UID: \"0e8f9521-62b0-466a-bce8-29da863f6032\") " pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821672    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-run-ovn-kubernetes\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821686    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-os-release\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821720    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-hostroot\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-daemon-config\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-sysconfig\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/48eb1cb9-59b2-4872-af62-482f69ebdb68-serviceca\") pod \"node-ca-s8bh7\" (UID: \"48eb1cb9-59b2-4872-af62-482f69ebdb68\") " pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-sysctl-d\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821857    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-os-release\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-systemd-units\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.822267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-run-ovn-kubernetes\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-hostroot\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821988    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-sysconfig\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.821998    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f3cb094-98ec-4214-8874-0b05c397d9cd-cni-binary-copy\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-modprobe-d\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822041    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/11070fc4-a765-4b3c-9491-06a78e7def55-ovnkube-script-lib\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-system-cni-dir\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11070fc4-a765-4b3c-9491-06a78e7def55-ovnkube-config\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-system-cni-dir\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822175    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bwml\" (UniqueName: \"kubernetes.io/projected/0e8f9521-62b0-466a-bce8-29da863f6032-kube-api-access-6bwml\") pod \"node-resolver-lfbss\" (UID: \"0e8f9521-62b0-466a-bce8-29da863f6032\") " pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822153    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-modprobe-d\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48eb1cb9-59b2-4872-af62-482f69ebdb68-host\") pod \"node-ca-s8bh7\" (UID: \"48eb1cb9-59b2-4872-af62-482f69ebdb68\") " pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822246    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822258    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-systemd\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.823118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-cnibin\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822309    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-etc-openvswitch\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822325    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/48eb1cb9-59b2-4872-af62-482f69ebdb68-host\") pod \"node-ca-s8bh7\" (UID: \"48eb1cb9-59b2-4872-af62-482f69ebdb68\") " pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-cni-netd\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822334    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/48eb1cb9-59b2-4872-af62-482f69ebdb68-serviceca\") pod \"node-ca-s8bh7\" (UID: \"48eb1cb9-59b2-4872-af62-482f69ebdb68\") " pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11070fc4-a765-4b3c-9491-06a78e7def55-ovn-node-metrics-cert\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-cnibin\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8f9521-62b0-466a-bce8-29da863f6032-tmp-dir\") pod \"node-resolver-lfbss\" (UID: \"0e8f9521-62b0-466a-bce8-29da863f6032\") " pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822409    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-cni-netd\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822426    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-sys-fs\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-var-lib-kubelet\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-etc-openvswitch\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822479    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-sys\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822481    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-systemd\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-lib-modules\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822514    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-sys-fs\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-var-lib-kubelet\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822530    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4afb73a-7200-4331-b5f4-b57811d9f15a-tmp\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.823850 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/11070fc4-a765-4b3c-9491-06a78e7def55-ovnkube-config\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee55e08f-e1c2-43dc-8b57-d721089f17ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822598    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee55e08f-e1c2-43dc-8b57-d721089f17ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822623    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-registration-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-device-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-lib-modules\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-etc-kubernetes\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-sys\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-run-netns\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e8f9521-62b0-466a-bce8-29da863f6032-tmp-dir\") pod \"node-resolver-lfbss\" (UID: \"0e8f9521-62b0-466a-bce8-29da863f6032\") " pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-device-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-cni-dir\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-run-netns\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-run-k8s-cni-cncf-io\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.822965    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-registration-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d8fea53-2115-402f-84be-8e34194e4320-host-slash\") pod \"iptables-alerter-dm5gq\" (UID: \"0d8fea53-2115-402f-84be-8e34194e4320\") " pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-host\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.824646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-daemon-config\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823049    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0d8fea53-2115-402f-84be-8e34194e4320-host-slash\") pod \"iptables-alerter-dm5gq\" (UID: \"0d8fea53-2115-402f-84be-8e34194e4320\") " pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-etc-kubernetes\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-host\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823125    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-run-k8s-cni-cncf-io\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee55e08f-e1c2-43dc-8b57-d721089f17ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823214    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-cni-dir\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-run-openvswitch\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823247    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-run-openvswitch\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ee55e08f-e1c2-43dc-8b57-d721089f17ab-cni-binary-copy\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-log-socket\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823308    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823354    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-log-socket\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/893f315a-1489-4167-b2f0-e41ac01d4301-konnectivity-ca\") pod \"konnectivity-agent-p9484\" (UID: \"893f315a-1489-4167-b2f0-e41ac01d4301\") " pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823525    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-run-systemd\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-var-lib-openvswitch\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823614    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-run-systemd\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.825564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823659    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-cni-bin\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823685    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11070fc4-a765-4b3c-9491-06a78e7def55-env-overrides\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823739    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-run-multus-certs\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxjz\" (UniqueName: \"kubernetes.io/projected/0d8fea53-2115-402f-84be-8e34194e4320-kube-api-access-4zxjz\") pod \"iptables-alerter-dm5gq\" (UID: \"0d8fea53-2115-402f-84be-8e34194e4320\") " pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-tuned\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823817    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-os-release\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ee55e08f-e1c2-43dc-8b57-d721089f17ab-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823861    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ee55e08f-e1c2-43dc-8b57-d721089f17ab-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-socket-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-conf-dir\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823905    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gklzf\" (UniqueName: \"kubernetes.io/projected/2f3cb094-98ec-4214-8874-0b05c397d9cd-kube-api-access-gklzf\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823914    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-var-lib-openvswitch\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d8fea53-2115-402f-84be-8e34194e4320-iptables-alerter-script\") pod \"iptables-alerter-dm5gq\" (UID: \"0d8fea53-2115-402f-84be-8e34194e4320\") " pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-run-multus-certs\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823963    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-cni-bin\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823971    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-multus-conf-dir\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.823981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/438c0d21-3d37-4f76-b8b8-a80944438de8-kubelet-config\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:25.826441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824185    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824248    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/438c0d21-3d37-4f76-b8b8-a80944438de8-kubelet-config\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824249    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ee55e08f-e1c2-43dc-8b57-d721089f17ab-os-release\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824261    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/11070fc4-a765-4b3c-9491-06a78e7def55-env-overrides\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824294    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/893f315a-1489-4167-b2f0-e41ac01d4301-konnectivity-ca\") pod \"konnectivity-agent-p9484\" (UID: \"893f315a-1489-4167-b2f0-e41ac01d4301\") " pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824419    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbbjl\" (UniqueName: \"kubernetes.io/projected/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-kube-api-access-pbbjl\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6288de98-2d84-4ea7-a916-d25e13c68c7a-socket-dir\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/438c0d21-3d37-4f76-b8b8-a80944438de8-dbus\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.824466    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-sysctl-conf\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.824561    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:26.324540509 +0000 UTC m=+2.963637301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824678    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-run\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824709    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-kubelet\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824738    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkfgw\" (UniqueName: \"kubernetes.io/projected/6288de98-2d84-4ea7-a916-d25e13c68c7a-kube-api-access-gkfgw\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824788    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-run-netns\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824818    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-var-lib-cni-multus\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824848    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-kubernetes\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.827234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw5t7\" (UniqueName: \"kubernetes.io/projected/ee55e08f-e1c2-43dc-8b57-d721089f17ab-kube-api-access-zw5t7\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0d8fea53-2115-402f-84be-8e34194e4320-iptables-alerter-script\") pod \"iptables-alerter-dm5gq\" (UID: \"0d8fea53-2115-402f-84be-8e34194e4320\") " pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824912    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-sysctl-conf\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfrbz\" (UniqueName: \"kubernetes.io/projected/11070fc4-a765-4b3c-9491-06a78e7def55-kube-api-access-dfrbz\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-run\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824962    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-run-netns\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.824992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-system-cni-dir\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.825074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-system-cni-dir\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.825131    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/11070fc4-a765-4b3c-9491-06a78e7def55-host-kubelet\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.825165    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-kubernetes\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.825168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f3cb094-98ec-4214-8874-0b05c397d9cd-host-var-lib-cni-multus\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.828166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.825295    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/438c0d21-3d37-4f76-b8b8-a80944438de8-dbus\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:25.828765 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.828335    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/893f315a-1489-4167-b2f0-e41ac01d4301-agent-certs\") pod \"konnectivity-agent-p9484\" (UID: \"893f315a-1489-4167-b2f0-e41ac01d4301\") " pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:25.829427 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.829397    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/11070fc4-a765-4b3c-9491-06a78e7def55-ovn-node-metrics-cert\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.830313 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.830288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4afb73a-7200-4331-b5f4-b57811d9f15a-tmp\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.834468 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.834413    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:25.834468 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.834438    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:25.834468 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.834451    2565 projected.go:196] Error preparing data for projected volume kube-api-access-z4l9h for pod openshift-network-diagnostics/network-check-target-rbcnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:25.834620 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:25.834508    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h podName:2a8dfebe-b4f3-4744-a527-b478ff6aa5c1 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:26.334491965 +0000 UTC m=+2.973588798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-z4l9h" (UniqueName: "kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h") pod "network-check-target-rbcnr" (UID: "2a8dfebe-b4f3-4744-a527-b478ff6aa5c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:25.834993 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.834960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9nc5\" (UniqueName: \"kubernetes.io/projected/48eb1cb9-59b2-4872-af62-482f69ebdb68-kube-api-access-f9nc5\") pod \"node-ca-s8bh7\" (UID: \"48eb1cb9-59b2-4872-af62-482f69ebdb68\") " pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:25.835851 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.835509    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4afb73a-7200-4331-b5f4-b57811d9f15a-etc-tuned\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.835851 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.835559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kg8jc\" (UniqueName: \"kubernetes.io/projected/c4afb73a-7200-4331-b5f4-b57811d9f15a-kube-api-access-kg8jc\") pod \"tuned-4gb26\" (UID: \"c4afb73a-7200-4331-b5f4-b57811d9f15a\") " pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:25.837523 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.837495    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bwml\" (UniqueName: \"kubernetes.io/projected/0e8f9521-62b0-466a-bce8-29da863f6032-kube-api-access-6bwml\") pod \"node-resolver-lfbss\" (UID: \"0e8f9521-62b0-466a-bce8-29da863f6032\") " pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:25.843666 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.843642    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxjz\" (UniqueName: \"kubernetes.io/projected/0d8fea53-2115-402f-84be-8e34194e4320-kube-api-access-4zxjz\") pod \"iptables-alerter-dm5gq\" (UID: \"0d8fea53-2115-402f-84be-8e34194e4320\") " pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:25.843763 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.843728    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbbjl\" (UniqueName: \"kubernetes.io/projected/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-kube-api-access-pbbjl\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:25.844126 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.844104    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkfgw\" (UniqueName: \"kubernetes.io/projected/6288de98-2d84-4ea7-a916-d25e13c68c7a-kube-api-access-gkfgw\") pod \"aws-ebs-csi-driver-node-dnx5l\" (UID: \"6288de98-2d84-4ea7-a916-d25e13c68c7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:25.844477 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.844446    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gklzf\" (UniqueName: \"kubernetes.io/projected/2f3cb094-98ec-4214-8874-0b05c397d9cd-kube-api-access-gklzf\") pod \"multus-ff4bq\" (UID: \"2f3cb094-98ec-4214-8874-0b05c397d9cd\") " pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:25.844582 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.844559    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfrbz\" (UniqueName: \"kubernetes.io/projected/11070fc4-a765-4b3c-9491-06a78e7def55-kube-api-access-dfrbz\") pod \"ovnkube-node-thlhl\" (UID: \"11070fc4-a765-4b3c-9491-06a78e7def55\") " pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:25.846259 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.846240    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw5t7\" (UniqueName: \"kubernetes.io/projected/ee55e08f-e1c2-43dc-8b57-d721089f17ab-kube-api-access-zw5t7\") pod \"multus-additional-cni-plugins-xg8vw\" (UID: \"ee55e08f-e1c2-43dc-8b57-d721089f17ab\") " pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:25.915765 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:25.915639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal" event={"ID":"15a642e5dbdb7944579e1ac85ffb4c8a","Type":"ContainerStarted","Data":"31e73d1781c00e6ae31b2c5d52b6c0532a3db46708cace30735d3aeb8e092ce8"}
Jul 29 01:10:26.008161 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.008116    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4gb26"
Jul 29 01:10:26.021644 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.021618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xg8vw"
Jul 29 01:10:26.030926 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.030902    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l"
Jul 29 01:10:26.037789 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.037761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ff4bq"
Jul 29 01:10:26.047500 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.047474    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-dm5gq"
Jul 29 01:10:26.055338 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.055303    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:26.063576 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.063552    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:26.069726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.069705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lfbss"
Jul 29 01:10:26.075722 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.075702    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-s8bh7"
Jul 29 01:10:26.329718 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.329647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:26.329718 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.329697    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:26.329907 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.329789    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:26.329907 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.329790    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:26.329907 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.329861    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret podName:438c0d21-3d37-4f76-b8b8-a80944438de8 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:27.329841593 +0000 UTC m=+3.968938385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret") pod "global-pull-secret-syncer-2k7wg" (UID: "438c0d21-3d37-4f76-b8b8-a80944438de8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:26.329907 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.329881    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:27.329871646 +0000 UTC m=+3.968968434 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:26.430399 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.430360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:26.430594 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.430493    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:26.430594 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.430521    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:26.430594 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.430533    2565 projected.go:196] Error preparing data for projected volume kube-api-access-z4l9h for pod openshift-network-diagnostics/network-check-target-rbcnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:26.430594 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.430587    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h podName:2a8dfebe-b4f3-4744-a527-b478ff6aa5c1 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:27.430572392 +0000 UTC m=+4.069669179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4l9h" (UniqueName: "kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h") pod "network-check-target-rbcnr" (UID: "2a8dfebe-b4f3-4744-a527-b478ff6aa5c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:26.749598 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.749515    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:05:26 +0000 UTC" deadline="2028-03-23 02:37:46.973403607 +0000 UTC"
Jul 29 01:10:26.749598 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.749549    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14473h27m20.223859524s"
Jul 29 01:10:26.910679 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.910646    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:26.910813 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:26.910690    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:26.910813 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.910772    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:26.910945 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:26.910850    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:26.961965 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:26.961941    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8f9521_62b0_466a_bce8_29da863f6032.slice/crio-1324a8d0f6e939581ed4484f811a2d5524950b42038de58499beee1beb299673 WatchSource:0}: Error finding container 1324a8d0f6e939581ed4484f811a2d5524950b42038de58499beee1beb299673: Status 404 returned error can't find the container with id 1324a8d0f6e939581ed4484f811a2d5524950b42038de58499beee1beb299673
Jul 29 01:10:26.970969 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:26.970854    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893f315a_1489_4167_b2f0_e41ac01d4301.slice/crio-08d37ae753d4bdbb7ac90bff03ddf4688e257dc96290bd5efb725f77f1566529 WatchSource:0}: Error finding container 08d37ae753d4bdbb7ac90bff03ddf4688e257dc96290bd5efb725f77f1566529: Status 404 returned error can't find the container with id 08d37ae753d4bdbb7ac90bff03ddf4688e257dc96290bd5efb725f77f1566529
Jul 29 01:10:26.973606 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:26.973583    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f3cb094_98ec_4214_8874_0b05c397d9cd.slice/crio-c68cc6e745dac4cc87006666485d5f7c0e8a0897858a5584b8950f9a464524bd WatchSource:0}: Error finding container c68cc6e745dac4cc87006666485d5f7c0e8a0897858a5584b8950f9a464524bd: Status 404 returned error can't find the container with id c68cc6e745dac4cc87006666485d5f7c0e8a0897858a5584b8950f9a464524bd
Jul 29 01:10:26.975407 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:26.975270    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11070fc4_a765_4b3c_9491_06a78e7def55.slice/crio-205afcc43d88855b8a10838a8a4bd8f2fb3527948463076906bc8bef37888eb7 WatchSource:0}: Error finding container 205afcc43d88855b8a10838a8a4bd8f2fb3527948463076906bc8bef37888eb7: Status 404 returned error can't find the container with id 205afcc43d88855b8a10838a8a4bd8f2fb3527948463076906bc8bef37888eb7
Jul 29 01:10:26.976946 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:26.976826    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee55e08f_e1c2_43dc_8b57_d721089f17ab.slice/crio-85ec0db9cf9708c2c555d26b68308e4ae5f2e5755bb8198c6082b85c28dd9a90 WatchSource:0}: Error finding container 85ec0db9cf9708c2c555d26b68308e4ae5f2e5755bb8198c6082b85c28dd9a90: Status 404 returned error can't find the container with id 85ec0db9cf9708c2c555d26b68308e4ae5f2e5755bb8198c6082b85c28dd9a90
Jul 29 01:10:26.977633 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:26.977607    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48eb1cb9_59b2_4872_af62_482f69ebdb68.slice/crio-17481414ff59b51a2ac81c8ee94eafa19eea6045e2d5617b4692770cd06fd26b WatchSource:0}: Error finding container 17481414ff59b51a2ac81c8ee94eafa19eea6045e2d5617b4692770cd06fd26b: Status 404 returned error can't find the container with id 17481414ff59b51a2ac81c8ee94eafa19eea6045e2d5617b4692770cd06fd26b
Jul 29 01:10:26.978468 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:26.978426    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8fea53_2115_402f_84be_8e34194e4320.slice/crio-2234d836243916b01d84ad67a3e49304d3ba27fde70d2eb2a05a14ed4d586dfa WatchSource:0}: Error finding container 2234d836243916b01d84ad67a3e49304d3ba27fde70d2eb2a05a14ed4d586dfa: Status 404 returned error can't find the container with id 2234d836243916b01d84ad67a3e49304d3ba27fde70d2eb2a05a14ed4d586dfa
Jul 29 01:10:26.980177 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:26.980127    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4afb73a_7200_4331_b5f4_b57811d9f15a.slice/crio-f29c487fcc2167e697be40af51ed5c7e4fd7db7ba3502b87fa6d7389fe6da65e WatchSource:0}: Error finding container f29c487fcc2167e697be40af51ed5c7e4fd7db7ba3502b87fa6d7389fe6da65e: Status 404 returned error can't find the container with id f29c487fcc2167e697be40af51ed5c7e4fd7db7ba3502b87fa6d7389fe6da65e
Jul 29 01:10:26.980862 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:10:26.980834    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6288de98_2d84_4ea7_a916_d25e13c68c7a.slice/crio-f54de9e8260cd654bf26564bb67b596426ba8911313c49d14facc67c755c0f59 WatchSource:0}: Error finding container f54de9e8260cd654bf26564bb67b596426ba8911313c49d14facc67c755c0f59: Status 404 returned error can't find the container with id f54de9e8260cd654bf26564bb67b596426ba8911313c49d14facc67c755c0f59
Jul 29 01:10:27.165098 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.164921    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 01:10:27.336953 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.336883    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:27.337087 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.336967    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:27.337087 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:27.337044    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:27.337087 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:27.337051    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:27.337250 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:27.337112    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret podName:438c0d21-3d37-4f76-b8b8-a80944438de8 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:29.337093644 +0000 UTC m=+5.976190447 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret") pod "global-pull-secret-syncer-2k7wg" (UID: "438c0d21-3d37-4f76-b8b8-a80944438de8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:27.337250 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:27.337129    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:29.337123219 +0000 UTC m=+5.976220006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:27.438365 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.438266    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:27.438535 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:27.438511    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:27.438535 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:27.438532    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:27.438676 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:27.438546    2565 projected.go:196] Error preparing data for projected volume kube-api-access-z4l9h for pod openshift-network-diagnostics/network-check-target-rbcnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:27.438676 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:27.438613    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h podName:2a8dfebe-b4f3-4744-a527-b478ff6aa5c1 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:29.438594405 +0000 UTC m=+6.077691215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4l9h" (UniqueName: "kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h") pod "network-check-target-rbcnr" (UID: "2a8dfebe-b4f3-4744-a527-b478ff6aa5c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:27.750765 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.750618    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 01:05:26 +0000 UTC" deadline="2028-04-28 23:11:42.73333771 +0000 UTC"
Jul 29 01:10:27.750765 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.750685    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15358h1m14.982657181s"
Jul 29 01:10:27.913240 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.912718    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:27.913240 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:27.912844    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:27.925074 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.925037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal" event={"ID":"15a642e5dbdb7944579e1ac85ffb4c8a","Type":"ContainerStarted","Data":"6205a5a039010495ec70c3f5efe0c693c299c28714a8e0f94bc9a780ccfff9b9"}
Jul 29 01:10:27.940823 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.940788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4gb26" event={"ID":"c4afb73a-7200-4331-b5f4-b57811d9f15a","Type":"ContainerStarted","Data":"f29c487fcc2167e697be40af51ed5c7e4fd7db7ba3502b87fa6d7389fe6da65e"}
Jul 29 01:10:27.941210 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.941139    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-204.ec2.internal" podStartSLOduration=2.941120787 podStartE2EDuration="2.941120787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:27.940769551 +0000 UTC m=+4.579866352" watchObservedRunningTime="2026-07-29 01:10:27.941120787 +0000 UTC m=+4.580217599"
Jul 29 01:10:27.947701 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.947669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dm5gq" event={"ID":"0d8fea53-2115-402f-84be-8e34194e4320","Type":"ContainerStarted","Data":"2234d836243916b01d84ad67a3e49304d3ba27fde70d2eb2a05a14ed4d586dfa"}
Jul 29 01:10:27.956363 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.956333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ff4bq" event={"ID":"2f3cb094-98ec-4214-8874-0b05c397d9cd","Type":"ContainerStarted","Data":"c68cc6e745dac4cc87006666485d5f7c0e8a0897858a5584b8950f9a464524bd"}
Jul 29 01:10:27.964776 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.964748    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l" event={"ID":"6288de98-2d84-4ea7-a916-d25e13c68c7a","Type":"ContainerStarted","Data":"f54de9e8260cd654bf26564bb67b596426ba8911313c49d14facc67c755c0f59"}
Jul 29 01:10:27.967518 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.967492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s8bh7" event={"ID":"48eb1cb9-59b2-4872-af62-482f69ebdb68","Type":"ContainerStarted","Data":"17481414ff59b51a2ac81c8ee94eafa19eea6045e2d5617b4692770cd06fd26b"}
Jul 29 01:10:27.973359 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.973333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xg8vw" event={"ID":"ee55e08f-e1c2-43dc-8b57-d721089f17ab","Type":"ContainerStarted","Data":"85ec0db9cf9708c2c555d26b68308e4ae5f2e5755bb8198c6082b85c28dd9a90"}
Jul 29 01:10:27.989443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:27.989329    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"205afcc43d88855b8a10838a8a4bd8f2fb3527948463076906bc8bef37888eb7"}
Jul 29 01:10:28.007653 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:28.007580    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p9484" event={"ID":"893f315a-1489-4167-b2f0-e41ac01d4301","Type":"ContainerStarted","Data":"08d37ae753d4bdbb7ac90bff03ddf4688e257dc96290bd5efb725f77f1566529"}
Jul 29 01:10:28.012191 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:28.012164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lfbss" event={"ID":"0e8f9521-62b0-466a-bce8-29da863f6032","Type":"ContainerStarted","Data":"1324a8d0f6e939581ed4484f811a2d5524950b42038de58499beee1beb299673"}
Jul 29 01:10:28.018475 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:28.018442    2565 generic.go:356] "Generic (PLEG): container finished" podID="9b3cbdd2dda476557f7e86204a599843" containerID="fa6926e6613ac3eb59dfbf676f31e238abed794dc86107edcfeac0ed46b49c9a" exitCode=0
Jul 29 01:10:28.018575 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:28.018479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal" event={"ID":"9b3cbdd2dda476557f7e86204a599843","Type":"ContainerDied","Data":"fa6926e6613ac3eb59dfbf676f31e238abed794dc86107edcfeac0ed46b49c9a"}
Jul 29 01:10:28.910941 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:28.910645    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:28.912426 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:28.911528    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:28.912426 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:28.911955    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:28.912426 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:28.912056    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:29.055711 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:29.055674    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal" event={"ID":"9b3cbdd2dda476557f7e86204a599843","Type":"ContainerStarted","Data":"4bfc8fa90084db5d5e2d7038330f46707508743fbb311ef5d3e53d0630587b7c"}
Jul 29 01:10:29.355327 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:29.355239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:29.355327 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:29.355310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:29.355581 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:29.355535    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:29.355635 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:29.355603    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret podName:438c0d21-3d37-4f76-b8b8-a80944438de8 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:33.355582416 +0000 UTC m=+9.994679205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret") pod "global-pull-secret-syncer-2k7wg" (UID: "438c0d21-3d37-4f76-b8b8-a80944438de8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:29.356026 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:29.356002    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:29.356120 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:29.356065    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:33.356048049 +0000 UTC m=+9.995144841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:29.456563 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:29.456526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:29.456779 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:29.456738    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:29.456779 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:29.456764    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:29.456779 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:29.456777    2565 projected.go:196] Error preparing data for projected volume kube-api-access-z4l9h for pod openshift-network-diagnostics/network-check-target-rbcnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:29.456949 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:29.456833    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h podName:2a8dfebe-b4f3-4744-a527-b478ff6aa5c1 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:33.456815517 +0000 UTC m=+10.095912308 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4l9h" (UniqueName: "kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h") pod "network-check-target-rbcnr" (UID: "2a8dfebe-b4f3-4744-a527-b478ff6aa5c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:29.910440 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:29.910401    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:29.910662 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:29.910531    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:30.910362 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:30.910304    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:30.910875 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:30.910474    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:30.910944 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:30.910894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:30.911077 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:30.911003    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:31.912906 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:31.912868    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:31.913373 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:31.912999    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:32.910856 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:32.910184    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:32.910856 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:32.910340    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:32.910856 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:32.910712    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:32.910856 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:32.910810    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:33.391803 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:33.391095    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:33.391803 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:33.391178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:33.391803 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:33.391289    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:33.391803 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:33.391359    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:41.391339638 +0000 UTC m=+18.030436428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:33.391803 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:33.391419    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:33.391803 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:33.391452    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret podName:438c0d21-3d37-4f76-b8b8-a80944438de8 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:41.391441986 +0000 UTC m=+18.030538773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret") pod "global-pull-secret-syncer-2k7wg" (UID: "438c0d21-3d37-4f76-b8b8-a80944438de8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:33.492724 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:33.492161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:33.492724 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:33.492346    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:33.492724 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:33.492367    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:33.492724 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:33.492379    2565 projected.go:196] Error preparing data for projected volume kube-api-access-z4l9h for pod openshift-network-diagnostics/network-check-target-rbcnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:33.492724 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:33.492429    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h podName:2a8dfebe-b4f3-4744-a527-b478ff6aa5c1 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:41.492409699 +0000 UTC m=+18.131506502 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4l9h" (UniqueName: "kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h") pod "network-check-target-rbcnr" (UID: "2a8dfebe-b4f3-4744-a527-b478ff6aa5c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:33.911910 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:33.911877    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:33.912081 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:33.911984    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:34.910275 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:34.910242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:34.910783 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:34.910390    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:34.910783 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:34.910744    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:34.910886 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:34.910844    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:35.910388 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:35.910355    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:35.910845 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:35.910482    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:36.910877 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:36.910844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:36.911267 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:36.910844    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:36.911267 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:36.910966    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:36.911267 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:36.911064    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:37.910955 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:37.910926    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:37.911393 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:37.911028    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:38.910947 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:38.910918    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:38.911076 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:38.911053    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:38.911418 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:38.911079    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:38.911418 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:38.911159    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:39.910554 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:39.910512    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:39.910717 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:39.910629    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:40.910324 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:40.910273    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:40.910760 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:40.910421    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:40.910760 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:40.910483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:40.910760 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:40.910606    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:41.452500 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:41.452454    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:41.452665 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:41.452526    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:41.452665 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:41.452603    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:41.452665 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:41.452614    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:41.452841 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:41.452667    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:57.452648891 +0000 UTC m=+34.091745677 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:41.452841 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:41.452685    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret podName:438c0d21-3d37-4f76-b8b8-a80944438de8 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:57.452676964 +0000 UTC m=+34.091773750 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret") pod "global-pull-secret-syncer-2k7wg" (UID: "438c0d21-3d37-4f76-b8b8-a80944438de8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:41.553821 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:41.553772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:41.553970 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:41.553941    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:41.553970 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:41.553961    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:41.553970 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:41.553970    2565 projected.go:196] Error preparing data for projected volume kube-api-access-z4l9h for pod openshift-network-diagnostics/network-check-target-rbcnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:41.554154 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:41.554028    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h podName:2a8dfebe-b4f3-4744-a527-b478ff6aa5c1 nodeName:}" failed. No retries permitted until 2026-07-29 01:10:57.554013277 +0000 UTC m=+34.193110067 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4l9h" (UniqueName: "kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h") pod "network-check-target-rbcnr" (UID: "2a8dfebe-b4f3-4744-a527-b478ff6aa5c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:41.910072 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:41.910038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:41.910247 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:41.910159    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:42.910998 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:42.910960    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:42.911412 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:42.910982    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:42.911412 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:42.911100    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:42.911412 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:42.911143    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:43.911670 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:43.911633    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:43.912078 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:43.911735    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:44.910906 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:44.910864    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:44.911081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:44.910923    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:44.911081 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:44.911009    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:44.911182 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:44.911098    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:45.910108 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:45.910072    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:45.910682 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:45.910206    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:46.911169 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:46.910992    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:46.912012 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:46.911055    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:46.912012 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:46.911259    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:46.912012 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:46.911337    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:47.095382 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.095345    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ff4bq" event={"ID":"2f3cb094-98ec-4214-8874-0b05c397d9cd","Type":"ContainerStarted","Data":"e25605127feecb83e388427da3713ecb96c0d8f551a76969f9a85e7ceec22f13"}
Jul 29 01:10:47.096698 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.096676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l" event={"ID":"6288de98-2d84-4ea7-a916-d25e13c68c7a","Type":"ContainerStarted","Data":"a53651a150ff529b26b002627f1b071e271ef399215519a353b02f33332fdd1a"}
Jul 29 01:10:47.098061 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.098027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-s8bh7" event={"ID":"48eb1cb9-59b2-4872-af62-482f69ebdb68","Type":"ContainerStarted","Data":"03b447997a32afb138ad73b5ffa42b3f9c8ad63cf2265e517a6899ca1ad4eda9"}
Jul 29 01:10:47.099499 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.099475    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee55e08f-e1c2-43dc-8b57-d721089f17ab" containerID="4405b0e4b2d6c793146f9d49ed2b92b6bd9abff8cb12b48ea95da45c5728f7b3" exitCode=0
Jul 29 01:10:47.099573 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.099548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xg8vw" event={"ID":"ee55e08f-e1c2-43dc-8b57-d721089f17ab","Type":"ContainerDied","Data":"4405b0e4b2d6c793146f9d49ed2b92b6bd9abff8cb12b48ea95da45c5728f7b3"}
Jul 29 01:10:47.101137 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.101113    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"84b697211d466b34ef532b2c21b412c3706cfb8783d3c0a6282ae80451240d2d"}
Jul 29 01:10:47.101212 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.101179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"07d95ee5835018eee768a5fd53c3e3e5ceaa737618592a759bca3bbe2437b329"}
Jul 29 01:10:47.102491 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.102465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p9484" event={"ID":"893f315a-1489-4167-b2f0-e41ac01d4301","Type":"ContainerStarted","Data":"1fdbfb73778fb12ab4b3160747ffd0a9b6ac08e7137bbfda7bd63f765606c343"}
Jul 29 01:10:47.103671 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.103641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lfbss" event={"ID":"0e8f9521-62b0-466a-bce8-29da863f6032","Type":"ContainerStarted","Data":"943649618f5c6f51ebd7e7b9f4eab7e6b55d3cac1002f16874098e5d47752223"}
Jul 29 01:10:47.105382 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.105058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4gb26" event={"ID":"c4afb73a-7200-4331-b5f4-b57811d9f15a","Type":"ContainerStarted","Data":"3e7bc8d413398dc688b3b1bc6e2e038db62960876a9b4ead9b208783c3495b7d"}
Jul 29 01:10:47.116140 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.116071    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ff4bq" podStartSLOduration=3.542070426 podStartE2EDuration="23.116059081s" totalImagesPullingTime="19.573988655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:47.115918126 +0000 UTC m=+23.755014933" watchObservedRunningTime="2026-07-29 01:10:47.116059081 +0000 UTC m=+23.755155888"
Jul 29 01:10:47.116278 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.116261    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-204.ec2.internal" podStartSLOduration=22.116256588 podStartE2EDuration="22.116256588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:29.072354137 +0000 UTC m=+5.711450948" watchObservedRunningTime="2026-07-29 01:10:47.116256588 +0000 UTC m=+23.755353398"
Jul 29 01:10:47.148537 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.148494    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lfbss" podStartSLOduration=3.584061999 podStartE2EDuration="23.148478105s" totalImagesPullingTime="19.564416106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:47.133833588 +0000 UTC m=+23.772930397" watchObservedRunningTime="2026-07-29 01:10:47.148478105 +0000 UTC m=+23.787574913"
Jul 29 01:10:47.148667 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.148562    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-s8bh7" podStartSLOduration=3.596668428 podStartE2EDuration="23.148557544s" totalImagesPullingTime="19.551889116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:47.148030506 +0000 UTC m=+23.787127315" watchObservedRunningTime="2026-07-29 01:10:47.148557544 +0000 UTC m=+23.787654351"
Jul 29 01:10:47.163951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.163904    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4gb26" podStartSLOduration=3.612674833 podStartE2EDuration="23.16389065s" totalImagesPullingTime="19.551215817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:47.163496326 +0000 UTC m=+23.802593176" watchObservedRunningTime="2026-07-29 01:10:47.16389065 +0000 UTC m=+23.802987457"
Jul 29 01:10:47.201175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.200985    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p9484" podStartSLOduration=7.750775438 podStartE2EDuration="23.200966568s" totalImagesPullingTime="15.45019113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:47.200639054 +0000 UTC m=+23.839735861" watchObservedRunningTime="2026-07-29 01:10:47.200966568 +0000 UTC m=+23.840063378"
Jul 29 01:10:47.233074 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.233047    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:47.233724 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.233709    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:47.910384 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:47.910347    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:47.910580 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:47.910484    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:48.110731 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.110703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:10:48.111290 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.111127    2565 generic.go:356] "Generic (PLEG): container finished" podID="11070fc4-a765-4b3c-9491-06a78e7def55" containerID="84b697211d466b34ef532b2c21b412c3706cfb8783d3c0a6282ae80451240d2d" exitCode=1
Jul 29 01:10:48.111290 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.111192    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerDied","Data":"84b697211d466b34ef532b2c21b412c3706cfb8783d3c0a6282ae80451240d2d"}
Jul 29 01:10:48.111437 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.111318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"785ee9363f69278c5d6b091d07d938f9bbc4f517637db2d5455c7d08c8b9e6ee"}
Jul 29 01:10:48.111437 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.111373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"d34f56190ce57a19632d6be6ce44acef5bc6f35a5e32ec39272bef4ba740852e"}
Jul 29 01:10:48.111437 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.111414    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"9e9a8bc5712b0a36c8a671594475d8369a394fe80ccfa1517f1fb62469e2592b"}
Jul 29 01:10:48.111575 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.111448    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"d3621461fdbdaef9c4c47bfd4dd2302b1355fb8473905e472ade5be96b4ebfee"}
Jul 29 01:10:48.112746 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.112707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-dm5gq" event={"ID":"0d8fea53-2115-402f-84be-8e34194e4320","Type":"ContainerStarted","Data":"dcabd23b016dffbe10da5c0a16df99f37ba0d2a8d815ff7c2a3792c9915e7536"}
Jul 29 01:10:48.112971 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.112953    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:48.113497 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.113480    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p9484"
Jul 29 01:10:48.142853 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.142792    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-dm5gq" podStartSLOduration=4.592441644 podStartE2EDuration="24.142774208s" totalImagesPullingTime="19.550332564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:48.142030883 +0000 UTC m=+24.781127691" watchObservedRunningTime="2026-07-29 01:10:48.142774208 +0000 UTC m=+24.781871017"
Jul 29 01:10:48.564450 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.564429    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 01:10:48.783266 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.783163    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T01:10:48.564444176Z","UUID":"d59c4d76-e27e-4a88-9362-9a2996044aba","Handler":null,"Name":"","Endpoint":""}
Jul 29 01:10:48.785971 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.785948    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 01:10:48.786109 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.785986    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 01:10:48.910882 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.910848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:48.911141 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:48.910851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:48.911141 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:48.910959    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:48.911141 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:48.911030    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:49.117169 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:49.117072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l" event={"ID":"6288de98-2d84-4ea7-a916-d25e13c68c7a","Type":"ContainerStarted","Data":"67ef9f1abae7aa6c2a1de61aeef11630a76730641064619b9cadcf16f14d80dc"}
Jul 29 01:10:49.910973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:49.910739    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:49.911133 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:49.911027    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:50.122192 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:50.122162    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:10:50.122631 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:50.122604    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"f7aac071227f8b5036968605497d5de983c8f6d2cbd0586a614bc77a1756441b"}
Jul 29 01:10:50.124781 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:50.124752    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l" event={"ID":"6288de98-2d84-4ea7-a916-d25e13c68c7a","Type":"ContainerStarted","Data":"5978a583c5a37a4f2f986090ea41f40f8415531b9e7419b764211efa1f00c380"}
Jul 29 01:10:50.143105 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:50.143056    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dnx5l" podStartSLOduration=3.794817336 podStartE2EDuration="26.143042751s" totalImagesPullingTime="22.348225415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:50.142617156 +0000 UTC m=+26.781713978" watchObservedRunningTime="2026-07-29 01:10:50.143042751 +0000 UTC m=+26.782139559"
Jul 29 01:10:50.910350 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:50.910295    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:50.910572 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:50.910296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:50.910572 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:50.910444    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:50.910572 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:50.910523    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:51.910589 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:51.910568    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:51.911240 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:51.910688    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:52.131555 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.131286    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee55e08f-e1c2-43dc-8b57-d721089f17ab" containerID="37b3072877b87313cd5c1e19a8b916435ea2f4bfe96a85dec9f586008ae8c90a" exitCode=0
Jul 29 01:10:52.131733 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.131337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xg8vw" event={"ID":"ee55e08f-e1c2-43dc-8b57-d721089f17ab","Type":"ContainerDied","Data":"37b3072877b87313cd5c1e19a8b916435ea2f4bfe96a85dec9f586008ae8c90a"}
Jul 29 01:10:52.135139 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.135121    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:10:52.135548 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.135516    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"ef859246e179a28847b0cd3b2027eb757db7316f7acef58f0519343789bdba82"}
Jul 29 01:10:52.135804 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.135788    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:52.135881 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.135858    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:52.135918 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.135906    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:52.135958 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.135905    2565 scope.go:117] "RemoveContainer" containerID="84b697211d466b34ef532b2c21b412c3706cfb8783d3c0a6282ae80451240d2d"
Jul 29 01:10:52.153593 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.153565    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:52.156108 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.156086    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:10:52.910568 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.910534    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:52.910750 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:52.910548    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:52.910750 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:52.910643    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:52.911091 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:52.910761    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:53.142498 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:53.142468    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:10:53.143099 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:53.143004    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" event={"ID":"11070fc4-a765-4b3c-9491-06a78e7def55","Type":"ContainerStarted","Data":"e1d49185f3a2cf32308dbed8aeda95bfeeb0bf7f17f2afb6481443059299818c"}
Jul 29 01:10:53.186384 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:53.186265    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl" podStartSLOduration=9.311892529 podStartE2EDuration="29.186250364s" totalImagesPullingTime="19.874357835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:10:53.186201391 +0000 UTC m=+29.825298200" watchObservedRunningTime="2026-07-29 01:10:53.186250364 +0000 UTC m=+29.825347171"
Jul 29 01:10:53.911215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:53.911183    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:53.911628 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:53.911264    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:54.128899 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:54.128713    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbcnr"]
Jul 29 01:10:54.131750 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:54.131705    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tjfzp"]
Jul 29 01:10:54.131874 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:54.131823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:54.131949 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:54.131931    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:54.141648 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:54.141578    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2k7wg"]
Jul 29 01:10:54.141747 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:54.141668    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:54.141787 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:54.141752    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:54.156089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:54.156053    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee55e08f-e1c2-43dc-8b57-d721089f17ab" containerID="190be6dbc6895ef6aaf1ffcadf53dff61202dbda7a5a7922d006c0dddf9bf431" exitCode=0
Jul 29 01:10:54.156257 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:54.156106    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xg8vw" event={"ID":"ee55e08f-e1c2-43dc-8b57-d721089f17ab","Type":"ContainerDied","Data":"190be6dbc6895ef6aaf1ffcadf53dff61202dbda7a5a7922d006c0dddf9bf431"}
Jul 29 01:10:54.156372 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:54.156357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:54.156494 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:54.156459    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:55.910737 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:55.910706    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:55.911364 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:55.910774    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:55.911364 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:55.910780    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:55.911364 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:55.910882    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:55.911364 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:55.911034    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:55.911364 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:55.911130    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:56.162792 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:56.162704    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee55e08f-e1c2-43dc-8b57-d721089f17ab" containerID="66b3c9425dbc7baef93c633a2b320470bbecff517d0a93249dc1d24891f273ae" exitCode=0
Jul 29 01:10:56.162792 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:56.162769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xg8vw" event={"ID":"ee55e08f-e1c2-43dc-8b57-d721089f17ab","Type":"ContainerDied","Data":"66b3c9425dbc7baef93c633a2b320470bbecff517d0a93249dc1d24891f273ae"}
Jul 29 01:10:57.477876 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:57.477834    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:57.478438 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:57.477918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:57.478438 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.478000    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:57.478438 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.478021    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:57.478438 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.478079    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:29.478059591 +0000 UTC m=+66.117156379 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 01:10:57.478438 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.478097    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret podName:438c0d21-3d37-4f76-b8b8-a80944438de8 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:29.478087928 +0000 UTC m=+66.117184720 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret") pod "global-pull-secret-syncer-2k7wg" (UID: "438c0d21-3d37-4f76-b8b8-a80944438de8") : object "kube-system"/"original-pull-secret" not registered
Jul 29 01:10:57.578538 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:57.578496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:57.578717 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.578694    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 01:10:57.578784 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.578720    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 01:10:57.578784 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.578733    2565 projected.go:196] Error preparing data for projected volume kube-api-access-z4l9h for pod openshift-network-diagnostics/network-check-target-rbcnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:57.578861 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.578799    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h podName:2a8dfebe-b4f3-4744-a527-b478ff6aa5c1 nodeName:}" failed. No retries permitted until 2026-07-29 01:11:29.578780787 +0000 UTC m=+66.217877591 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-z4l9h" (UniqueName: "kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h") pod "network-check-target-rbcnr" (UID: "2a8dfebe-b4f3-4744-a527-b478ff6aa5c1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 01:10:57.910268 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:57.910235    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:57.910468 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.910374    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:57.910782 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:57.910755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:57.910902 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.910859    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:10:57.910964 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:57.910952    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:57.911058 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:57.911040    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:59.910654 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:59.910620    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:10:59.911138 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:59.910625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:10:59.911138 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:59.910754    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:10:59.911138 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:10:59.910625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:10:59.911138 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:59.910846    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rbcnr" podUID="2a8dfebe-b4f3-4744-a527-b478ff6aa5c1"
Jul 29 01:10:59.911138 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:10:59.910900    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2k7wg" podUID="438c0d21-3d37-4f76-b8b8-a80944438de8"
Jul 29 01:11:00.707552 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.707469    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-204.ec2.internal" event="NodeReady"
Jul 29 01:11:00.707696 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.707598    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 01:11:00.758347 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.758297    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w6266"]
Jul 29 01:11:00.761641 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.761611    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sbsln"]
Jul 29 01:11:00.761830 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.761791    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:00.763816 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.763796    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbsln"
Jul 29 01:11:00.764258 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.764237    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 01:11:00.764390 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.764355    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 01:11:00.764439 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.764390    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5rpdf\""
Jul 29 01:11:00.767024 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.767009    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 01:11:00.767125 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.767110    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 01:11:00.767264 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.767251    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 01:11:00.767439 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.767424    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ccxn7\""
Jul 29 01:11:00.770232 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.770214    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbsln"]
Jul 29 01:11:00.773268 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.773246    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w6266"]
Jul 29 01:11:00.902246 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.902211    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:00.902444 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.902255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/515d5fad-7061-41fd-b0b9-c04e9a68205a-tmp-dir\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:00.902444 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.902274    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqrjc\" (UniqueName: \"kubernetes.io/projected/515d5fad-7061-41fd-b0b9-c04e9a68205a-kube-api-access-nqrjc\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:00.902444 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.902360    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snjdz\" (UniqueName: \"kubernetes.io/projected/07cd5f44-2d82-43e8-9672-6f9c02e885fa-kube-api-access-snjdz\") pod \"ingress-canary-sbsln\" (UID: \"07cd5f44-2d82-43e8-9672-6f9c02e885fa\") " pod="openshift-ingress-canary/ingress-canary-sbsln"
Jul 29 01:11:00.902444 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.902397    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07cd5f44-2d82-43e8-9672-6f9c02e885fa-cert\") pod \"ingress-canary-sbsln\" (UID: \"07cd5f44-2d82-43e8-9672-6f9c02e885fa\") " pod="openshift-ingress-canary/ingress-canary-sbsln"
Jul 29 01:11:00.902599 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:00.902456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/515d5fad-7061-41fd-b0b9-c04e9a68205a-config-volume\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:01.003781 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.003673    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:01.003781 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.003729    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/515d5fad-7061-41fd-b0b9-c04e9a68205a-tmp-dir\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:01.003781 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.003754    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqrjc\" (UniqueName: \"kubernetes.io/projected/515d5fad-7061-41fd-b0b9-c04e9a68205a-kube-api-access-nqrjc\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:01.004472 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.003804    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snjdz\" (UniqueName: \"kubernetes.io/projected/07cd5f44-2d82-43e8-9672-6f9c02e885fa-kube-api-access-snjdz\") pod \"ingress-canary-sbsln\" (UID: \"07cd5f44-2d82-43e8-9672-6f9c02e885fa\") " pod="openshift-ingress-canary/ingress-canary-sbsln"
Jul 29 01:11:01.004472 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:01.003831    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:01.004472 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.003855    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07cd5f44-2d82-43e8-9672-6f9c02e885fa-cert\") pod \"ingress-canary-sbsln\" (UID: \"07cd5f44-2d82-43e8-9672-6f9c02e885fa\") " pod="openshift-ingress-canary/ingress-canary-sbsln"
Jul 29 01:11:01.004472 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:01.003900    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls podName:515d5fad-7061-41fd-b0b9-c04e9a68205a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:01.503885153 +0000 UTC m=+38.142981939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls") pod "dns-default-w6266" (UID: "515d5fad-7061-41fd-b0b9-c04e9a68205a") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:01.004472 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.003918    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/515d5fad-7061-41fd-b0b9-c04e9a68205a-config-volume\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:01.004472 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.004061    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/515d5fad-7061-41fd-b0b9-c04e9a68205a-tmp-dir\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:01.004472 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.004408    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/515d5fad-7061-41fd-b0b9-c04e9a68205a-config-volume\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:01.008168 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.008147    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07cd5f44-2d82-43e8-9672-6f9c02e885fa-cert\") pod \"ingress-canary-sbsln\" (UID: \"07cd5f44-2d82-43e8-9672-6f9c02e885fa\") " pod="openshift-ingress-canary/ingress-canary-sbsln"
Jul 29 01:11:01.014715 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.014695    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqrjc\" (UniqueName: \"kubernetes.io/projected/515d5fad-7061-41fd-b0b9-c04e9a68205a-kube-api-access-nqrjc\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:01.014815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.014744    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snjdz\" (UniqueName: \"kubernetes.io/projected/07cd5f44-2d82-43e8-9672-6f9c02e885fa-kube-api-access-snjdz\") pod \"ingress-canary-sbsln\" (UID: \"07cd5f44-2d82-43e8-9672-6f9c02e885fa\") " pod="openshift-ingress-canary/ingress-canary-sbsln"
Jul 29 01:11:01.077389 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.077359    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sbsln"
Jul 29 01:11:01.177892 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.177725    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee55e08f-e1c2-43dc-8b57-d721089f17ab" containerID="a635eff7451a5cd27a6b0e4574dec4598cf5e8b10ecfa5941ef969f881d36afe" exitCode=0
Jul 29 01:11:01.178047 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.177806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xg8vw" event={"ID":"ee55e08f-e1c2-43dc-8b57-d721089f17ab","Type":"ContainerDied","Data":"a635eff7451a5cd27a6b0e4574dec4598cf5e8b10ecfa5941ef969f881d36afe"}
Jul 29 01:11:01.214125 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.214099    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sbsln"]
Jul 29 01:11:01.217896 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:11:01.217869    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07cd5f44_2d82_43e8_9672_6f9c02e885fa.slice/crio-c443879604775d17f17a139d00dd2c15a75f190d02c21d0f67790916b73ce2de WatchSource:0}: Error finding container c443879604775d17f17a139d00dd2c15a75f190d02c21d0f67790916b73ce2de: Status 404 returned error can't find the container with id c443879604775d17f17a139d00dd2c15a75f190d02c21d0f67790916b73ce2de
Jul 29 01:11:01.508265 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.508157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:01.508458 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:01.508291    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:01.508458 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:01.508368    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls podName:515d5fad-7061-41fd-b0b9-c04e9a68205a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:02.508352754 +0000 UTC m=+39.147449540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls") pod "dns-default-w6266" (UID: "515d5fad-7061-41fd-b0b9-c04e9a68205a") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:01.910015 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.909979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:11:01.910194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.910022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:11:01.910194 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.910160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:11:01.912391 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.912362    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:11:01.912513 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.912362    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:11:01.912688 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.912662    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:11:01.912794 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.912689    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:11:01.912794 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.912710    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d72dr\""
Jul 29 01:11:01.912794 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:01.912662    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llbnf\""
Jul 29 01:11:02.184218 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:02.184131    2565 generic.go:356] "Generic (PLEG): container finished" podID="ee55e08f-e1c2-43dc-8b57-d721089f17ab" containerID="e4d586019db995f388367d80880e9e8be92d473c7c09f8df203eccd42fc596e0" exitCode=0
Jul 29 01:11:02.184660 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:02.184210    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xg8vw" event={"ID":"ee55e08f-e1c2-43dc-8b57-d721089f17ab","Type":"ContainerDied","Data":"e4d586019db995f388367d80880e9e8be92d473c7c09f8df203eccd42fc596e0"}
Jul 29 01:11:02.185820 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:02.185575    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbsln" event={"ID":"07cd5f44-2d82-43e8-9672-6f9c02e885fa","Type":"ContainerStarted","Data":"c443879604775d17f17a139d00dd2c15a75f190d02c21d0f67790916b73ce2de"}
Jul 29 01:11:02.515890 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:02.515647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:02.516050 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:02.515819    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:02.516050 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:02.516022    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls podName:515d5fad-7061-41fd-b0b9-c04e9a68205a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:04.516001104 +0000 UTC m=+41.155097893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls") pod "dns-default-w6266" (UID: "515d5fad-7061-41fd-b0b9-c04e9a68205a") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:03.191228 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:03.191190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xg8vw" event={"ID":"ee55e08f-e1c2-43dc-8b57-d721089f17ab","Type":"ContainerStarted","Data":"10d91e467a188b066ef2529c5e4fb9c90330dbf92f4c35db6861f13f0e7dbf33"}
Jul 29 01:11:03.214374 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:03.214294    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xg8vw" podStartSLOduration=8.812352047 podStartE2EDuration="39.214273281s" totalImagesPullingTime="30.401921234s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:11:03.213208407 +0000 UTC m=+39.852305216" watchObservedRunningTime="2026-07-29 01:11:03.214273281 +0000 UTC m=+39.853370089"
Jul 29 01:11:04.194493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:04.194453    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sbsln" event={"ID":"07cd5f44-2d82-43e8-9672-6f9c02e885fa","Type":"ContainerStarted","Data":"eb4cf35c45abf5ce48efaa3a72926989d69f7064e82be184e1eb9f4cc4b73565"}
Jul 29 01:11:04.209759 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:04.209713    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sbsln" podStartSLOduration=1.861800477 podStartE2EDuration="4.209696878s" totalImagesPullingTime="2.347896401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:11:04.209356288 +0000 UTC m=+40.848453097" watchObservedRunningTime="2026-07-29 01:11:04.209696878 +0000 UTC m=+40.848793686"
Jul 29 01:11:04.530224 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:04.530193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:04.530412 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:04.530335    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:04.530412 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:04.530387    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls podName:515d5fad-7061-41fd-b0b9-c04e9a68205a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:08.5303729 +0000 UTC m=+45.169469687 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls") pod "dns-default-w6266" (UID: "515d5fad-7061-41fd-b0b9-c04e9a68205a") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:08.558611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:08.558569    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:08.558982 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:08.558721    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:08.558982 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:08.558784    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls podName:515d5fad-7061-41fd-b0b9-c04e9a68205a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:16.558768461 +0000 UTC m=+53.197865247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls") pod "dns-default-w6266" (UID: "515d5fad-7061-41fd-b0b9-c04e9a68205a") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:16.612443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:16.612400    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:16.613011 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:16.612556    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:16.613011 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:16.612623    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls podName:515d5fad-7061-41fd-b0b9-c04e9a68205a nodeName:}" failed. No retries permitted until 2026-07-29 01:11:32.612605859 +0000 UTC m=+69.251702645 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls") pod "dns-default-w6266" (UID: "515d5fad-7061-41fd-b0b9-c04e9a68205a") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:24.167592 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:24.167564    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-thlhl"
Jul 29 01:11:29.497354 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.497322    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:11:29.497750 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.497366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:11:29.499527 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.499502    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 01:11:29.499647 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.499505    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 01:11:29.508231 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:29.508210    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:11:29.508293 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:29.508282    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:12:33.508262779 +0000 UTC m=+130.147359565 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : secret "metrics-daemon-secret" not found
Jul 29 01:11:29.511797 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.511780    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/438c0d21-3d37-4f76-b8b8-a80944438de8-original-pull-secret\") pod \"global-pull-secret-syncer-2k7wg\" (UID: \"438c0d21-3d37-4f76-b8b8-a80944438de8\") " pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:11:29.529998 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.529977    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2k7wg"
Jul 29 01:11:29.598528 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.598500    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:11:29.601279 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.601261    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 01:11:29.611468 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.611447    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 01:11:29.622765 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.622746    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4l9h\" (UniqueName: \"kubernetes.io/projected/2a8dfebe-b4f3-4744-a527-b478ff6aa5c1-kube-api-access-z4l9h\") pod \"network-check-target-rbcnr\" (UID: \"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1\") " pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:11:29.648258 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.648237    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2k7wg"]
Jul 29 01:11:29.651542 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:11:29.651519    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod438c0d21_3d37_4f76_b8b8_a80944438de8.slice/crio-57498264b702bcd12b89d27fddcf80c28832b46f8561e0bd2e43deae52d284b0 WatchSource:0}: Error finding container 57498264b702bcd12b89d27fddcf80c28832b46f8561e0bd2e43deae52d284b0: Status 404 returned error can't find the container with id 57498264b702bcd12b89d27fddcf80c28832b46f8561e0bd2e43deae52d284b0
Jul 29 01:11:29.824867 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.824847    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-d72dr\""
Jul 29 01:11:29.833369 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.833351    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:11:29.950613 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:29.950582    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rbcnr"]
Jul 29 01:11:29.953992 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:11:29.953968    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8dfebe_b4f3_4744_a527_b478ff6aa5c1.slice/crio-f48e4000049400591dc51a30442a90581985b8e8f9f77d8c7fc67c3d1b5ab1f1 WatchSource:0}: Error finding container f48e4000049400591dc51a30442a90581985b8e8f9f77d8c7fc67c3d1b5ab1f1: Status 404 returned error can't find the container with id f48e4000049400591dc51a30442a90581985b8e8f9f77d8c7fc67c3d1b5ab1f1
Jul 29 01:11:30.253431 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:30.253341    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbcnr" event={"ID":"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1","Type":"ContainerStarted","Data":"f48e4000049400591dc51a30442a90581985b8e8f9f77d8c7fc67c3d1b5ab1f1"}
Jul 29 01:11:30.254498 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:30.254474    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2k7wg" event={"ID":"438c0d21-3d37-4f76-b8b8-a80944438de8","Type":"ContainerStarted","Data":"57498264b702bcd12b89d27fddcf80c28832b46f8561e0bd2e43deae52d284b0"}
Jul 29 01:11:32.618140 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:32.618102    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:11:32.618540 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:32.618290    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:11:32.618540 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:11:32.618392    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls podName:515d5fad-7061-41fd-b0b9-c04e9a68205a nodeName:}" failed. No retries permitted until 2026-07-29 01:12:04.618369745 +0000 UTC m=+101.257466546 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls") pod "dns-default-w6266" (UID: "515d5fad-7061-41fd-b0b9-c04e9a68205a") : secret "dns-default-metrics-tls" not found
Jul 29 01:11:35.270129 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:35.270009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rbcnr" event={"ID":"2a8dfebe-b4f3-4744-a527-b478ff6aa5c1","Type":"ContainerStarted","Data":"3ffe9bd6f8c51b3f3ebe0f573de0bce3d4d9a7e3148587c31736342eff73a4fd"}
Jul 29 01:11:35.272476 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:35.270672    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:11:35.273915 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:35.273886    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2k7wg" event={"ID":"438c0d21-3d37-4f76-b8b8-a80944438de8","Type":"ContainerStarted","Data":"f173cb41de50959d6feb01b4b795354975ca2d8f57abe9059e17b4fdaa7b541a"}
Jul 29 01:11:35.285597 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:11:35.285559    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rbcnr" podStartSLOduration=66.781416907 podStartE2EDuration="1m11.285547441s" totalImagesPullingTime="4.504130534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:11:35.285301644 +0000 UTC m=+71.924398478" watchObservedRunningTime="2026-07-29 01:11:35.285547441 +0000 UTC m=+71.924644228"
Jul 29 01:12:04.621587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:04.621555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:12:04.621979 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:12:04.621654    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:12:04.621979 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:12:04.621710    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls podName:515d5fad-7061-41fd-b0b9-c04e9a68205a nodeName:}" failed. No retries permitted until 2026-07-29 01:13:08.621696858 +0000 UTC m=+165.260793644 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls") pod "dns-default-w6266" (UID: "515d5fad-7061-41fd-b0b9-c04e9a68205a") : secret "dns-default-metrics-tls" not found
Jul 29 01:12:07.280916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:07.280890    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rbcnr"
Jul 29 01:12:07.298698 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:07.298651    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2k7wg" podStartSLOduration=98.481533123 podStartE2EDuration="1m43.298638457s" totalImagesPullingTime="4.817105334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:11:35.298875583 +0000 UTC m=+71.937972390" watchObservedRunningTime="2026-07-29 01:12:07.298638457 +0000 UTC m=+103.937735264"
Jul 29 01:12:33.600938 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:33.600904    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:12:33.601446 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:12:33.601027    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:12:33.601446 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:12:33.601090    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:35.601073439 +0000 UTC m=+252.240170226 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : secret "metrics-daemon-secret" not found
Jul 29 01:12:38.067751 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.067723    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"]
Jul 29 01:12:38.069776 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.069761    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.072534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.072511    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 29 01:12:38.072658 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.072541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 29 01:12:38.072658 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.072553    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 29 01:12:38.072658 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.072568    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 29 01:12:38.080672 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.080649    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"]
Jul 29 01:12:38.127973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.127948    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c454280c-5140-45ff-9b25-2365eaa01c96-tmp\") pod \"klusterlet-addon-workmgr-7b56c46d9c-58zbd\" (UID: \"c454280c-5140-45ff-9b25-2365eaa01c96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.128079 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.127982    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzk95\" (UniqueName: \"kubernetes.io/projected/c454280c-5140-45ff-9b25-2365eaa01c96-kube-api-access-dzk95\") pod \"klusterlet-addon-workmgr-7b56c46d9c-58zbd\" (UID: \"c454280c-5140-45ff-9b25-2365eaa01c96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.128079 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.128038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c454280c-5140-45ff-9b25-2365eaa01c96-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b56c46d9c-58zbd\" (UID: \"c454280c-5140-45ff-9b25-2365eaa01c96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.228458 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.228437    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c454280c-5140-45ff-9b25-2365eaa01c96-tmp\") pod \"klusterlet-addon-workmgr-7b56c46d9c-58zbd\" (UID: \"c454280c-5140-45ff-9b25-2365eaa01c96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.228534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.228467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzk95\" (UniqueName: \"kubernetes.io/projected/c454280c-5140-45ff-9b25-2365eaa01c96-kube-api-access-dzk95\") pod \"klusterlet-addon-workmgr-7b56c46d9c-58zbd\" (UID: \"c454280c-5140-45ff-9b25-2365eaa01c96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.228575 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.228528    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c454280c-5140-45ff-9b25-2365eaa01c96-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b56c46d9c-58zbd\" (UID: \"c454280c-5140-45ff-9b25-2365eaa01c96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.228959 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.228944    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c454280c-5140-45ff-9b25-2365eaa01c96-tmp\") pod \"klusterlet-addon-workmgr-7b56c46d9c-58zbd\" (UID: \"c454280c-5140-45ff-9b25-2365eaa01c96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.230940 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.230924    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/c454280c-5140-45ff-9b25-2365eaa01c96-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b56c46d9c-58zbd\" (UID: \"c454280c-5140-45ff-9b25-2365eaa01c96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.236782 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.236764    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzk95\" (UniqueName: \"kubernetes.io/projected/c454280c-5140-45ff-9b25-2365eaa01c96-kube-api-access-dzk95\") pod \"klusterlet-addon-workmgr-7b56c46d9c-58zbd\" (UID: \"c454280c-5140-45ff-9b25-2365eaa01c96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.379037 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.378979    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:38.493598 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:38.493567    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"]
Jul 29 01:12:38.496220 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:12:38.496192    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc454280c_5140_45ff_9b25_2365eaa01c96.slice/crio-a61579db9ac1579031dced83f94d625b584e578b43acaab5118344f3c942dd5e WatchSource:0}: Error finding container a61579db9ac1579031dced83f94d625b584e578b43acaab5118344f3c942dd5e: Status 404 returned error can't find the container with id a61579db9ac1579031dced83f94d625b584e578b43acaab5118344f3c942dd5e
Jul 29 01:12:39.412400 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:39.412362    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd" event={"ID":"c454280c-5140-45ff-9b25-2365eaa01c96","Type":"ContainerStarted","Data":"a61579db9ac1579031dced83f94d625b584e578b43acaab5118344f3c942dd5e"}
Jul 29 01:12:44.429387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:44.429354    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd" event={"ID":"c454280c-5140-45ff-9b25-2365eaa01c96","Type":"ContainerStarted","Data":"14a10a129af145f97fe44c062017777529185faeddc2197a5ab877146e87ba32"}
Jul 29 01:12:44.429764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:44.429559    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:44.430973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:44.430952    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:12:44.445020 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:12:44.444917    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd" podStartSLOduration=1.466528756 podStartE2EDuration="6.444903054s" totalImagesPullingTime="4.978374298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:12:44.444820057 +0000 UTC m=+141.083916866" watchObservedRunningTime="2026-07-29 01:12:44.444903054 +0000 UTC m=+141.083999865"
Jul 29 01:13:03.772046 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:13:03.772018    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w6266" podUID="515d5fad-7061-41fd-b0b9-c04e9a68205a"
Jul 29 01:13:04.473983 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:13:04.473956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6266"
Jul 29 01:13:04.935481 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:13:04.935438    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:13:08.720958 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:13:08.720925    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:13:08.721429 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:13:08.721045    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 01:13:08.721429 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:13:08.721117    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls podName:515d5fad-7061-41fd-b0b9-c04e9a68205a nodeName:}" failed. No retries permitted until 2026-07-29 01:15:10.721095872 +0000 UTC m=+287.360192660 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls") pod "dns-default-w6266" (UID: "515d5fad-7061-41fd-b0b9-c04e9a68205a") : secret "dns-default-metrics-tls" not found
Jul 29 01:13:18.910654 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:13:18.910585    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:14:31.682964 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.682936    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6"]
Jul 29 01:14:31.684809 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.684794    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6"
Jul 29 01:14:31.687623 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.687547    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l9cnv\""
Jul 29 01:14:31.689130 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.689108    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-h567k"]
Jul 29 01:14:31.691300 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.691281    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7db9444c44-6prgm"]
Jul 29 01:14:31.691430 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.691409    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.693343 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.693326    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.697978 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.697962    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 01:14:31.698092 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.698069    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 01:14:31.698092 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.698083    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:14:31.698248 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.698083    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 01:14:31.698248 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.698080    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 01:14:31.698456 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.698440    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pglm7\""
Jul 29 01:14:31.699000 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.698982    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 01:14:31.699151 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.699129    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 01:14:31.699242 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.699170    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cdts5\""
Jul 29 01:14:31.705339 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.705302    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 01:14:31.705871 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.705853    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 01:14:31.718349 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.718330    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-h567k"]
Jul 29 01:14:31.723056 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.723034    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7db9444c44-6prgm"]
Jul 29 01:14:31.723699 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.723681    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6"]
Jul 29 01:14:31.742372 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742350    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f514c21-dc80-4dbf-9198-dff7170b80de-ca-trust-extracted\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.742372 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-trusted-ca\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.742493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-config\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.742493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-trusted-ca\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.742493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-installation-pull-secrets\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.742493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-bound-sa-token\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.742493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-certificates\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.742688 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdsb7\" (UniqueName: \"kubernetes.io/projected/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-kube-api-access-zdsb7\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.742688 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5shn\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-kube-api-access-n5shn\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.742688 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742604    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-image-registry-private-configuration\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.742688 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clzjc\" (UniqueName: \"kubernetes.io/projected/57a6ad2d-12c1-415a-aebc-fd2fb654db16-kube-api-access-clzjc\") pod \"network-check-source-7d88cb55d8-94cj6\" (UID: \"57a6ad2d-12c1-415a-aebc-fd2fb654db16\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6"
Jul 29 01:14:31.742688 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-serving-cert\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.742688 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.742654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.796368 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.796348    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"]
Jul 29 01:14:31.798337 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.798321    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:31.800640 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.800623    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 01:14:31.800793 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.800777    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qzpdd\""
Jul 29 01:14:31.800839 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.800820    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 29 01:14:31.801485 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.801462    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 01:14:31.803279 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.803256    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 29 01:14:31.813088 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.813068    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"]
Jul 29 01:14:31.843388 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843366    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-certificates\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.843467 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843406    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdsb7\" (UniqueName: \"kubernetes.io/projected/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-kube-api-access-zdsb7\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.843467 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843423    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5shn\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-kube-api-access-n5shn\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.843561 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843540    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:31.843612 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843586    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-image-registry-private-configuration\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.843662 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clzjc\" (UniqueName: \"kubernetes.io/projected/57a6ad2d-12c1-415a-aebc-fd2fb654db16-kube-api-access-clzjc\") pod \"network-check-source-7d88cb55d8-94cj6\" (UID: \"57a6ad2d-12c1-415a-aebc-fd2fb654db16\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6"
Jul 29 01:14:31.843662 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843646    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-serving-cert\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.843757 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.843757 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843679    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f514c21-dc80-4dbf-9198-dff7170b80de-ca-trust-extracted\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.843757 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843693    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-trusted-ca\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.843757 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843718    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-config\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.843942 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-trusted-ca\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.843942 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:31.843799    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:14:31.843942 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:31.843816    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db9444c44-6prgm: secret "image-registry-tls" not found
Jul 29 01:14:31.843942 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843822    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-installation-pull-secrets\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.843942 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-bound-sa-token\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.843942 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:31.843891    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls podName:0f514c21-dc80-4dbf-9198-dff7170b80de nodeName:}" failed. No retries permitted until 2026-07-29 01:14:32.343872025 +0000 UTC m=+248.982968841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls") pod "image-registry-7db9444c44-6prgm" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de") : secret "image-registry-tls" not found
Jul 29 01:14:31.843942 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843918    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-certificates\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.843942 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:31.844335 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.843964    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fcsm\" (UniqueName: \"kubernetes.io/projected/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-kube-api-access-2fcsm\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:31.844335 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.844032    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f514c21-dc80-4dbf-9198-dff7170b80de-ca-trust-extracted\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.844558 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.844539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-config\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.844890 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.844873    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-trusted-ca\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.845034 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.845013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-trusted-ca\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.846451 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.846425    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-installation-pull-secrets\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.846546 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.846531    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-serving-cert\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.846590 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.846572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-image-registry-private-configuration\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.854420 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.854391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clzjc\" (UniqueName: \"kubernetes.io/projected/57a6ad2d-12c1-415a-aebc-fd2fb654db16-kube-api-access-clzjc\") pod \"network-check-source-7d88cb55d8-94cj6\" (UID: \"57a6ad2d-12c1-415a-aebc-fd2fb654db16\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6"
Jul 29 01:14:31.854591 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.854572    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-bound-sa-token\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.854840 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.854824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5shn\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-kube-api-access-n5shn\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:31.858829 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.855449    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdsb7\" (UniqueName: \"kubernetes.io/projected/6a88e7bc-78c9-45de-8b6c-6462af16a7c9-kube-api-access-zdsb7\") pod \"console-operator-584dcb6b54-h567k\" (UID: \"6a88e7bc-78c9-45de-8b6c-6462af16a7c9\") " pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:31.944754 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.944703    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:31.944754 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.944734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fcsm\" (UniqueName: \"kubernetes.io/projected/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-kube-api-access-2fcsm\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:31.944862 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.944771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:31.944862 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:31.944837    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:31.945028 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:31.944907    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls podName:368387bd-4f4b-4ec0-9d6b-8500c5c8e353 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:32.444890425 +0000 UTC m=+249.083987214 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-dhgmg" (UID: "368387bd-4f4b-4ec0-9d6b-8500c5c8e353") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:31.945374 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.945358    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:31.958760 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.958738    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fcsm\" (UniqueName: \"kubernetes.io/projected/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-kube-api-access-2fcsm\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:31.993577 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:31.993544    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6"
Jul 29 01:14:32.001210 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:32.001190    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:32.117509 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:32.117470    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6"]
Jul 29 01:14:32.121769 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:14:32.121743    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57a6ad2d_12c1_415a_aebc_fd2fb654db16.slice/crio-38385b432a3f4a0887d8b865911fb9bf74dc28e4e9f3df996171eba96a86148b WatchSource:0}: Error finding container 38385b432a3f4a0887d8b865911fb9bf74dc28e4e9f3df996171eba96a86148b: Status 404 returned error can't find the container with id 38385b432a3f4a0887d8b865911fb9bf74dc28e4e9f3df996171eba96a86148b
Jul 29 01:14:32.135947 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:32.135921    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-h567k"]
Jul 29 01:14:32.145426 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:14:32.145379    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a88e7bc_78c9_45de_8b6c_6462af16a7c9.slice/crio-cb012150d4ea297b15cf9a32abcbc153967b9780e36e833b066d257505864e23 WatchSource:0}: Error finding container cb012150d4ea297b15cf9a32abcbc153967b9780e36e833b066d257505864e23: Status 404 returned error can't find the container with id cb012150d4ea297b15cf9a32abcbc153967b9780e36e833b066d257505864e23
Jul 29 01:14:32.347417 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:32.347384    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:32.347550 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:32.347507    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:14:32.347550 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:32.347518    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db9444c44-6prgm: secret "image-registry-tls" not found
Jul 29 01:14:32.347615 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:32.347564    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls podName:0f514c21-dc80-4dbf-9198-dff7170b80de nodeName:}" failed. No retries permitted until 2026-07-29 01:14:33.347551954 +0000 UTC m=+249.986648740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls") pod "image-registry-7db9444c44-6prgm" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de") : secret "image-registry-tls" not found
Jul 29 01:14:32.448092 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:32.448063    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:32.448217 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:32.448167    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:32.448217 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:32.448216    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls podName:368387bd-4f4b-4ec0-9d6b-8500c5c8e353 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:33.448203732 +0000 UTC m=+250.087300519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-dhgmg" (UID: "368387bd-4f4b-4ec0-9d6b-8500c5c8e353") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:32.671081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:32.671009    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" event={"ID":"6a88e7bc-78c9-45de-8b6c-6462af16a7c9","Type":"ContainerStarted","Data":"cb012150d4ea297b15cf9a32abcbc153967b9780e36e833b066d257505864e23"}
Jul 29 01:14:32.672412 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:32.672373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6" event={"ID":"57a6ad2d-12c1-415a-aebc-fd2fb654db16","Type":"ContainerStarted","Data":"5587fe386673b5394c3f3d351cee963e18c43fd6e02662ffd93385efbf8ef734"}
Jul 29 01:14:32.672542 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:32.672416    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6" event={"ID":"57a6ad2d-12c1-415a-aebc-fd2fb654db16","Type":"ContainerStarted","Data":"38385b432a3f4a0887d8b865911fb9bf74dc28e4e9f3df996171eba96a86148b"}
Jul 29 01:14:32.689969 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:32.689917    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-94cj6" podStartSLOduration=1.6898973499999999 podStartE2EDuration="1.68989735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:32.688280278 +0000 UTC m=+249.327377105" watchObservedRunningTime="2026-07-29 01:14:32.68989735 +0000 UTC m=+249.328994158"
Jul 29 01:14:33.354072 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:33.354036    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:33.354263 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:33.354184    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:14:33.354263 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:33.354203    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db9444c44-6prgm: secret "image-registry-tls" not found
Jul 29 01:14:33.354263 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:33.354256    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls podName:0f514c21-dc80-4dbf-9198-dff7170b80de nodeName:}" failed. No retries permitted until 2026-07-29 01:14:35.354241085 +0000 UTC m=+251.993337871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls") pod "image-registry-7db9444c44-6prgm" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de") : secret "image-registry-tls" not found
Jul 29 01:14:33.454575 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:33.454544    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:33.454740 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:33.454664    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:33.454740 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:33.454712    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls podName:368387bd-4f4b-4ec0-9d6b-8500c5c8e353 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:35.454699014 +0000 UTC m=+252.093795802 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-dhgmg" (UID: "368387bd-4f4b-4ec0-9d6b-8500c5c8e353") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:34.680092 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:34.680065    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/0.log"
Jul 29 01:14:34.680529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:34.680104    2565 generic.go:356] "Generic (PLEG): container finished" podID="6a88e7bc-78c9-45de-8b6c-6462af16a7c9" containerID="a0845162cb4f42bc11281d9e675017c58dfb0cf64fce155eb5db615978e7db2d" exitCode=255
Jul 29 01:14:34.680529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:34.680141    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" event={"ID":"6a88e7bc-78c9-45de-8b6c-6462af16a7c9","Type":"ContainerDied","Data":"a0845162cb4f42bc11281d9e675017c58dfb0cf64fce155eb5db615978e7db2d"}
Jul 29 01:14:34.680529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:34.680371    2565 scope.go:117] "RemoveContainer" containerID="a0845162cb4f42bc11281d9e675017c58dfb0cf64fce155eb5db615978e7db2d"
Jul 29 01:14:35.368102 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:35.368068    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:35.368257 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:35.368228    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:14:35.368257 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:35.368246    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db9444c44-6prgm: secret "image-registry-tls" not found
Jul 29 01:14:35.368351 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:35.368299    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls podName:0f514c21-dc80-4dbf-9198-dff7170b80de nodeName:}" failed. No retries permitted until 2026-07-29 01:14:39.368284 +0000 UTC m=+256.007380786 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls") pod "image-registry-7db9444c44-6prgm" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de") : secret "image-registry-tls" not found
Jul 29 01:14:35.469220 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:35.469177    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:35.469357 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:35.469331    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:35.469401 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:35.469388    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls podName:368387bd-4f4b-4ec0-9d6b-8500c5c8e353 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:39.469370918 +0000 UTC m=+256.108467713 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-dhgmg" (UID: "368387bd-4f4b-4ec0-9d6b-8500c5c8e353") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:35.670806 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:35.670731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:14:35.670933 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:35.670876    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 29 01:14:35.670974 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:35.670933    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs podName:a8df54e0-7ee3-4299-bbd5-0be15e4026d6 nodeName:}" failed. No retries permitted until 2026-07-29 01:16:37.670919259 +0000 UTC m=+374.310016049 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs") pod "network-metrics-daemon-tjfzp" (UID: "a8df54e0-7ee3-4299-bbd5-0be15e4026d6") : secret "metrics-daemon-secret" not found
Jul 29 01:14:35.684728 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:35.684703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/1.log"
Jul 29 01:14:35.685088 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:35.685068    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/0.log"
Jul 29 01:14:35.685134 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:35.685096    2565 generic.go:356] "Generic (PLEG): container finished" podID="6a88e7bc-78c9-45de-8b6c-6462af16a7c9" containerID="fcbeb4a51ea5921d949e4dd0e8baf47db28b91db03719b74ff5e71ab8eda5c8f" exitCode=255
Jul 29 01:14:35.685134 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:35.685122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" event={"ID":"6a88e7bc-78c9-45de-8b6c-6462af16a7c9","Type":"ContainerDied","Data":"fcbeb4a51ea5921d949e4dd0e8baf47db28b91db03719b74ff5e71ab8eda5c8f"}
Jul 29 01:14:35.685199 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:35.685173    2565 scope.go:117] "RemoveContainer" containerID="a0845162cb4f42bc11281d9e675017c58dfb0cf64fce155eb5db615978e7db2d"
Jul 29 01:14:35.685384 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:35.685365    2565 scope.go:117] "RemoveContainer" containerID="fcbeb4a51ea5921d949e4dd0e8baf47db28b91db03719b74ff5e71ab8eda5c8f"
Jul 29 01:14:35.685610 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:35.685592    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-h567k_openshift-console-operator(6a88e7bc-78c9-45de-8b6c-6462af16a7c9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" podUID="6a88e7bc-78c9-45de-8b6c-6462af16a7c9"
Jul 29 01:14:36.264864 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.264836    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5579b"]
Jul 29 01:14:36.268828 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.268814    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.271052 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.271023    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 01:14:36.271154 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.271113    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 01:14:36.273494 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.273476    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 01:14:36.273611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.273577    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p2fjq\""
Jul 29 01:14:36.273732 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.273715    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 01:14:36.280759 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.280741    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5579b"]
Jul 29 01:14:36.375445 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.375422    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.375534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.375449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.375534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.375488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-crio-socket\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.375603 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.375533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-data-volume\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.375603 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.375594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcsx8\" (UniqueName: \"kubernetes.io/projected/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-api-access-wcsx8\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.476547 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.476519    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-crio-socket\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.476547 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.476553    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-data-volume\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.476668 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.476590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcsx8\" (UniqueName: \"kubernetes.io/projected/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-api-access-wcsx8\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.476668 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.476627    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.476668 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.476637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-crio-socket\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.476668 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.476652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.476801 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:36.476724    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:36.476801 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:36.476744    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:36.476801 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:36.476788    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:36.976770776 +0000 UTC m=+253.615867579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:36.476911 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:36.476806    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:36.976797601 +0000 UTC m=+253.615894390 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:36.476947 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.476916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-data-volume\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.486464 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.486443    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcsx8\" (UniqueName: \"kubernetes.io/projected/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-api-access-wcsx8\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.690328 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.690257    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/1.log"
Jul 29 01:14:36.690627 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.690555    2565 scope.go:117] "RemoveContainer" containerID="fcbeb4a51ea5921d949e4dd0e8baf47db28b91db03719b74ff5e71ab8eda5c8f"
Jul 29 01:14:36.690728 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:36.690710    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-h567k_openshift-console-operator(6a88e7bc-78c9-45de-8b6c-6462af16a7c9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" podUID="6a88e7bc-78c9-45de-8b6c-6462af16a7c9"
Jul 29 01:14:36.979894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.979823    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.979894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:36.979858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:36.980073 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:36.979954    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:36.980073 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:36.979959    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:36.980073 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:36.980016    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:37.980001564 +0000 UTC m=+254.619098351 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:36.980073 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:36.980029    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:37.980022537 +0000 UTC m=+254.619119323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:37.987246 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:37.987212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:37.987246 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:37.987250    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:37.987712 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:37.987365    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:37.987712 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:37.987376    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:37.987712 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:37.987417    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:39.987404324 +0000 UTC m=+256.626501110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:37.987712 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:37.987438    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:39.987423965 +0000 UTC m=+256.626520771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:38.053751 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:38.053730    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lfbss_0e8f9521-62b0-466a-bce8-29da863f6032/dns-node-resolver/0.log"
Jul 29 01:14:38.990681 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:38.990654    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-np782"]
Jul 29 01:14:38.993789 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:38.993771    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:38.995880 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:38.995858    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 29 01:14:38.995966 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:38.995949    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-l5zgp\""
Jul 29 01:14:38.996613 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:38.996595    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 29 01:14:38.996718 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:38.996616    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 29 01:14:38.996718 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:38.996683    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 29 01:14:39.003212 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.003195    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-np782"]
Jul 29 01:14:39.094443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.094418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d365b84e-7f33-455c-be03-060bfcc82d5e-signing-key\") pod \"service-ca-658d7b7c78-np782\" (UID: \"d365b84e-7f33-455c-be03-060bfcc82d5e\") " pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.094540 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.094454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d365b84e-7f33-455c-be03-060bfcc82d5e-signing-cabundle\") pod \"service-ca-658d7b7c78-np782\" (UID: \"d365b84e-7f33-455c-be03-060bfcc82d5e\") " pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.094540 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.094528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhjxf\" (UniqueName: \"kubernetes.io/projected/d365b84e-7f33-455c-be03-060bfcc82d5e-kube-api-access-hhjxf\") pod \"service-ca-658d7b7c78-np782\" (UID: \"d365b84e-7f33-455c-be03-060bfcc82d5e\") " pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.195003 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.194978    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjxf\" (UniqueName: \"kubernetes.io/projected/d365b84e-7f33-455c-be03-060bfcc82d5e-kube-api-access-hhjxf\") pod \"service-ca-658d7b7c78-np782\" (UID: \"d365b84e-7f33-455c-be03-060bfcc82d5e\") " pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.195098 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.195054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d365b84e-7f33-455c-be03-060bfcc82d5e-signing-key\") pod \"service-ca-658d7b7c78-np782\" (UID: \"d365b84e-7f33-455c-be03-060bfcc82d5e\") " pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.195098 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.195074    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d365b84e-7f33-455c-be03-060bfcc82d5e-signing-cabundle\") pod \"service-ca-658d7b7c78-np782\" (UID: \"d365b84e-7f33-455c-be03-060bfcc82d5e\") " pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.195640 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.195621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d365b84e-7f33-455c-be03-060bfcc82d5e-signing-cabundle\") pod \"service-ca-658d7b7c78-np782\" (UID: \"d365b84e-7f33-455c-be03-060bfcc82d5e\") " pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.197467 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.197448    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d365b84e-7f33-455c-be03-060bfcc82d5e-signing-key\") pod \"service-ca-658d7b7c78-np782\" (UID: \"d365b84e-7f33-455c-be03-060bfcc82d5e\") " pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.203423 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.203406    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhjxf\" (UniqueName: \"kubernetes.io/projected/d365b84e-7f33-455c-be03-060bfcc82d5e-kube-api-access-hhjxf\") pod \"service-ca-658d7b7c78-np782\" (UID: \"d365b84e-7f33-455c-be03-060bfcc82d5e\") " pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.303018 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.302998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-np782"
Jul 29 01:14:39.397121 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.397096    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:39.397650 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:39.397632    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 01:14:39.397708 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:39.397652    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7db9444c44-6prgm: secret "image-registry-tls" not found
Jul 29 01:14:39.397708 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:39.397707    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls podName:0f514c21-dc80-4dbf-9198-dff7170b80de nodeName:}" failed. No retries permitted until 2026-07-29 01:14:47.397692635 +0000 UTC m=+264.036789422 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls") pod "image-registry-7db9444c44-6prgm" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de") : secret "image-registry-tls" not found
Jul 29 01:14:39.421517 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.421487    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-np782"]
Jul 29 01:14:39.424873 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:14:39.424848    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd365b84e_7f33_455c_be03_060bfcc82d5e.slice/crio-8c26f5930faee312239f338991dad5e39cd1243c721ab2445f3ab53a8979320c WatchSource:0}: Error finding container 8c26f5930faee312239f338991dad5e39cd1243c721ab2445f3ab53a8979320c: Status 404 returned error can't find the container with id 8c26f5930faee312239f338991dad5e39cd1243c721ab2445f3ab53a8979320c
Jul 29 01:14:39.453926 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.453904    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s8bh7_48eb1cb9-59b2-4872-af62-482f69ebdb68/node-ca/0.log"
Jul 29 01:14:39.497958 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.497935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:39.498038 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:39.498031    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:39.498083 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:39.498074    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls podName:368387bd-4f4b-4ec0-9d6b-8500c5c8e353 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:47.498062825 +0000 UTC m=+264.137159612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-dhgmg" (UID: "368387bd-4f4b-4ec0-9d6b-8500c5c8e353") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:39.700403 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:39.700342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-np782" event={"ID":"d365b84e-7f33-455c-be03-060bfcc82d5e","Type":"ContainerStarted","Data":"8c26f5930faee312239f338991dad5e39cd1243c721ab2445f3ab53a8979320c"}
Jul 29 01:14:40.001406 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:40.001330    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:40.001406 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:40.001371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:40.001855 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:40.001439    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:40.001855 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:40.001487    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:40.001855 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:40.001537    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:44.001510617 +0000 UTC m=+260.640607403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:40.001855 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:40.001561    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:44.001552496 +0000 UTC m=+260.640649287 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:40.054593 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:40.054567    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbsln_07cd5f44-2d82-43e8-9672-6f9c02e885fa/serve-healthcheck-canary/0.log"
Jul 29 01:14:41.710031 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:41.709995    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-np782" event={"ID":"d365b84e-7f33-455c-be03-060bfcc82d5e","Type":"ContainerStarted","Data":"c5fcea86fc484606df32ae62c61ecdd6bc6aac85a0a54ab873f4f0ae7eb2283c"}
Jul 29 01:14:41.725068 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:41.725024    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-np782" podStartSLOduration=2.013219495 podStartE2EDuration="3.725009093s" totalImagesPullingTime="1.711789598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:41.723578265 +0000 UTC m=+258.362675072" watchObservedRunningTime="2026-07-29 01:14:41.725009093 +0000 UTC m=+258.364105900"
Jul 29 01:14:42.002377 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:42.002286    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:42.002377 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:42.002360    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:14:42.002782 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:42.002768    2565 scope.go:117] "RemoveContainer" containerID="fcbeb4a51ea5921d949e4dd0e8baf47db28b91db03719b74ff5e71ab8eda5c8f"
Jul 29 01:14:42.002961 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:42.002939    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-h567k_openshift-console-operator(6a88e7bc-78c9-45de-8b6c-6462af16a7c9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" podUID="6a88e7bc-78c9-45de-8b6c-6462af16a7c9"
Jul 29 01:14:43.716991 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:43.716960    2565 generic.go:356] "Generic (PLEG): container finished" podID="c454280c-5140-45ff-9b25-2365eaa01c96" containerID="14a10a129af145f97fe44c062017777529185faeddc2197a5ab877146e87ba32" exitCode=1
Jul 29 01:14:43.717416 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:43.717007    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd" event={"ID":"c454280c-5140-45ff-9b25-2365eaa01c96","Type":"ContainerDied","Data":"14a10a129af145f97fe44c062017777529185faeddc2197a5ab877146e87ba32"}
Jul 29 01:14:43.717416 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:43.717391    2565 scope.go:117] "RemoveContainer" containerID="14a10a129af145f97fe44c062017777529185faeddc2197a5ab877146e87ba32"
Jul 29 01:14:44.034454 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:44.034430    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:44.034596 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:44.034464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:44.034596 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:44.034557    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 01:14:44.034596 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:44.034557    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:44.034688 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:44.034612    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:52.034598494 +0000 UTC m=+268.673695281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:44.034688 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:44.034624    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:14:52.034618132 +0000 UTC m=+268.673714918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : configmap "kube-rbac-proxy" not found
Jul 29 01:14:44.430467 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:44.430380    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:14:44.726293 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:44.726220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd" event={"ID":"c454280c-5140-45ff-9b25-2365eaa01c96","Type":"ContainerStarted","Data":"7a3a7eda7b3606e72f5d5ef73a4316209c7b8506e2dc428ca840df387c85fac6"}
Jul 29 01:14:44.726696 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:44.726411    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:14:44.726989 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:44.726971    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b56c46d9c-58zbd"
Jul 29 01:14:47.458561 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:47.458532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:47.460889 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:47.460860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") pod \"image-registry-7db9444c44-6prgm\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") " pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:47.559010 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:47.558981    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:14:47.559127 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:47.559110    2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:47.559177 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:47.559167    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls podName:368387bd-4f4b-4ec0-9d6b-8500c5c8e353 nodeName:}" failed. No retries permitted until 2026-07-29 01:15:03.559152936 +0000 UTC m=+280.198249726 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-dhgmg" (UID: "368387bd-4f4b-4ec0-9d6b-8500c5c8e353") : secret "cluster-monitoring-operator-tls" not found
Jul 29 01:14:47.607429 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:47.607411    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:47.730728 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:47.730666    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7db9444c44-6prgm"]
Jul 29 01:14:47.733700 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:14:47.733669    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f514c21_dc80_4dbf_9198_dff7170b80de.slice/crio-caeefe80b9e3970c93dd89b74ce42a33011b58f6cd194a55aa889f2292cb169e WatchSource:0}: Error finding container caeefe80b9e3970c93dd89b74ce42a33011b58f6cd194a55aa889f2292cb169e: Status 404 returned error can't find the container with id caeefe80b9e3970c93dd89b74ce42a33011b58f6cd194a55aa889f2292cb169e
Jul 29 01:14:47.738369 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:47.738344    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db9444c44-6prgm" event={"ID":"0f514c21-dc80-4dbf-9198-dff7170b80de","Type":"ContainerStarted","Data":"caeefe80b9e3970c93dd89b74ce42a33011b58f6cd194a55aa889f2292cb169e"}
Jul 29 01:14:48.743060 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:48.743026    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db9444c44-6prgm" event={"ID":"0f514c21-dc80-4dbf-9198-dff7170b80de","Type":"ContainerStarted","Data":"6aea6dfee7e425ccade19b4364baa75c7ad278c48c3ac63d5325dbb5893f281e"}
Jul 29 01:14:48.743469 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:48.743157    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:14:48.766871 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:48.766817    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7db9444c44-6prgm" podStartSLOduration=17.766802628 podStartE2EDuration="17.766802628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:14:48.766146799 +0000 UTC m=+265.405243606" watchObservedRunningTime="2026-07-29 01:14:48.766802628 +0000 UTC m=+265.405899459"
Jul 29 01:14:52.095986 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:52.095948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:52.095986 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:52.095989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:52.096523 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:52.096081    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:52.096523 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:52.096137    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls podName:e0b4baf1-4be3-47ec-b35d-d8b2906fea97 nodeName:}" failed. No retries permitted until 2026-07-29 01:15:08.096121979 +0000 UTC m=+284.735218765 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5579b" (UID: "e0b4baf1-4be3-47ec-b35d-d8b2906fea97") : secret "insights-runtime-extractor-tls" not found
Jul 29 01:14:52.096642 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:52.096607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:14:53.911907 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:53.911880    2565 scope.go:117] "RemoveContainer" containerID="fcbeb4a51ea5921d949e4dd0e8baf47db28b91db03719b74ff5e71ab8eda5c8f"
Jul 29 01:14:54.760234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:54.760208    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:14:54.760580 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:54.760561    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/1.log"
Jul 29 01:14:54.760670 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:54.760599    2565 generic.go:356] "Generic (PLEG): container finished" podID="6a88e7bc-78c9-45de-8b6c-6462af16a7c9" containerID="cecbb3870e80b92e29ff87ec32e25227d9156e8499a4379688b0a7adbf6d6672" exitCode=255
Jul 29 01:14:54.760670 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:54.760659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" event={"ID":"6a88e7bc-78c9-45de-8b6c-6462af16a7c9","Type":"ContainerDied","Data":"cecbb3870e80b92e29ff87ec32e25227d9156e8499a4379688b0a7adbf6d6672"}
Jul 29 01:14:54.760772 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:54.760713    2565 scope.go:117] "RemoveContainer" containerID="fcbeb4a51ea5921d949e4dd0e8baf47db28b91db03719b74ff5e71ab8eda5c8f"
Jul 29 01:14:54.761023 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:54.760999    2565 scope.go:117] "RemoveContainer" containerID="cecbb3870e80b92e29ff87ec32e25227d9156e8499a4379688b0a7adbf6d6672"
Jul 29 01:14:54.761177 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:14:54.761159    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-h567k_openshift-console-operator(6a88e7bc-78c9-45de-8b6c-6462af16a7c9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" podUID="6a88e7bc-78c9-45de-8b6c-6462af16a7c9"
Jul 29 01:14:55.765395 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:14:55.765370    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:15:02.002117 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.002090    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:15:02.002493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.002133    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:15:02.002493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.002387    2565 scope.go:117] "RemoveContainer" containerID="cecbb3870e80b92e29ff87ec32e25227d9156e8499a4379688b0a7adbf6d6672"
Jul 29 01:15:02.002560 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:02.002525    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-h567k_openshift-console-operator(6a88e7bc-78c9-45de-8b6c-6462af16a7c9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" podUID="6a88e7bc-78c9-45de-8b6c-6462af16a7c9"
Jul 29 01:15:02.786467 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.786435    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7db9444c44-6prgm"]
Jul 29 01:15:02.795424 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.795394    2565 patch_prober.go:28] interesting pod/image-registry-7db9444c44-6prgm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:15:02.795592 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.795447    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7db9444c44-6prgm" podUID="0f514c21-dc80-4dbf-9198-dff7170b80de" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:15:02.838955 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.838923    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-798f887b5c-x5p7q"]
Jul 29 01:15:02.841739 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.841719    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:02.855635 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.855616    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-798f887b5c-x5p7q"]
Jul 29 01:15:02.971799 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.971777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-ca-trust-extracted\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:02.971905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.971804    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-installation-pull-secrets\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:02.971905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.971823    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-registry-certificates\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:02.971905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.971843    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdnw2\" (UniqueName: \"kubernetes.io/projected/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-kube-api-access-bdnw2\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:02.971905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.971860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-trusted-ca\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:02.971905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.971882    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-image-registry-private-configuration\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:02.972085 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.971911    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-bound-sa-token\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:02.972085 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:02.971958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-registry-tls\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.072514 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.072452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-ca-trust-extracted\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.072514 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.072480    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-installation-pull-secrets\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.072514 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.072497    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-registry-certificates\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.072514 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.072515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdnw2\" (UniqueName: \"kubernetes.io/projected/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-kube-api-access-bdnw2\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.073012 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.072531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-trusted-ca\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.073012 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.072557    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-image-registry-private-configuration\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.073012 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.072721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-bound-sa-token\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.073012 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.072853    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-registry-tls\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.073012 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.072913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-ca-trust-extracted\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.073490 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.073470    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-trusted-ca\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.073646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.073627    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-registry-certificates\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.075130 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.075104    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-image-registry-private-configuration\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.075218 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.075157    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-installation-pull-secrets\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.075522 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.075506    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-registry-tls\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.082148 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.082126    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-bound-sa-token\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.082741 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.082723    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdnw2\" (UniqueName: \"kubernetes.io/projected/0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d-kube-api-access-bdnw2\") pod \"image-registry-798f887b5c-x5p7q\" (UID: \"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d\") " pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.149827 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.149805    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.272073 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.272042    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-798f887b5c-x5p7q"]
Jul 29 01:15:03.274750 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:15:03.274723    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d71b7b9_fbd1_4414_bdd6_0b42e4d16d8d.slice/crio-dc660314345ecc59b9c5d2db7c55343003beec4f47b38f22dc1af494003beecc WatchSource:0}: Error finding container dc660314345ecc59b9c5d2db7c55343003beec4f47b38f22dc1af494003beecc: Status 404 returned error can't find the container with id dc660314345ecc59b9c5d2db7c55343003beec4f47b38f22dc1af494003beecc
Jul 29 01:15:03.576695 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.576663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:15:03.578961 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.578937    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/368387bd-4f4b-4ec0-9d6b-8500c5c8e353-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-dhgmg\" (UID: \"368387bd-4f4b-4ec0-9d6b-8500c5c8e353\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:15:03.606834 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.606803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"
Jul 29 01:15:03.731448 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.731411    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg"]
Jul 29 01:15:03.733805 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:15:03.733781    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod368387bd_4f4b_4ec0_9d6b_8500c5c8e353.slice/crio-9ac265c8d0487d1dcee6cac7557032a44ad6f756f03618dbee8c3148d0bc7220 WatchSource:0}: Error finding container 9ac265c8d0487d1dcee6cac7557032a44ad6f756f03618dbee8c3148d0bc7220: Status 404 returned error can't find the container with id 9ac265c8d0487d1dcee6cac7557032a44ad6f756f03618dbee8c3148d0bc7220
Jul 29 01:15:03.795790 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.795764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-798f887b5c-x5p7q" event={"ID":"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d","Type":"ContainerStarted","Data":"ffedd363c8982915a4c9bfbd80d02c0bfabf665171e2674cc9d4121375ae835a"}
Jul 29 01:15:03.795894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.795817    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-798f887b5c-x5p7q" event={"ID":"0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d","Type":"ContainerStarted","Data":"dc660314345ecc59b9c5d2db7c55343003beec4f47b38f22dc1af494003beecc"}
Jul 29 01:15:03.795894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.795845    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:03.797004 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.796981    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg" event={"ID":"368387bd-4f4b-4ec0-9d6b-8500c5c8e353","Type":"ContainerStarted","Data":"9ac265c8d0487d1dcee6cac7557032a44ad6f756f03618dbee8c3148d0bc7220"}
Jul 29 01:15:03.815655 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:03.815616    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-798f887b5c-x5p7q" podStartSLOduration=1.815602419 podStartE2EDuration="1.815602419s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:03.813890506 +0000 UTC m=+280.452987313" watchObservedRunningTime="2026-07-29 01:15:03.815602419 +0000 UTC m=+280.454699205"
Jul 29 01:15:05.803781 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:05.803749    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg" event={"ID":"368387bd-4f4b-4ec0-9d6b-8500c5c8e353","Type":"ContainerStarted","Data":"d8387321f331bf10f95d823ca439f3ba39dc72ce1af2d806aa1bd82bde04d8bd"}
Jul 29 01:15:05.820252 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:05.820203    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-dhgmg" podStartSLOduration=33.138940467 podStartE2EDuration="34.820183126s" totalImagesPullingTime="1.681242659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:05.818580828 +0000 UTC m=+282.457677636" watchObservedRunningTime="2026-07-29 01:15:05.820183126 +0000 UTC m=+282.459279936"
Jul 29 01:15:05.904640 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:05.904611    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"]
Jul 29 01:15:05.906610 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:05.906595    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"
Jul 29 01:15:05.909660 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:05.909640    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 29 01:15:05.910214 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:05.910193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nnn5p\""
Jul 29 01:15:05.919651 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:05.919627    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"]
Jul 29 01:15:05.999141 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:05.999116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67c483ef-ddd3-4ae7-b056-e00756212219-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-76lds\" (UID: \"67c483ef-ddd3-4ae7-b056-e00756212219\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"
Jul 29 01:15:06.099574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:06.099517    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67c483ef-ddd3-4ae7-b056-e00756212219-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-76lds\" (UID: \"67c483ef-ddd3-4ae7-b056-e00756212219\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"
Jul 29 01:15:06.099671 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:06.099622    2565 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 01:15:06.099723 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:06.099689    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67c483ef-ddd3-4ae7-b056-e00756212219-tls-certificates podName:67c483ef-ddd3-4ae7-b056-e00756212219 nodeName:}" failed. No retries permitted until 2026-07-29 01:15:06.599669351 +0000 UTC m=+283.238766138 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/67c483ef-ddd3-4ae7-b056-e00756212219-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-76lds" (UID: "67c483ef-ddd3-4ae7-b056-e00756212219") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 29 01:15:06.603295 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:06.603270    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67c483ef-ddd3-4ae7-b056-e00756212219-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-76lds\" (UID: \"67c483ef-ddd3-4ae7-b056-e00756212219\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"
Jul 29 01:15:06.605742 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:06.605714    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/67c483ef-ddd3-4ae7-b056-e00756212219-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-76lds\" (UID: \"67c483ef-ddd3-4ae7-b056-e00756212219\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"
Jul 29 01:15:06.818849 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:06.818818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"
Jul 29 01:15:06.938003 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:06.937974    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"]
Jul 29 01:15:06.940855 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:15:06.940832    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67c483ef_ddd3_4ae7_b056_e00756212219.slice/crio-d0561b4ad0f48ece8d57b5a6720af3d176cb7d041c614a214c05031dd67ebcd3 WatchSource:0}: Error finding container d0561b4ad0f48ece8d57b5a6720af3d176cb7d041c614a214c05031dd67ebcd3: Status 404 returned error can't find the container with id d0561b4ad0f48ece8d57b5a6720af3d176cb7d041c614a214c05031dd67ebcd3
Jul 29 01:15:07.474969 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:07.474932    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w6266" podUID="515d5fad-7061-41fd-b0b9-c04e9a68205a"
Jul 29 01:15:07.810681 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:07.810634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds" event={"ID":"67c483ef-ddd3-4ae7-b056-e00756212219","Type":"ContainerStarted","Data":"d0561b4ad0f48ece8d57b5a6720af3d176cb7d041c614a214c05031dd67ebcd3"}
Jul 29 01:15:07.810865 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:07.810661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6266"
Jul 29 01:15:08.113845 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:08.113777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:15:08.115924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:08.115906    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0b4baf1-4be3-47ec-b35d-d8b2906fea97-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5579b\" (UID: \"e0b4baf1-4be3-47ec-b35d-d8b2906fea97\") " pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:15:08.377365 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:08.377276    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5579b"
Jul 29 01:15:08.495913 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:08.495890    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5579b"]
Jul 29 01:15:08.498235 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:15:08.498212    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b4baf1_4be3_47ec_b35d_d8b2906fea97.slice/crio-ab02039edcd86599c991aeaa5214c18d7f160ccf5f01f7c1c371c6600177d09c WatchSource:0}: Error finding container ab02039edcd86599c991aeaa5214c18d7f160ccf5f01f7c1c371c6600177d09c: Status 404 returned error can't find the container with id ab02039edcd86599c991aeaa5214c18d7f160ccf5f01f7c1c371c6600177d09c
Jul 29 01:15:08.814396 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:08.814363    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5579b" event={"ID":"e0b4baf1-4be3-47ec-b35d-d8b2906fea97","Type":"ContainerStarted","Data":"ab02039edcd86599c991aeaa5214c18d7f160ccf5f01f7c1c371c6600177d09c"}
Jul 29 01:15:08.815565 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:08.815544    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds" event={"ID":"67c483ef-ddd3-4ae7-b056-e00756212219","Type":"ContainerStarted","Data":"eaf3bbed86162afe535ce8efdd7c40d01f4c47ce916fed595ca21191f8dc82d5"}
Jul 29 01:15:08.815763 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:08.815745    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"
Jul 29 01:15:08.820097 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:08.820077    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds"
Jul 29 01:15:08.831542 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:08.831506    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-76lds" podStartSLOduration=2.85928448 podStartE2EDuration="3.831495197s" totalImagesPullingTime="972.210717ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:08.830833547 +0000 UTC m=+285.469930356" watchObservedRunningTime="2026-07-29 01:15:08.831495197 +0000 UTC m=+285.470592003"
Jul 29 01:15:10.738168 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:10.738130    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:15:10.740691 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:10.740660    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/515d5fad-7061-41fd-b0b9-c04e9a68205a-metrics-tls\") pod \"dns-default-w6266\" (UID: \"515d5fad-7061-41fd-b0b9-c04e9a68205a\") " pod="openshift-dns/dns-default-w6266"
Jul 29 01:15:10.814448 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:10.814418    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5rpdf\""
Jul 29 01:15:10.822402 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:10.822363    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w6266"
Jul 29 01:15:12.791796 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:12.791759    2565 patch_prober.go:28] interesting pod/image-registry-7db9444c44-6prgm container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 29 01:15:12.792395 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:12.791821    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7db9444c44-6prgm" podUID="0f514c21-dc80-4dbf-9198-dff7170b80de" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:15:12.911084 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:12.911058    2565 scope.go:117] "RemoveContainer" containerID="cecbb3870e80b92e29ff87ec32e25227d9156e8499a4379688b0a7adbf6d6672"
Jul 29 01:15:12.911286 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:12.911263    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-h567k_openshift-console-operator(6a88e7bc-78c9-45de-8b6c-6462af16a7c9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" podUID="6a88e7bc-78c9-45de-8b6c-6462af16a7c9"
Jul 29 01:15:13.240117 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:13.240093    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w6266"]
Jul 29 01:15:13.242781 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:15:13.242755    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod515d5fad_7061_41fd_b0b9_c04e9a68205a.slice/crio-83bba04f701079932870642d80166e5abdf94fb15888aea88c4c93463940c80a WatchSource:0}: Error finding container 83bba04f701079932870642d80166e5abdf94fb15888aea88c4c93463940c80a: Status 404 returned error can't find the container with id 83bba04f701079932870642d80166e5abdf94fb15888aea88c4c93463940c80a
Jul 29 01:15:13.842667 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:13.842629    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5579b" event={"ID":"e0b4baf1-4be3-47ec-b35d-d8b2906fea97","Type":"ContainerStarted","Data":"91414d81bbfaa10f59225e41b0acace5594ce9101becc48b41e47b038555b194"}
Jul 29 01:15:13.845723 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:13.845693    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w6266" event={"ID":"515d5fad-7061-41fd-b0b9-c04e9a68205a","Type":"ContainerStarted","Data":"83bba04f701079932870642d80166e5abdf94fb15888aea88c4c93463940c80a"}
Jul 29 01:15:16.423420 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.423383    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"]
Jul 29 01:15:16.431166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.431145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.434938 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.434910    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 29 01:15:16.435079 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.434946    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-th4zk\""
Jul 29 01:15:16.435079 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.434971    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 29 01:15:16.435079 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.434919    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 29 01:15:16.435079 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.434915    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 01:15:16.449009 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.448985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"]
Jul 29 01:15:16.451653 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.451634    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vqffm"]
Jul 29 01:15:16.454092 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.454033    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.457877 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.457857    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 01:15:16.457997 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.457928    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pnbbx\""
Jul 29 01:15:16.458060 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.457857    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 01:15:16.458113 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.458063    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 01:15:16.586468 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p5xt\" (UniqueName: \"kubernetes.io/projected/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-api-access-5p5xt\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.586468 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.586709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586504    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.586709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-wtmp\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.586709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586608    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1568b0ae-58b5-452f-8a8e-a1e6b8154237-sys\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.586709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586628    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1568b0ae-58b5-452f-8a8e-a1e6b8154237-root\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.586709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586649    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.586709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.586709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586697    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-tls\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.586951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586736    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-textfile\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.586951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586771    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glnnz\" (UniqueName: \"kubernetes.io/projected/1568b0ae-58b5-452f-8a8e-a1e6b8154237-kube-api-access-glnnz\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.586951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.586951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.586951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586841    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1568b0ae-58b5-452f-8a8e-a1e6b8154237-metrics-client-ca\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.586951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.586919    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.688095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-wtmp\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688057    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1568b0ae-58b5-452f-8a8e-a1e6b8154237-sys\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1568b0ae-58b5-452f-8a8e-a1e6b8154237-root\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.688360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-tls\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688273    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1568b0ae-58b5-452f-8a8e-a1e6b8154237-sys\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-textfile\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glnnz\" (UniqueName: \"kubernetes.io/projected/1568b0ae-58b5-452f-8a8e-a1e6b8154237-kube-api-access-glnnz\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688645 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.688645 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688645 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:16.688457    2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 29 01:15:16.688645 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:16.688517    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-tls podName:cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5 nodeName:}" failed. No retries permitted until 2026-07-29 01:15:17.18849756 +0000 UTC m=+293.827594351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-pt7db" (UID: "cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5") : secret "kube-state-metrics-tls" not found
Jul 29 01:15:16.688645 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1568b0ae-58b5-452f-8a8e-a1e6b8154237-metrics-client-ca\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.688645 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.688645 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688647    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p5xt\" (UniqueName: \"kubernetes.io/projected/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-api-access-5p5xt\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.688973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.688973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.690790 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.689200    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-textfile\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.690790 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:16.689330    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 29 01:15:16.690790 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:16.689393    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-tls podName:1568b0ae-58b5-452f-8a8e-a1e6b8154237 nodeName:}" failed. No retries permitted until 2026-07-29 01:15:17.189373423 +0000 UTC m=+293.828470215 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-tls") pod "node-exporter-vqffm" (UID: "1568b0ae-58b5-452f-8a8e-a1e6b8154237") : secret "node-exporter-tls" not found
Jul 29 01:15:16.690790 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.689548    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1568b0ae-58b5-452f-8a8e-a1e6b8154237-metrics-client-ca\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.690790 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.689952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.690790 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.690410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.690790 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.688216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1568b0ae-58b5-452f-8a8e-a1e6b8154237-root\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.690790 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.690499    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-wtmp\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.690790 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.690601    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.691516 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.691476    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.691977 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.691950    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:16.693020 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.692979    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.711612 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.711566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p5xt\" (UniqueName: \"kubernetes.io/projected/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-api-access-5p5xt\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:16.712600 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:16.712557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glnnz\" (UniqueName: \"kubernetes.io/projected/1568b0ae-58b5-452f-8a8e-a1e6b8154237-kube-api-access-glnnz\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:17.192768 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.192691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:17.192768 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.192731    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-tls\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:17.194977 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.194957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1568b0ae-58b5-452f-8a8e-a1e6b8154237-node-exporter-tls\") pod \"node-exporter-vqffm\" (UID: \"1568b0ae-58b5-452f-8a8e-a1e6b8154237\") " pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:17.195069 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.195035    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-pt7db\" (UID: \"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:17.342813 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.342787    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"
Jul 29 01:15:17.365057 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.365033    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqffm"
Jul 29 01:15:17.375934 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:15:17.375849    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1568b0ae_58b5_452f_8a8e_a1e6b8154237.slice/crio-64163433a0ce98db347a0f0a1efbedf9b94dbd9381f0525d7a991d2ad821c193 WatchSource:0}: Error finding container 64163433a0ce98db347a0f0a1efbedf9b94dbd9381f0525d7a991d2ad821c193: Status 404 returned error can't find the container with id 64163433a0ce98db347a0f0a1efbedf9b94dbd9381f0525d7a991d2ad821c193
Jul 29 01:15:17.489738 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.489639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db"]
Jul 29 01:15:17.494524 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:15:17.494494    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd23a66e_e5b1_4146_8a37_d82f6bf9ebc5.slice/crio-f240579a3b361241644e7b798e5e72b2c6d77e14d3c6188c5d5076705acd46aa WatchSource:0}: Error finding container f240579a3b361241644e7b798e5e72b2c6d77e14d3c6188c5d5076705acd46aa: Status 404 returned error can't find the container with id f240579a3b361241644e7b798e5e72b2c6d77e14d3c6188c5d5076705acd46aa
Jul 29 01:15:17.864558 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.864483    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5579b" event={"ID":"e0b4baf1-4be3-47ec-b35d-d8b2906fea97","Type":"ContainerStarted","Data":"3281a1e79948b7ba92db2b83ea4dd0108cf2f7102a61ada930e6cc948efafffb"}
Jul 29 01:15:17.866998 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.866969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w6266" event={"ID":"515d5fad-7061-41fd-b0b9-c04e9a68205a","Type":"ContainerStarted","Data":"8e09c4e2affbbb98201b4cab0bebf8e79f9ce759f7133ee9b56c8ecc8023c79f"}
Jul 29 01:15:17.867118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.867018    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w6266" event={"ID":"515d5fad-7061-41fd-b0b9-c04e9a68205a","Type":"ContainerStarted","Data":"9b5baa3353ca061f777f24652ac6926dbaba4dae9f967612a1529867f2274891"}
Jul 29 01:15:17.867694 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.867658    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w6266"
Jul 29 01:15:17.869213 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.869154    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqffm" event={"ID":"1568b0ae-58b5-452f-8a8e-a1e6b8154237","Type":"ContainerStarted","Data":"64163433a0ce98db347a0f0a1efbedf9b94dbd9381f0525d7a991d2ad821c193"}
Jul 29 01:15:17.870537 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.870513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db" event={"ID":"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5","Type":"ContainerStarted","Data":"f240579a3b361241644e7b798e5e72b2c6d77e14d3c6188c5d5076705acd46aa"}
Jul 29 01:15:17.883377 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:17.883332    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w6266" podStartSLOduration=254.221728473 podStartE2EDuration="4m17.883297326s" totalImagesPullingTime="3.661568853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:11:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:17.882581072 +0000 UTC m=+294.521677880" watchObservedRunningTime="2026-07-29 01:15:17.883297326 +0000 UTC m=+294.522394136"
Jul 29 01:15:19.881524 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:19.881488    2565 generic.go:356] "Generic (PLEG): container finished" podID="1568b0ae-58b5-452f-8a8e-a1e6b8154237" containerID="96554ca3a0a964065f6450e44d9e8eddd86db693451640099f09205ec04106a2" exitCode=0
Jul 29 01:15:19.881914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:19.881539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqffm" event={"ID":"1568b0ae-58b5-452f-8a8e-a1e6b8154237","Type":"ContainerDied","Data":"96554ca3a0a964065f6450e44d9e8eddd86db693451640099f09205ec04106a2"}
Jul 29 01:15:19.884611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:19.884507    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db" event={"ID":"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5","Type":"ContainerStarted","Data":"941cf4a2523e6bdc13d91ddc99b5da042eb32d72689e0f2735ea65b95bf3dcaa"}
Jul 29 01:15:19.884611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:19.884560    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db" event={"ID":"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5","Type":"ContainerStarted","Data":"92aeeb7fe101eb16d252eaa0edc52b45abca18b3558446ebf43d9ebc6250b0c2"}
Jul 29 01:15:19.884611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:19.884584    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db" event={"ID":"cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5","Type":"ContainerStarted","Data":"5333d7bdca97ecf00050c8b67097bb8e78b069a45c1d4a970ced2558efc2dccb"}
Jul 29 01:15:19.916712 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:19.916666    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-pt7db" podStartSLOduration=2.538800252 podStartE2EDuration="3.916653007s" totalImagesPullingTime="1.377852755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:19.915954031 +0000 UTC m=+296.555050855" watchObservedRunningTime="2026-07-29 01:15:19.916653007 +0000 UTC m=+296.555749814"
Jul 29 01:15:20.889578 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:20.889539    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5579b" event={"ID":"e0b4baf1-4be3-47ec-b35d-d8b2906fea97","Type":"ContainerStarted","Data":"7e771b5103a303f4b943c85c00248a43fc5a0f06c80bf453e8649f97b2932a69"}
Jul 29 01:15:20.891541 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:20.891513    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqffm" event={"ID":"1568b0ae-58b5-452f-8a8e-a1e6b8154237","Type":"ContainerStarted","Data":"6ceb71d6073ac75a3135de3aa72f524dbabc09ad2294c8193e8842e3d362133d"}
Jul 29 01:15:20.908846 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:20.908716    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5579b" podStartSLOduration=32.752479473 podStartE2EDuration="44.908702368s" totalImagesPullingTime="12.156222895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 01:14:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:20.907261895 +0000 UTC m=+297.546358703" watchObservedRunningTime="2026-07-29 01:15:20.908702368 +0000 UTC m=+297.547799175"
Jul 29 01:15:21.079767 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.079697    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"]
Jul 29 01:15:21.081954 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.081937    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:21.084158 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.084137    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 29 01:15:21.084261 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.084172    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-f8wzg\""
Jul 29 01:15:21.091786 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.091765    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"]
Jul 29 01:15:21.231889 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.231862    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tc8qt\" (UniqueName: \"kubernetes.io/projected/c80277b8-582e-46e5-9e10-2cfe9c5af9f6-kube-api-access-tc8qt\") pod \"monitoring-plugin-68b7fc9574-x42kl\" (UID: \"c80277b8-582e-46e5-9e10-2cfe9c5af9f6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:21.231975 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.231913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c80277b8-582e-46e5-9e10-2cfe9c5af9f6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-x42kl\" (UID: \"c80277b8-582e-46e5-9e10-2cfe9c5af9f6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:21.332273 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.332215    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c80277b8-582e-46e5-9e10-2cfe9c5af9f6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-x42kl\" (UID: \"c80277b8-582e-46e5-9e10-2cfe9c5af9f6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:21.332377 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.332281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tc8qt\" (UniqueName: \"kubernetes.io/projected/c80277b8-582e-46e5-9e10-2cfe9c5af9f6-kube-api-access-tc8qt\") pod \"monitoring-plugin-68b7fc9574-x42kl\" (UID: \"c80277b8-582e-46e5-9e10-2cfe9c5af9f6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:21.334643 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.334618    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c80277b8-582e-46e5-9e10-2cfe9c5af9f6-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-x42kl\" (UID: \"c80277b8-582e-46e5-9e10-2cfe9c5af9f6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:21.340366 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.340348    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tc8qt\" (UniqueName: \"kubernetes.io/projected/c80277b8-582e-46e5-9e10-2cfe9c5af9f6-kube-api-access-tc8qt\") pod \"monitoring-plugin-68b7fc9574-x42kl\" (UID: \"c80277b8-582e-46e5-9e10-2cfe9c5af9f6\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:21.391122 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.391105    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:21.511801 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.511774    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"]
Jul 29 01:15:21.514526 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:15:21.514502    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc80277b8_582e_46e5_9e10_2cfe9c5af9f6.slice/crio-1ae7d9f5ebbd037047ddd939e5e57f197677380e6a5c220354e0ee5f3eb0ee97 WatchSource:0}: Error finding container 1ae7d9f5ebbd037047ddd939e5e57f197677380e6a5c220354e0ee5f3eb0ee97: Status 404 returned error can't find the container with id 1ae7d9f5ebbd037047ddd939e5e57f197677380e6a5c220354e0ee5f3eb0ee97
Jul 29 01:15:21.896977 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.896935    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqffm" event={"ID":"1568b0ae-58b5-452f-8a8e-a1e6b8154237","Type":"ContainerStarted","Data":"4a8367f00abfd0d894d17dcdcd87fd227f189964f8b28843f99fa330ff553ba1"}
Jul 29 01:15:21.898062 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.898042    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl" event={"ID":"c80277b8-582e-46e5-9e10-2cfe9c5af9f6","Type":"ContainerStarted","Data":"1ae7d9f5ebbd037047ddd939e5e57f197677380e6a5c220354e0ee5f3eb0ee97"}
Jul 29 01:15:21.911336 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:15:21.911301    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tjfzp" podUID="a8df54e0-7ee3-4299-bbd5-0be15e4026d6"
Jul 29 01:15:21.925075 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:21.925036    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vqffm" podStartSLOduration=4.738468698 podStartE2EDuration="5.925022262s" totalImagesPullingTime="1.097896096s" totalInitContainerRuntime="88.657468ms" isStatefulPod=true podCreationTimestamp="2026-07-29 01:15:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:21.923450652 +0000 UTC m=+298.562547471" watchObservedRunningTime="2026-07-29 01:15:21.925022262 +0000 UTC m=+298.564119070"
Jul 29 01:15:22.584735 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.584703    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:22.587695 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.587673    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.590511 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.590371    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 01:15:22.590511 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.590371    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 01:15:22.590511 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.590428    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 01:15:22.590511 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.590455    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 01:15:22.591046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.591022    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 01:15:22.591111 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.591023    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 01:15:22.591155 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.591025    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 01:15:22.591215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.591032    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 01:15:22.591215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.591055    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 01:15:22.591530 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.591507    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6k7lh\""
Jul 29 01:15:22.591634 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.591558    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 01:15:22.592045 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.592024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 01:15:22.592166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.592150    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 01:15:22.592363 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.592349    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 01:15:22.592444 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.592410    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7o3rmhvtdvhv0\""
Jul 29 01:15:22.592501 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.592489    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 01:15:22.593763 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.593717    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 01:15:22.615849 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.615504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:22.745260 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745233    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745260 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745510 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745335    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745510 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745510 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x98fg\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-kube-api-access-x98fg\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745510 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745426    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745510 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745510 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745475    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745510 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745720 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745522    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745720 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-config\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745720 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745612    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745720 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745637    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745720 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745720 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745967 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745967 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745967 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745797    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745967 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745871    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.745967 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.745914    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.791454 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.791430    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:15:22.846530 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846508    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.846636 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.846636 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846576    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.846636 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.846765 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.846765 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.846853 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846777    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.846853 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.846853 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.846992 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.846876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847149    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847297    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847476    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847496    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847514    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847539    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847571    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x98fg\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-kube-api-access-x98fg\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847628    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847662    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847703    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847769    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847784    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847792    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.847835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-config\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.849007    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.850587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.850450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.851834 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.850730    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.851834 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.851520    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-web-config\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.852281 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.852259    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.852456 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.852329    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.852630 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.852607    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-config\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.853158 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.853136    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.853268 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.853156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.853449 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.853423    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.853946 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.853915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.854042 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.853988    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.854089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.854074    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-config-out\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.855789 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.855773    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x98fg\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-kube-api-access-x98fg\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.855836 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.855790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:22.899610 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:22.899593    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:23.029007 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.028976    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:15:23.032386 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:15:23.032362    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8797895_7e9e_44b9_8656_7b1516265819.slice/crio-2a402848eadd4f3500e7e64b7324b6da9778e1d3dc6bc3ce19a088ce5cb4086f WatchSource:0}: Error finding container 2a402848eadd4f3500e7e64b7324b6da9778e1d3dc6bc3ce19a088ce5cb4086f: Status 404 returned error can't find the container with id 2a402848eadd4f3500e7e64b7324b6da9778e1d3dc6bc3ce19a088ce5cb4086f
Jul 29 01:15:23.925094 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.917509    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerStarted","Data":"2a402848eadd4f3500e7e64b7324b6da9778e1d3dc6bc3ce19a088ce5cb4086f"}
Jul 29 01:15:23.925094 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.917581    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl" event={"ID":"c80277b8-582e-46e5-9e10-2cfe9c5af9f6","Type":"ContainerStarted","Data":"903817ae6b2b0c905702f3fa655e432b9f582a419faf4b48b29a5fe0d1b0b0fe"}
Jul 29 01:15:23.925094 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.917608    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:23.925094 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.918690    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:15:23.925094 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.918871    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:15:23.925094 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.921399    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl"
Jul 29 01:15:23.927236 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.927213    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:15:23.927500 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.927484    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:15:23.930766 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.930718    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-x42kl" podStartSLOduration=1.611713687 podStartE2EDuration="2.930700466s" totalImagesPullingTime="1.318986779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:23.929028633 +0000 UTC m=+300.568125456" watchObservedRunningTime="2026-07-29 01:15:23.930700466 +0000 UTC m=+300.569797275"
Jul 29 01:15:23.931417 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:23.931404    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 01:15:24.803918 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:24.803890    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-798f887b5c-x5p7q"
Jul 29 01:15:24.919150 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:24.919116    2565 generic.go:356] "Generic (PLEG): container finished" podID="a8797895-7e9e-44b9-8656-7b1516265819" containerID="156e7466141a175bc2ff493d64b182aaba087b79c158191a564c98fa145a3af4" exitCode=0
Jul 29 01:15:24.919292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:24.919209    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerDied","Data":"156e7466141a175bc2ff493d64b182aaba087b79c158191a564c98fa145a3af4"}
Jul 29 01:15:24.920366 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:24.920353    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:15:27.806486 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:27.806425    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7db9444c44-6prgm" podUID="0f514c21-dc80-4dbf-9198-dff7170b80de" containerName="registry" containerID="cri-o://6aea6dfee7e425ccade19b4364baa75c7ad278c48c3ac63d5325dbb5893f281e" gracePeriod=30
Jul 29 01:15:27.910648 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:27.910621    2565 scope.go:117] "RemoveContainer" containerID="cecbb3870e80b92e29ff87ec32e25227d9156e8499a4379688b0a7adbf6d6672"
Jul 29 01:15:27.934078 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:27.934048    2565 generic.go:356] "Generic (PLEG): container finished" podID="0f514c21-dc80-4dbf-9198-dff7170b80de" containerID="6aea6dfee7e425ccade19b4364baa75c7ad278c48c3ac63d5325dbb5893f281e" exitCode=0
Jul 29 01:15:27.934193 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:27.934118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db9444c44-6prgm" event={"ID":"0f514c21-dc80-4dbf-9198-dff7170b80de","Type":"ContainerDied","Data":"6aea6dfee7e425ccade19b4364baa75c7ad278c48c3ac63d5325dbb5893f281e"}
Jul 29 01:15:28.053391 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.053367    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:15:28.086925 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.086834    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-installation-pull-secrets\") pod \"0f514c21-dc80-4dbf-9198-dff7170b80de\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") "
Jul 29 01:15:28.087161 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.087141    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f514c21-dc80-4dbf-9198-dff7170b80de-ca-trust-extracted\") pod \"0f514c21-dc80-4dbf-9198-dff7170b80de\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") "
Jul 29 01:15:28.087327 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.087291    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-bound-sa-token\") pod \"0f514c21-dc80-4dbf-9198-dff7170b80de\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") "
Jul 29 01:15:28.087473 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.087459    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-trusted-ca\") pod \"0f514c21-dc80-4dbf-9198-dff7170b80de\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") "
Jul 29 01:15:28.087599 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.087585    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5shn\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-kube-api-access-n5shn\") pod \"0f514c21-dc80-4dbf-9198-dff7170b80de\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") "
Jul 29 01:15:28.087711 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.087698    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") pod \"0f514c21-dc80-4dbf-9198-dff7170b80de\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") "
Jul 29 01:15:28.087825 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.087812    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-certificates\") pod \"0f514c21-dc80-4dbf-9198-dff7170b80de\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") "
Jul 29 01:15:28.087956 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.087942    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-image-registry-private-configuration\") pod \"0f514c21-dc80-4dbf-9198-dff7170b80de\" (UID: \"0f514c21-dc80-4dbf-9198-dff7170b80de\") "
Jul 29 01:15:28.089334 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.088938    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "0f514c21-dc80-4dbf-9198-dff7170b80de" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:28.093343 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.093291    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "0f514c21-dc80-4dbf-9198-dff7170b80de" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:28.097325 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.093668    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "0f514c21-dc80-4dbf-9198-dff7170b80de" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:15:28.100351 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.099391    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "0f514c21-dc80-4dbf-9198-dff7170b80de" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:15:28.100919 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.100891    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "0f514c21-dc80-4dbf-9198-dff7170b80de" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:28.102004 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.101970    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "0f514c21-dc80-4dbf-9198-dff7170b80de" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:28.102004 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.101993    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-kube-api-access-n5shn" (OuterVolumeSpecName: "kube-api-access-n5shn") pod "0f514c21-dc80-4dbf-9198-dff7170b80de" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de"). InnerVolumeSpecName "kube-api-access-n5shn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:15:28.107373 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.107081    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f514c21-dc80-4dbf-9198-dff7170b80de-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "0f514c21-dc80-4dbf-9198-dff7170b80de" (UID: "0f514c21-dc80-4dbf-9198-dff7170b80de"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:15:28.189100 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.189071    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5shn\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-kube-api-access-n5shn\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:15:28.189100 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.189100    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:15:28.189100 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.189109    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-registry-certificates\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:15:28.189326 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.189118    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-image-registry-private-configuration\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:15:28.189326 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.189128    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0f514c21-dc80-4dbf-9198-dff7170b80de-installation-pull-secrets\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:15:28.189326 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.189137    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0f514c21-dc80-4dbf-9198-dff7170b80de-ca-trust-extracted\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:15:28.189326 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.189144    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0f514c21-dc80-4dbf-9198-dff7170b80de-bound-sa-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:15:28.189326 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.189153    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0f514c21-dc80-4dbf-9198-dff7170b80de-trusted-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:15:28.886837 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.886812    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w6266"
Jul 29 01:15:28.940972 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.940944    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerStarted","Data":"120a6d2a8cee98da1a3910e71d49427364349b0ff67c8fa60b77279141a59d57"}
Jul 29 01:15:28.941121 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.941020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerStarted","Data":"1955486614f4cf440060d4791b7c7fc611b53cb0b7422169f30e5f271e9fc30a"}
Jul 29 01:15:28.943227 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.943204    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:15:28.943378 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.943295    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" event={"ID":"6a88e7bc-78c9-45de-8b6c-6462af16a7c9","Type":"ContainerStarted","Data":"7d13fb5d5359d057caf39f946515e2d6778a99d53fc51c3aeb5808d4231acc6b"}
Jul 29 01:15:28.943763 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.943743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:15:28.945021 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.945003    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7db9444c44-6prgm"
Jul 29 01:15:28.945128 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.945002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7db9444c44-6prgm" event={"ID":"0f514c21-dc80-4dbf-9198-dff7170b80de","Type":"ContainerDied","Data":"caeefe80b9e3970c93dd89b74ce42a33011b58f6cd194a55aa889f2292cb169e"}
Jul 29 01:15:28.945182 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.945144    2565 scope.go:117] "RemoveContainer" containerID="6aea6dfee7e425ccade19b4364baa75c7ad278c48c3ac63d5325dbb5893f281e"
Jul 29 01:15:28.949489 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.949445    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-h567k"
Jul 29 01:15:28.964058 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.964008    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-h567k" podStartSLOduration=56.081660956 podStartE2EDuration="57.963988135s" totalImagesPullingTime="1.882327179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:28.961944646 +0000 UTC m=+305.601041546" watchObservedRunningTime="2026-07-29 01:15:28.963988135 +0000 UTC m=+305.603084943"
Jul 29 01:15:28.996130 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:28.996102    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7db9444c44-6prgm"]
Jul 29 01:15:29.001604 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:29.001578    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7db9444c44-6prgm"]
Jul 29 01:15:29.915703 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:29.915676    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f514c21-dc80-4dbf-9198-dff7170b80de" path="/var/lib/kubelet/pods/0f514c21-dc80-4dbf-9198-dff7170b80de/volumes"
Jul 29 01:15:29.951254 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:29.951183    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerStarted","Data":"0d504dadf6a4815e4bafe5b093e3b162e3f400f8433a66034b67b917c18313f2"}
Jul 29 01:15:29.951409 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:29.951257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerStarted","Data":"83b06c5b0c811833c668c4285784711e1254ca157ac1887ca6aec417dda7985c"}
Jul 29 01:15:29.951409 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:29.951333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerStarted","Data":"fff0968b3f831bf9f160c8f9072b7fd33ce45d589d698f05299318100a8ede65"}
Jul 29 01:15:29.951409 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:29.951372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerStarted","Data":"614fbc766708dc1cb16ab15fb0019b0d5f57c6570f3cf5877996b01a694bdc6c"}
Jul 29 01:15:29.983907 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:29.983850    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.542401946 podStartE2EDuration="7.983829793s" totalImagesPullingTime="5.42410264s" totalInitContainerRuntime="17.325207ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:15:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:15:29.982432204 +0000 UTC m=+306.621529011" watchObservedRunningTime="2026-07-29 01:15:29.983829793 +0000 UTC m=+306.622926602"
Jul 29 01:15:32.899788 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:32.899756    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:15:34.910910 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:34.910881    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:15:56.105595 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:15:56.105558    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbsln_07cd5f44-2d82-43e8-9672-6f9c02e885fa/serve-healthcheck-canary/0.log"
Jul 29 01:16:22.900562 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:22.900482    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:22.920095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:22.920071    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:23.163295 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:23.163226    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:37.698719 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:37.698684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:16:37.700963 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:37.700943    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a8df54e0-7ee3-4299-bbd5-0be15e4026d6-metrics-certs\") pod \"network-metrics-daemon-tjfzp\" (UID: \"a8df54e0-7ee3-4299-bbd5-0be15e4026d6\") " pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:16:37.913965 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:37.913935    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-llbnf\""
Jul 29 01:16:37.922625 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:37.922598    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tjfzp"
Jul 29 01:16:38.053047 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:38.053018    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tjfzp"]
Jul 29 01:16:38.055961 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:16:38.055928    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8df54e0_7ee3_4299_bbd5_0be15e4026d6.slice/crio-a39a97170f18f8e0b978cdb371c15c275dcadf38a2bc2f5670a16b49aaec2356 WatchSource:0}: Error finding container a39a97170f18f8e0b978cdb371c15c275dcadf38a2bc2f5670a16b49aaec2356: Status 404 returned error can't find the container with id a39a97170f18f8e0b978cdb371c15c275dcadf38a2bc2f5670a16b49aaec2356
Jul 29 01:16:38.201191 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:38.201157    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tjfzp" event={"ID":"a8df54e0-7ee3-4299-bbd5-0be15e4026d6","Type":"ContainerStarted","Data":"a39a97170f18f8e0b978cdb371c15c275dcadf38a2bc2f5670a16b49aaec2356"}
Jul 29 01:16:39.205924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:39.205852    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tjfzp" event={"ID":"a8df54e0-7ee3-4299-bbd5-0be15e4026d6","Type":"ContainerStarted","Data":"56e416bba9893639320d19245a6862f6dff793b72b48346824fd3e5a59316d0a"}
Jul 29 01:16:39.205924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:39.205901    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tjfzp" event={"ID":"a8df54e0-7ee3-4299-bbd5-0be15e4026d6","Type":"ContainerStarted","Data":"21695490582c54674e8d009ce0493871e9f835be3987e80214e341991732319b"}
Jul 29 01:16:39.222790 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:39.222733    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tjfzp" podStartSLOduration=374.406286189 podStartE2EDuration="6m15.222716848s" totalImagesPullingTime="816.430659ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:10:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:16:39.221095758 +0000 UTC m=+375.860192567" watchObservedRunningTime="2026-07-29 01:16:39.222716848 +0000 UTC m=+375.861813655"
Jul 29 01:16:41.013549 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.013518    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:16:41.013955 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.013798    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="prometheus" containerID="cri-o://1955486614f4cf440060d4791b7c7fc611b53cb0b7422169f30e5f271e9fc30a" gracePeriod=600
Jul 29 01:16:41.013955 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.013808    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy" containerID="cri-o://83b06c5b0c811833c668c4285784711e1254ca157ac1887ca6aec417dda7985c" gracePeriod=600
Jul 29 01:16:41.013955 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.013852    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="thanos-sidecar" containerID="cri-o://614fbc766708dc1cb16ab15fb0019b0d5f57c6570f3cf5877996b01a694bdc6c" gracePeriod=600
Jul 29 01:16:41.013955 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.013869    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy-web" containerID="cri-o://fff0968b3f831bf9f160c8f9072b7fd33ce45d589d698f05299318100a8ede65" gracePeriod=600
Jul 29 01:16:41.013955 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.013882    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0d504dadf6a4815e4bafe5b093e3b162e3f400f8433a66034b67b917c18313f2" gracePeriod=600
Jul 29 01:16:41.013955 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.013858    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="config-reloader" containerID="cri-o://120a6d2a8cee98da1a3910e71d49427364349b0ff67c8fa60b77279141a59d57" gracePeriod=600
Jul 29 01:16:41.217601 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217558    2565 generic.go:356] "Generic (PLEG): container finished" podID="a8797895-7e9e-44b9-8656-7b1516265819" containerID="0d504dadf6a4815e4bafe5b093e3b162e3f400f8433a66034b67b917c18313f2" exitCode=0
Jul 29 01:16:41.217601 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217582    2565 generic.go:356] "Generic (PLEG): container finished" podID="a8797895-7e9e-44b9-8656-7b1516265819" containerID="83b06c5b0c811833c668c4285784711e1254ca157ac1887ca6aec417dda7985c" exitCode=0
Jul 29 01:16:41.217601 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217589    2565 generic.go:356] "Generic (PLEG): container finished" podID="a8797895-7e9e-44b9-8656-7b1516265819" containerID="fff0968b3f831bf9f160c8f9072b7fd33ce45d589d698f05299318100a8ede65" exitCode=0
Jul 29 01:16:41.217601 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217604    2565 generic.go:356] "Generic (PLEG): container finished" podID="a8797895-7e9e-44b9-8656-7b1516265819" containerID="614fbc766708dc1cb16ab15fb0019b0d5f57c6570f3cf5877996b01a694bdc6c" exitCode=0
Jul 29 01:16:41.217807 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217610    2565 generic.go:356] "Generic (PLEG): container finished" podID="a8797895-7e9e-44b9-8656-7b1516265819" containerID="120a6d2a8cee98da1a3910e71d49427364349b0ff67c8fa60b77279141a59d57" exitCode=0
Jul 29 01:16:41.217807 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217615    2565 generic.go:356] "Generic (PLEG): container finished" podID="a8797895-7e9e-44b9-8656-7b1516265819" containerID="1955486614f4cf440060d4791b7c7fc611b53cb0b7422169f30e5f271e9fc30a" exitCode=0
Jul 29 01:16:41.217807 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerDied","Data":"0d504dadf6a4815e4bafe5b093e3b162e3f400f8433a66034b67b917c18313f2"}
Jul 29 01:16:41.217807 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217726    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerDied","Data":"83b06c5b0c811833c668c4285784711e1254ca157ac1887ca6aec417dda7985c"}
Jul 29 01:16:41.217807 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerDied","Data":"fff0968b3f831bf9f160c8f9072b7fd33ce45d589d698f05299318100a8ede65"}
Jul 29 01:16:41.217995 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217809    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerDied","Data":"614fbc766708dc1cb16ab15fb0019b0d5f57c6570f3cf5877996b01a694bdc6c"}
Jul 29 01:16:41.217995 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217846    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerDied","Data":"120a6d2a8cee98da1a3910e71d49427364349b0ff67c8fa60b77279141a59d57"}
Jul 29 01:16:41.217995 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.217884    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerDied","Data":"1955486614f4cf440060d4791b7c7fc611b53cb0b7422169f30e5f271e9fc30a"}
Jul 29 01:16:41.250369 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.250351    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:41.427947 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.427879    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-2\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.427947 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.427912    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-serving-certs-ca-bundle\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.427947 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.427930    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-kubelet-serving-ca-bundle\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.428197 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.427955    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-tls-assets\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.428197 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.427977    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-metrics-client-certs\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.428197 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428001    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-tls\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.428197 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428034    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-trusted-ca-bundle\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.428197 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428059    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-grpc-tls\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.428197 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428086    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-metrics-client-ca\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.428197 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428108    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-kube-rbac-proxy\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.428633 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428440    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:41.428848 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428811    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:41.428934 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428870    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:41.428986 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428941    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.428986 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428819    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:41.428986 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.428975    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-web-config\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.429768 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.429527    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:41.431517 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431481    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:41.431623 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431545    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:41.431623 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:41.431623 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431568    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:16:41.431764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431675    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-db\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.431764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431715    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-thanos-prometheus-http-client-file\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.431764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431755    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-config\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.432008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431794    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.432008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431818    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-1\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.432008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431859    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-0\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.432008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431923    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-config-out\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.432008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.431989    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x98fg\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-kube-api-access-x98fg\") pod \"a8797895-7e9e-44b9-8656-7b1516265819\" (UID: \"a8797895-7e9e-44b9-8656-7b1516265819\") "
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.432563    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.432872    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433003    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433020    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-grpc-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433035    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-metrics-client-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433053    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-kube-rbac-proxy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433066    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433079    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433092    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433110    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433122    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-tls-assets\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433135    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-metrics-client-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433149    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.433443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.433145    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:16:41.436344 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.434459    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:41.436344 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.435229    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:16:41.436344 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.435499    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-kube-api-access-x98fg" (OuterVolumeSpecName: "kube-api-access-x98fg") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "kube-api-access-x98fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:16:41.436344 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.435738    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-config" (OuterVolumeSpecName: "config") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:41.436677 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.436581    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:41.438513 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.438488    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:41.439330 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.439292    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-config-out" (OuterVolumeSpecName: "config-out") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:16:41.444653 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.444634    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-web-config" (OuterVolumeSpecName: "web-config") pod "a8797895-7e9e-44b9-8656-7b1516265819" (UID: "a8797895-7e9e-44b9-8656-7b1516265819"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:16:41.533977 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.533953    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.533977 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.533976    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-config-out\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.534084 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.533985    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x98fg\" (UniqueName: \"kubernetes.io/projected/a8797895-7e9e-44b9-8656-7b1516265819-kube-api-access-x98fg\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.534084 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.533994    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.534084 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.534003    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-web-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.534084 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.534010    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a8797895-7e9e-44b9-8656-7b1516265819-prometheus-k8s-db\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.534084 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.534017    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.534084 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.534026    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-config\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:41.534084 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:41.534033    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a8797895-7e9e-44b9-8656-7b1516265819-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:16:42.223938 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.223869    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a8797895-7e9e-44b9-8656-7b1516265819","Type":"ContainerDied","Data":"2a402848eadd4f3500e7e64b7324b6da9778e1d3dc6bc3ce19a088ce5cb4086f"}
Jul 29 01:16:42.223938 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.223933    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.224360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.223947    2565 scope.go:117] "RemoveContainer" containerID="0d504dadf6a4815e4bafe5b093e3b162e3f400f8433a66034b67b917c18313f2"
Jul 29 01:16:42.231787 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.231765    2565 scope.go:117] "RemoveContainer" containerID="83b06c5b0c811833c668c4285784711e1254ca157ac1887ca6aec417dda7985c"
Jul 29 01:16:42.238073 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.238058    2565 scope.go:117] "RemoveContainer" containerID="fff0968b3f831bf9f160c8f9072b7fd33ce45d589d698f05299318100a8ede65"
Jul 29 01:16:42.244732 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.244712    2565 scope.go:117] "RemoveContainer" containerID="614fbc766708dc1cb16ab15fb0019b0d5f57c6570f3cf5877996b01a694bdc6c"
Jul 29 01:16:42.245370 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.245350    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:16:42.251104 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.251061    2565 scope.go:117] "RemoveContainer" containerID="120a6d2a8cee98da1a3910e71d49427364349b0ff67c8fa60b77279141a59d57"
Jul 29 01:16:42.252960 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.252944    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:16:42.257844 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.257825    2565 scope.go:117] "RemoveContainer" containerID="1955486614f4cf440060d4791b7c7fc611b53cb0b7422169f30e5f271e9fc30a"
Jul 29 01:16:42.264407 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.264381    2565 scope.go:117] "RemoveContainer" containerID="156e7466141a175bc2ff493d64b182aaba087b79c158191a564c98fa145a3af4"
Jul 29 01:16:42.278101 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278083    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:16:42.278352 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278340    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="prometheus"
Jul 29 01:16:42.278390 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278354    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="prometheus"
Jul 29 01:16:42.278390 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278365    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy-thanos"
Jul 29 01:16:42.278390 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278370    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy-thanos"
Jul 29 01:16:42.278390 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278377    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy-web"
Jul 29 01:16:42.278390 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278382    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy-web"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278391    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="config-reloader"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278399    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="config-reloader"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278409    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="thanos-sidecar"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278415    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="thanos-sidecar"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278422    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="init-config-reloader"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278426    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="init-config-reloader"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278433    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f514c21-dc80-4dbf-9198-dff7170b80de" containerName="registry"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278437    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f514c21-dc80-4dbf-9198-dff7170b80de" containerName="registry"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278448    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278452    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278501    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="prometheus"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278508    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="config-reloader"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278514    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="thanos-sidecar"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278521    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy-web"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278526    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278531    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8797895-7e9e-44b9-8656-7b1516265819" containerName="kube-rbac-proxy-thanos"
Jul 29 01:16:42.278529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.278536    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f514c21-dc80-4dbf-9198-dff7170b80de" containerName="registry"
Jul 29 01:16:42.282664 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.282650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.284905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.284889    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 29 01:16:42.285161 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285144    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 29 01:16:42.285251 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285167    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 29 01:16:42.285251 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285200    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6k7lh\""
Jul 29 01:16:42.285431 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285144    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 29 01:16:42.285431 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285266    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 29 01:16:42.285600 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285573    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 29 01:16:42.285669 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285616    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 29 01:16:42.285669 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285621    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 29 01:16:42.285770 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285740    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7o3rmhvtdvhv0\""
Jul 29 01:16:42.285841 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285825    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 29 01:16:42.285892 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285855    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 29 01:16:42.285941 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.285930    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 29 01:16:42.286040 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.286024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 29 01:16:42.286481 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.286465    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 29 01:16:42.288356 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.288300    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 29 01:16:42.290618 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.290601    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 29 01:16:42.296156 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.296137    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:16:42.439610 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439580    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-config\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.439610 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439616    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.439810 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f221889-79d3-496c-845c-310df60244a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.439810 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.439810 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439681    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f221889-79d3-496c-845c-310df60244a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.439810 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439696    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.439810 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439709    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.439810 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.439810 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2pk9\" (UniqueName: \"kubernetes.io/projected/6f221889-79d3-496c-845c-310df60244a0-kube-api-access-w2pk9\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440001 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440001 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440001 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439872    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440001 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439886    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440001 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439905    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440001 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440001 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.439991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440202 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.440005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440202 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.440021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440202 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.440037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.440202 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.440054    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.540400 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540381    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.540501 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540409    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.540501 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.540501 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540451    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.540501 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.540677 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.540677 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-config\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.540938 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541009 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540969    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f221889-79d3-496c-845c-310df60244a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541009 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.540993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541099 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541032    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f221889-79d3-496c-845c-310df60244a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541099 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541054    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541099 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541239 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541104    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541239 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2pk9\" (UniqueName: \"kubernetes.io/projected/6f221889-79d3-496c-845c-310df60244a0-kube-api-access-w2pk9\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541239 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541178    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541239 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541200    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541239 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541218    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541504 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541239    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541504 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541268    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541504 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541362    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541504 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541385    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.541962 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.541935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.542139 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.542113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.542960 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.542932    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.543882 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.543849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.544066 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.544044    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-config\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.544703 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.544604    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.545429 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.544834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.545429 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.544922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6f221889-79d3-496c-845c-310df60244a0-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.545429 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.545289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.545429 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.545389    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.545695 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.545676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.545767 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.545752    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f221889-79d3-496c-845c-310df60244a0-config-out\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.545958 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.545935    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.546052 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.546028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.546735 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.546717    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f221889-79d3-496c-845c-310df60244a0-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.546991 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.546977    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-web-config\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.547063 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.547039    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6f221889-79d3-496c-845c-310df60244a0-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.551650 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.551628    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2pk9\" (UniqueName: \"kubernetes.io/projected/6f221889-79d3-496c-845c-310df60244a0-kube-api-access-w2pk9\") pod \"prometheus-k8s-0\" (UID: \"6f221889-79d3-496c-845c-310df60244a0\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.592616 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.592590    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:16:42.728858 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:42.728823    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 29 01:16:42.730833 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:16:42.730808    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f221889_79d3_496c_845c_310df60244a0.slice/crio-6047c1eaff3ff519b0f0610a76f644342923874402ac0fa61f1b81930fcf4691 WatchSource:0}: Error finding container 6047c1eaff3ff519b0f0610a76f644342923874402ac0fa61f1b81930fcf4691: Status 404 returned error can't find the container with id 6047c1eaff3ff519b0f0610a76f644342923874402ac0fa61f1b81930fcf4691
Jul 29 01:16:43.229762 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:43.229689    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f221889-79d3-496c-845c-310df60244a0" containerID="3a9a728e4bc5f7edf1e85af12f7e180a6cb95ad677f7eb6f402dbdd4dd7c25fc" exitCode=0
Jul 29 01:16:43.229762 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:43.229721    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f221889-79d3-496c-845c-310df60244a0","Type":"ContainerDied","Data":"3a9a728e4bc5f7edf1e85af12f7e180a6cb95ad677f7eb6f402dbdd4dd7c25fc"}
Jul 29 01:16:43.230136 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:43.229769    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f221889-79d3-496c-845c-310df60244a0","Type":"ContainerStarted","Data":"6047c1eaff3ff519b0f0610a76f644342923874402ac0fa61f1b81930fcf4691"}
Jul 29 01:16:43.915668 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:43.915635    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8797895-7e9e-44b9-8656-7b1516265819" path="/var/lib/kubelet/pods/a8797895-7e9e-44b9-8656-7b1516265819/volumes"
Jul 29 01:16:44.236316 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:44.236232    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f221889-79d3-496c-845c-310df60244a0","Type":"ContainerStarted","Data":"77bfffb6fc8bf82aec438180ada46e83f9d61846b0213b396e0be18fc837bbb3"}
Jul 29 01:16:44.236316 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:44.236288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f221889-79d3-496c-845c-310df60244a0","Type":"ContainerStarted","Data":"9fa7b516c4a209a282fcd89fc7de915f351d7f95cc06d9419e13c3d62361c26b"}
Jul 29 01:16:44.236672 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:44.236342    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f221889-79d3-496c-845c-310df60244a0","Type":"ContainerStarted","Data":"a837e062c0031f5c0eb3ead0be866e2ef81df39eb8510f197455b4ea84fe948f"}
Jul 29 01:16:44.236672 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:44.236373    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f221889-79d3-496c-845c-310df60244a0","Type":"ContainerStarted","Data":"584c4605fe07c97e7d71b65621eceb4acc4d6205c24effcb4ac724a9474845d9"}
Jul 29 01:16:44.236672 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:44.236397    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f221889-79d3-496c-845c-310df60244a0","Type":"ContainerStarted","Data":"9f610696d0beadeedaaab13377f97f4afb654c9a1667b9dd186d2da2a7ff5316"}
Jul 29 01:16:44.236672 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:44.236418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6f221889-79d3-496c-845c-310df60244a0","Type":"ContainerStarted","Data":"d52f60492e3c16ae204370e31d331e4097c2351b154e39de9916658acdb075e7"}
Jul 29 01:16:44.266785 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:44.266701    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.25009752 podStartE2EDuration="2.266680147s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.582627ms" isStatefulPod=false podCreationTimestamp="2026-07-29 01:16:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:16:44.26515828 +0000 UTC m=+380.904255090" watchObservedRunningTime="2026-07-29 01:16:44.266680147 +0000 UTC m=+380.905776958"
Jul 29 01:16:47.593296 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:16:47.593258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:17:42.593065 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:17:42.593024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:17:42.608756 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:17:42.608728    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:17:43.463049 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:17:43.463020    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 29 01:19:37.151973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.151896    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"]
Jul 29 01:19:37.154139 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.154120    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"
Jul 29 01:19:37.156547 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.156526    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-9tjlt\""
Jul 29 01:19:37.156637 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.156529    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 01:19:37.157025 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.157006    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 01:19:37.165180 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.165160    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"]
Jul 29 01:19:37.315470 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.315434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrsnx\" (UniqueName: \"kubernetes.io/projected/6aad3f7b-9862-43d0-a64b-b88a9c78b151-kube-api-access-lrsnx\") pod \"openshift-lws-operator-fd8ccff4c-jnmwm\" (UID: \"6aad3f7b-9862-43d0-a64b-b88a9c78b151\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"
Jul 29 01:19:37.315605 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.315499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aad3f7b-9862-43d0-a64b-b88a9c78b151-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jnmwm\" (UID: \"6aad3f7b-9862-43d0-a64b-b88a9c78b151\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"
Jul 29 01:19:37.416611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.416550    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aad3f7b-9862-43d0-a64b-b88a9c78b151-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jnmwm\" (UID: \"6aad3f7b-9862-43d0-a64b-b88a9c78b151\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"
Jul 29 01:19:37.416611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.416599    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrsnx\" (UniqueName: \"kubernetes.io/projected/6aad3f7b-9862-43d0-a64b-b88a9c78b151-kube-api-access-lrsnx\") pod \"openshift-lws-operator-fd8ccff4c-jnmwm\" (UID: \"6aad3f7b-9862-43d0-a64b-b88a9c78b151\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"
Jul 29 01:19:37.416908 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.416890    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6aad3f7b-9862-43d0-a64b-b88a9c78b151-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jnmwm\" (UID: \"6aad3f7b-9862-43d0-a64b-b88a9c78b151\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"
Jul 29 01:19:37.425094 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.425066    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrsnx\" (UniqueName: \"kubernetes.io/projected/6aad3f7b-9862-43d0-a64b-b88a9c78b151-kube-api-access-lrsnx\") pod \"openshift-lws-operator-fd8ccff4c-jnmwm\" (UID: \"6aad3f7b-9862-43d0-a64b-b88a9c78b151\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"
Jul 29 01:19:37.475508 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.475483    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"
Jul 29 01:19:37.606247 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.606226    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm"]
Jul 29 01:19:37.608633 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:19:37.608606    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6aad3f7b_9862_43d0_a64b_b88a9c78b151.slice/crio-3a5275ef5ed02318cea13f8d504ec53eb1907669845b292cce3800e38c089fdc WatchSource:0}: Error finding container 3a5275ef5ed02318cea13f8d504ec53eb1907669845b292cce3800e38c089fdc: Status 404 returned error can't find the container with id 3a5275ef5ed02318cea13f8d504ec53eb1907669845b292cce3800e38c089fdc
Jul 29 01:19:37.862191 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:37.862165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm" event={"ID":"6aad3f7b-9862-43d0-a64b-b88a9c78b151","Type":"ContainerStarted","Data":"3a5275ef5ed02318cea13f8d504ec53eb1907669845b292cce3800e38c089fdc"}
Jul 29 01:19:40.876918 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:40.876887    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm" event={"ID":"6aad3f7b-9862-43d0-a64b-b88a9c78b151","Type":"ContainerStarted","Data":"0168d2cfeee78d06b25ef44c3880ec383ab9e23a0467c2a7b432cf86e448b7a9"}
Jul 29 01:19:40.898393 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:19:40.898345    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jnmwm" podStartSLOduration=1.054917163 podStartE2EDuration="3.89833042s" totalImagesPullingTime="2.843413257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:19:40.896910509 +0000 UTC m=+557.536007318" watchObservedRunningTime="2026-07-29 01:19:40.89833042 +0000 UTC m=+557.537427222"
Jul 29 01:20:08.917106 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:08.912809    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"]
Jul 29 01:20:08.920242 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:08.920217    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:08.923513 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:08.923493    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2h4qb\""
Jul 29 01:20:08.923990 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:08.923968    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 01:20:08.924255 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:08.924235    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 01:20:08.924255 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:08.924243    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 01:20:08.928474 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:08.928456    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 01:20:08.946026 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:08.946006    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"]
Jul 29 01:20:09.044617 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.044585    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34c5d87e-b059-4563-86e7-3909a5205c58-tmp\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.044754 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.044639    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkpfk\" (UniqueName: \"kubernetes.io/projected/34c5d87e-b059-4563-86e7-3909a5205c58-kube-api-access-rkpfk\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.044824 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.044777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34c5d87e-b059-4563-86e7-3909a5205c58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.045244 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.044989    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34c5d87e-b059-4563-86e7-3909a5205c58-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.045244 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.045072    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34c5d87e-b059-4563-86e7-3909a5205c58-manifests\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.146140 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.146111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34c5d87e-b059-4563-86e7-3909a5205c58-manifests\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.146260 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.146157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34c5d87e-b059-4563-86e7-3909a5205c58-tmp\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.146260 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.146180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkpfk\" (UniqueName: \"kubernetes.io/projected/34c5d87e-b059-4563-86e7-3909a5205c58-kube-api-access-rkpfk\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.146260 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.146199    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34c5d87e-b059-4563-86e7-3909a5205c58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.146260 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.146245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34c5d87e-b059-4563-86e7-3909a5205c58-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.146579 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.146557    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/34c5d87e-b059-4563-86e7-3909a5205c58-manifests\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.148592 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.148566    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34c5d87e-b059-4563-86e7-3909a5205c58-tmp\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.148805 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.148787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/34c5d87e-b059-4563-86e7-3909a5205c58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.148862 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.148823    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/34c5d87e-b059-4563-86e7-3909a5205c58-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.154860 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.154836    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkpfk\" (UniqueName: \"kubernetes.io/projected/34c5d87e-b059-4563-86e7-3909a5205c58-kube-api-access-rkpfk\") pod \"opendatahub-operator-controller-manager-857d7cdd4c-cl4ps\" (UID: \"34c5d87e-b059-4563-86e7-3909a5205c58\") " pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.230024 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.229965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:09.369744 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.369717    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"]
Jul 29 01:20:09.370658 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:20:09.370629    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34c5d87e_b059_4563_86e7_3909a5205c58.slice/crio-1827440fae354fd47889976e698fb04b3ebeb920cf32f5a6b59fe525fca68cbb WatchSource:0}: Error finding container 1827440fae354fd47889976e698fb04b3ebeb920cf32f5a6b59fe525fca68cbb: Status 404 returned error can't find the container with id 1827440fae354fd47889976e698fb04b3ebeb920cf32f5a6b59fe525fca68cbb
Jul 29 01:20:09.983631 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:09.983551    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps" event={"ID":"34c5d87e-b059-4563-86e7-3909a5205c58","Type":"ContainerStarted","Data":"1827440fae354fd47889976e698fb04b3ebeb920cf32f5a6b59fe525fca68cbb"}
Jul 29 01:20:13.001674 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:13.000964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps" event={"ID":"34c5d87e-b059-4563-86e7-3909a5205c58","Type":"ContainerStarted","Data":"023c579df07becee8773a24c7902d47faf52bd70b8019da29af5b07cdd987a20"}
Jul 29 01:20:14.011660 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:14.011629    2565 generic.go:356] "Generic (PLEG): container finished" podID="34c5d87e-b059-4563-86e7-3909a5205c58" containerID="023c579df07becee8773a24c7902d47faf52bd70b8019da29af5b07cdd987a20" exitCode=0
Jul 29 01:20:14.012062 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:14.011711    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps" event={"ID":"34c5d87e-b059-4563-86e7-3909a5205c58","Type":"ContainerDied","Data":"023c579df07becee8773a24c7902d47faf52bd70b8019da29af5b07cdd987a20"}
Jul 29 01:20:15.017139 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:15.017102    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps" event={"ID":"34c5d87e-b059-4563-86e7-3909a5205c58","Type":"ContainerStarted","Data":"ac6a9abd04851d603c3c27232e337307a2ee0273c4ec3a9f53dd328704b477a3"}
Jul 29 01:20:15.017508 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:15.017234    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:15.038377 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:15.038332    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps" podStartSLOduration=2.578135999 podStartE2EDuration="7.038295791s" totalImagesPullingTime="3.371524138s" totalInitContainerRuntime="1.088635654s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:15.037595795 +0000 UTC m=+591.676692603" watchObservedRunningTime="2026-07-29 01:20:15.038295791 +0000 UTC m=+591.677392599"
Jul 29 01:20:23.944653 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:23.944564    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:20:23.944653 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:23.944633    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:20:23.965025 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:23.951181    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:20:23.965025 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:23.951558    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:20:26.023833 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:26.023806    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-857d7cdd4c-cl4ps"
Jul 29 01:20:37.075479 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.075439    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"]
Jul 29 01:20:37.077764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.077737    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.079933 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.079909    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 01:20:37.080165 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.080145    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 01:20:37.080358 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.080231    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 01:20:37.080436 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.080374    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zlvjd\""
Jul 29 01:20:37.092093 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.092072    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"]
Jul 29 01:20:37.167652 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.167622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.167832 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.167660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.167832 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.167691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.167832 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.167781    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk22m\" (UniqueName: \"kubernetes.io/projected/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-kube-api-access-jk22m\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.167832 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.167826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.167956 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.167846    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.167956 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.167923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.168016 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.167961    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.168057 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.168039    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.268722 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.268680    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.268914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.268735    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.268914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.268770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.268914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.268808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk22m\" (UniqueName: \"kubernetes.io/projected/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-kube-api-access-jk22m\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.268914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.268856    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.268914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.268882    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.269161 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.268928    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.269161 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.268973    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.269161 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.269035    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.269161 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.269127    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.269417 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.269391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.269576 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.269538    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.269675 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.269592    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.270098 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.270073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.271551 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.271521    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.272258 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.272238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.277100 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.277076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.278149 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.278117    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk22m\" (UniqueName: \"kubernetes.io/projected/6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b-kube-api-access-jk22m\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h\" (UID: \"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.389562 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.389481    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:37.522893 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.522865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"]
Jul 29 01:20:37.525602 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:20:37.525571    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a28a9fa_8b90_4a6d_a9ae_52b6870bdf8b.slice/crio-28f678d17702769089d69c98bb5d3464b355f6adb9bdfa63625950d651f8acac WatchSource:0}: Error finding container 28f678d17702769089d69c98bb5d3464b355f6adb9bdfa63625950d651f8acac: Status 404 returned error can't find the container with id 28f678d17702769089d69c98bb5d3464b355f6adb9bdfa63625950d651f8acac
Jul 29 01:20:37.528091 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.528074    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:20:37.593029 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.593002    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"]
Jul 29 01:20:37.595951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.595930    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.598524 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.598504    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 01:20:37.598747 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.598565    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jtn8v\""
Jul 29 01:20:37.598747 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.598652    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 01:20:37.600565 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.600548    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 01:20:37.609701 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.609677    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"]
Jul 29 01:20:37.774035 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.774004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/64b5fa3a-136a-4f6f-8488-3f2262864c62-metrics-cert\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.774035 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.774035    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/64b5fa3a-136a-4f6f-8488-3f2262864c62-manager-config\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.774253 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.774062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w7s4\" (UniqueName: \"kubernetes.io/projected/64b5fa3a-136a-4f6f-8488-3f2262864c62-kube-api-access-9w7s4\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.774253 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.774092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64b5fa3a-136a-4f6f-8488-3f2262864c62-cert\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.841670 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.841638    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"]
Jul 29 01:20:37.843952 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.843931    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:37.845997 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.845978    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 01:20:37.846118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.846057    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-splfj\""
Jul 29 01:20:37.846173 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.846141    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 01:20:37.846298 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.846280    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 01:20:37.858550 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.858530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"]
Jul 29 01:20:37.875186 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.875167    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64b5fa3a-136a-4f6f-8488-3f2262864c62-cert\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.875293 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.875219    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/64b5fa3a-136a-4f6f-8488-3f2262864c62-metrics-cert\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.875293 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.875240    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/64b5fa3a-136a-4f6f-8488-3f2262864c62-manager-config\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.875293 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.875272    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w7s4\" (UniqueName: \"kubernetes.io/projected/64b5fa3a-136a-4f6f-8488-3f2262864c62-kube-api-access-9w7s4\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.876044 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.876018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/64b5fa3a-136a-4f6f-8488-3f2262864c62-manager-config\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.877834 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.877814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/64b5fa3a-136a-4f6f-8488-3f2262864c62-metrics-cert\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.877908 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.877850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64b5fa3a-136a-4f6f-8488-3f2262864c62-cert\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.885129 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.885106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w7s4\" (UniqueName: \"kubernetes.io/projected/64b5fa3a-136a-4f6f-8488-3f2262864c62-kube-api-access-9w7s4\") pod \"lws-controller-manager-7c7f9c9bb4-2gkhc\" (UID: \"64b5fa3a-136a-4f6f-8488-3f2262864c62\") " pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.906604 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.906584    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:37.976079 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.976051    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:37.976205 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.976099    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cf415d9-2db2-4858-a2ad-04133e2822a0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:37.976205 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.976114    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj8tl\" (UniqueName: \"kubernetes.io/projected/5cf415d9-2db2-4858-a2ad-04133e2822a0-kube-api-access-zj8tl\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:37.976205 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.976193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:37.976379 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.976227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:37.976379 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.976342    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:37.976379 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:37.976373    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cf415d9-2db2-4858-a2ad-04133e2822a0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.031736 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.031709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"]
Jul 29 01:20:38.033821 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:20:38.033795    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b5fa3a_136a_4f6f_8488_3f2262864c62.slice/crio-470d5549610d3ab64e8e503400753049a98641be6723d320ddaa0dc36055692b WatchSource:0}: Error finding container 470d5549610d3ab64e8e503400753049a98641be6723d320ddaa0dc36055692b: Status 404 returned error can't find the container with id 470d5549610d3ab64e8e503400753049a98641be6723d320ddaa0dc36055692b
Jul 29 01:20:38.077492 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.077466    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.077843 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.077496    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cf415d9-2db2-4858-a2ad-04133e2822a0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.077843 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.077645    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.078012 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.077989    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cf415d9-2db2-4858-a2ad-04133e2822a0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.078068 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.078029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj8tl\" (UniqueName: \"kubernetes.io/projected/5cf415d9-2db2-4858-a2ad-04133e2822a0-kube-api-access-zj8tl\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.078151 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.078125    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.078262 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.078164    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.079100 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.079076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.080059 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.080040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/5cf415d9-2db2-4858-a2ad-04133e2822a0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.080148 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.080091    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/5cf415d9-2db2-4858-a2ad-04133e2822a0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.080148 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.080138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.080420 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.080396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.086133 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.086115    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj8tl\" (UniqueName: \"kubernetes.io/projected/5cf415d9-2db2-4858-a2ad-04133e2822a0-kube-api-access-zj8tl\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.086213 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.086123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5cf415d9-2db2-4858-a2ad-04133e2822a0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-qgkj2\" (UID: \"5cf415d9-2db2-4858-a2ad-04133e2822a0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.112611 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.112587    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc" event={"ID":"64b5fa3a-136a-4f6f-8488-3f2262864c62","Type":"ContainerStarted","Data":"470d5549610d3ab64e8e503400753049a98641be6723d320ddaa0dc36055692b"}
Jul 29 01:20:38.113988 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.113962    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h" event={"ID":"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b","Type":"ContainerStarted","Data":"28f678d17702769089d69c98bb5d3464b355f6adb9bdfa63625950d651f8acac"}
Jul 29 01:20:38.152500 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.152463    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:38.286750 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:38.286674    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"]
Jul 29 01:20:38.289420 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:20:38.289389    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cf415d9_2db2_4858_a2ad_04133e2822a0.slice/crio-a3189d5d88c8d4a99b2f86eaedb396789ac1cc8836d694295be1d696dcd4a852 WatchSource:0}: Error finding container a3189d5d88c8d4a99b2f86eaedb396789ac1cc8836d694295be1d696dcd4a852: Status 404 returned error can't find the container with id a3189d5d88c8d4a99b2f86eaedb396789ac1cc8836d694295be1d696dcd4a852
Jul 29 01:20:39.123756 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:39.123673    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2" event={"ID":"5cf415d9-2db2-4858-a2ad-04133e2822a0","Type":"ContainerStarted","Data":"a3189d5d88c8d4a99b2f86eaedb396789ac1cc8836d694295be1d696dcd4a852"}
Jul 29 01:20:40.130751 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:40.130716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc" event={"ID":"64b5fa3a-136a-4f6f-8488-3f2262864c62","Type":"ContainerStarted","Data":"0679f3120aed69fdff85cdc3c602429eea45786cbca6a24d40de215f4d4e376a"}
Jul 29 01:20:40.131103 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:40.130835    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:20:40.186217 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:40.184149    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc" podStartSLOduration=1.305220967 podStartE2EDuration="3.184125813s" totalImagesPullingTime="1.878904846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:40.178760705 +0000 UTC m=+616.817857540" watchObservedRunningTime="2026-07-29 01:20:40.184125813 +0000 UTC m=+616.823222621"
Jul 29 01:20:42.141166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:42.141121    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:20:42.141429 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:42.141222    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:20:42.141429 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:42.141261    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:20:42.142462 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:42.142429    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:20:42.142545 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:42.142495    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:20:43.147220 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:43.147182    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h" event={"ID":"6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b","Type":"ContainerStarted","Data":"0c05748be4e3b4b3501a89b96cd5678a54b2eb0ccad02d19fd3474b931d7889a"}
Jul 29 01:20:43.148703 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:43.148682    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2" event={"ID":"5cf415d9-2db2-4858-a2ad-04133e2822a0","Type":"ContainerStarted","Data":"648718027cf0cbf0e417212716ffb76b71c796267e58616117d2f69cf90dca34"}
Jul 29 01:20:43.148911 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:43.148896    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:43.150445 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:43.150424    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2"
Jul 29 01:20:43.188488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:43.188437    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h" podStartSLOduration=1.575832629 podStartE2EDuration="6.188423728s" totalImagesPullingTime="4.612591099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:43.185607117 +0000 UTC m=+619.824703907" watchObservedRunningTime="2026-07-29 01:20:43.188423728 +0000 UTC m=+619.827520535"
Jul 29 01:20:43.241653 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:43.241607    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-qgkj2" podStartSLOduration=2.391096529 podStartE2EDuration="6.241584261s" totalImagesPullingTime="3.850487732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:20:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:20:43.230697007 +0000 UTC m=+619.869793815" watchObservedRunningTime="2026-07-29 01:20:43.241584261 +0000 UTC m=+619.880681071"
Jul 29 01:20:43.390527 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:43.390492    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:43.394964 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:43.394939    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:44.152526 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:44.152444    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:44.153082 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:44.153065    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h"
Jul 29 01:20:51.138483 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:20:51.138454    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c7f9c9bb4-2gkhc"
Jul 29 01:23:11.002003 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.001970    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"]
Jul 29 01:23:11.005088 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.005069    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.007213 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.007194    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-h286w\""
Jul 29 01:23:11.017184 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.017163    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"]
Jul 29 01:23:11.122396 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.122368    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1924cc2-8894-4a5b-b66e-3389b980963f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.122555 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.122413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.122555 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.122440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2hrc\" (UniqueName: \"kubernetes.io/projected/e1924cc2-8894-4a5b-b66e-3389b980963f-kube-api-access-s2hrc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.122555 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.122470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.122555 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.122497    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.122555 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.122512    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.122555 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.122537    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.122555 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.122559    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.122893 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.122581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.223575 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.223551    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.223719 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.223604    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1924cc2-8894-4a5b-b66e-3389b980963f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.223719 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.223638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.223719 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.223664    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2hrc\" (UniqueName: \"kubernetes.io/projected/e1924cc2-8894-4a5b-b66e-3389b980963f-kube-api-access-s2hrc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.223719 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.223691    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.223914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.223721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.223914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.223745    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.223914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.223772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.223914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.223794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.224113 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.224042    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.224196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.224174    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.224476 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.224421    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.224476 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.224467    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.224601 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.224530    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1924cc2-8894-4a5b-b66e-3389b980963f-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.225949 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.225931    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.226631 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.226611    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.233648 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.233621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1924cc2-8894-4a5b-b66e-3389b980963f-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.233772 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.233754    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2hrc\" (UniqueName: \"kubernetes.io/projected/e1924cc2-8894-4a5b-b66e-3389b980963f-kube-api-access-s2hrc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-dtd8w\" (UID: \"e1924cc2-8894-4a5b-b66e-3389b980963f\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.314179 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.314152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:11.450456 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.450379    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"]
Jul 29 01:23:11.452978 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:23:11.452942    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1924cc2_8894_4a5b_b66e_3389b980963f.slice/crio-128e7cc3fda383417036eae4826bad4cb487ff67524334e9e458c2e6cad8a642 WatchSource:0}: Error finding container 128e7cc3fda383417036eae4826bad4cb487ff67524334e9e458c2e6cad8a642: Status 404 returned error can't find the container with id 128e7cc3fda383417036eae4826bad4cb487ff67524334e9e458c2e6cad8a642
Jul 29 01:23:11.455015 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.454983    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:23:11.455089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.455044    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:23:11.455089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.455071    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:23:11.755418 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.755338    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w" event={"ID":"e1924cc2-8894-4a5b-b66e-3389b980963f","Type":"ContainerStarted","Data":"34d36f258588343cd9463c7f3301dfdce6a4c77bc2dca81ff90d538ee88e1f32"}
Jul 29 01:23:11.755418 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.755396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w" event={"ID":"e1924cc2-8894-4a5b-b66e-3389b980963f","Type":"ContainerStarted","Data":"128e7cc3fda383417036eae4826bad4cb487ff67524334e9e458c2e6cad8a642"}
Jul 29 01:23:11.784519 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:11.784467    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w" podStartSLOduration=1.784447899 podStartE2EDuration="1.784447899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:23:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:23:11.782623889 +0000 UTC m=+768.421720733" watchObservedRunningTime="2026-07-29 01:23:11.784447899 +0000 UTC m=+768.423544707"
Jul 29 01:23:12.315235 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:12.315211    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:12.319649 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:12.319627    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:12.760233 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:12.760160    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:23:12.761041 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:23:12.761024    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:24:48.155273 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:48.155202    2565 generic.go:356] "Generic (PLEG): container finished" podID="e1924cc2-8894-4a5b-b66e-3389b980963f" containerID="34d36f258588343cd9463c7f3301dfdce6a4c77bc2dca81ff90d538ee88e1f32" exitCode=0
Jul 29 01:24:48.155638 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:48.155274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w" event={"ID":"e1924cc2-8894-4a5b-b66e-3389b980963f","Type":"ContainerDied","Data":"34d36f258588343cd9463c7f3301dfdce6a4c77bc2dca81ff90d538ee88e1f32"}
Jul 29 01:24:48.155678 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:48.155637    2565 scope.go:117] "RemoveContainer" containerID="34d36f258588343cd9463c7f3301dfdce6a4c77bc2dca81ff90d538ee88e1f32"
Jul 29 01:24:48.156615 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:48.156586    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:24:48.156728 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:48.156650    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:24:48.156728 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:48.156680    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:24:49.161236 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:49.161205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w" event={"ID":"e1924cc2-8894-4a5b-b66e-3389b980963f","Type":"ContainerStarted","Data":"5b5eec1e625177c344e46784b335402163d53247d124a024c4bd57fb9afd08b1"}
Jul 29 01:24:49.315234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:49.315190    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:24:49.315953 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:49.315290    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-dtd8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 29 01:24:49.315953 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:49.315635    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w" podUID="e1924cc2-8894-4a5b-b66e-3389b980963f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 29 01:24:50.315667 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:50.315630    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-dtd8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 29 01:24:50.316154 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:50.315690    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w" podUID="e1924cc2-8894-4a5b-b66e-3389b980963f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 29 01:24:51.315324 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:51.315266    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-dtd8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 29 01:24:51.315585 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:51.315558    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w" podUID="e1924cc2-8894-4a5b-b66e-3389b980963f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 29 01:24:52.315177 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:52.315135    2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-dtd8w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Jul 29 01:24:52.315698 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:52.315205    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w" podUID="e1924cc2-8894-4a5b-b66e-3389b980963f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Jul 29 01:24:53.319463 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:53.319429    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:24:53.320009 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:53.319984    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:24:53.320620 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:24:53.320600    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-dtd8w"
Jul 29 01:25:23.969724 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:23.969695    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:25:23.972713 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:23.972690    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:25:23.977288 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:23.977271    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:25:23.979957 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:23.979940    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:25:27.951380 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:27.951353    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"]
Jul 29 01:25:27.953779 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:27.953760    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:27.956947 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:27.956925    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mpzrx\""
Jul 29 01:25:27.957161 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:27.956954    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 01:25:27.957246 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:27.956995    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 01:25:27.957246 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:27.957037    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 29 01:25:27.965935 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:27.965913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"]
Jul 29 01:25:28.020020 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.019994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.020116 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.020034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.020116 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.020050    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f89f1f-53c2-4c7e-8475-194e789ce129-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.020184 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.020113    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r69g\" (UniqueName: \"kubernetes.io/projected/b2f89f1f-53c2-4c7e-8475-194e789ce129-kube-api-access-2r69g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.020220 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.020192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.020252 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.020235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.121426 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.121392    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.121590 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.121438    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.121590 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.121483    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.121590 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.121532    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.121590 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.121555    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f89f1f-53c2-4c7e-8475-194e789ce129-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.121793 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.121590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r69g\" (UniqueName: \"kubernetes.io/projected/b2f89f1f-53c2-4c7e-8475-194e789ce129-kube-api-access-2r69g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.121842 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.121787    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.121842 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.121806    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.121937 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.121915    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.123781 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.123759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b2f89f1f-53c2-4c7e-8475-194e789ce129-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.123916 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.123897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b2f89f1f-53c2-4c7e-8475-194e789ce129-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.129553 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.129532    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r69g\" (UniqueName: \"kubernetes.io/projected/b2f89f1f-53c2-4c7e-8475-194e789ce129-kube-api-access-2r69g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-jjql8\" (UID: \"b2f89f1f-53c2-4c7e-8475-194e789ce129\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.267340 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.267296    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:28.396536 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:28.396504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"]
Jul 29 01:25:28.397781 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:25:28.397752    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f89f1f_53c2_4c7e_8475_194e789ce129.slice/crio-d7423973151388e70f7243abd8799f86d73126e04333bbc8f4968585fda0b6d7 WatchSource:0}: Error finding container d7423973151388e70f7243abd8799f86d73126e04333bbc8f4968585fda0b6d7: Status 404 returned error can't find the container with id d7423973151388e70f7243abd8799f86d73126e04333bbc8f4968585fda0b6d7
Jul 29 01:25:29.337910 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:29.337880    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8" event={"ID":"b2f89f1f-53c2-4c7e-8475-194e789ce129","Type":"ContainerStarted","Data":"d7423973151388e70f7243abd8799f86d73126e04333bbc8f4968585fda0b6d7"}
Jul 29 01:25:30.343721 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:30.343685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8" event={"ID":"b2f89f1f-53c2-4c7e-8475-194e789ce129","Type":"ContainerStarted","Data":"3576732879e2364f3e8644575920bf17e8d45ef82f970fc5ac7182f8b8fdaab2"}
Jul 29 01:25:30.359962 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:30.359861    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8" podStartSLOduration=2.428523895 podStartE2EDuration="3.359839651s" totalImagesPullingTime="931.315756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:25:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:25:30.359426659 +0000 UTC m=+906.998523467" watchObservedRunningTime="2026-07-29 01:25:30.359839651 +0000 UTC m=+906.998936475"
Jul 29 01:25:38.268151 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:38.268116    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:38.268534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:38.268182    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:38.280089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:38.280067    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:38.387526 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:38.387500    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-jjql8"
Jul 29 01:25:55.263113 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.263079    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"]
Jul 29 01:25:55.265293 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.265277    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.267590 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.267568    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 29 01:25:55.277534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.277503    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"]
Jul 29 01:25:55.349471 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.349440    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.349589 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.349483    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.349589 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.349507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkxbn\" (UniqueName: \"kubernetes.io/projected/cf33614f-e014-473d-9e6b-b98b76e31b63-kube-api-access-nkxbn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.349589 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.349565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.349706 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.349651    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.350178 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.349698    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf33614f-e014-473d-9e6b-b98b76e31b63-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.451529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.451489    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf33614f-e014-473d-9e6b-b98b76e31b63-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.451714 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.451534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.451714 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.451573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.451714 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.451594    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxbn\" (UniqueName: \"kubernetes.io/projected/cf33614f-e014-473d-9e6b-b98b76e31b63-kube-api-access-nkxbn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.451714 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.451632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.451905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.451716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.452039 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.452018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.452109 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.452063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.452109 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.452084    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.454023 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.454002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cf33614f-e014-473d-9e6b-b98b76e31b63-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.454195 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.454179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cf33614f-e014-473d-9e6b-b98b76e31b63-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.459415 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.459391    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkxbn\" (UniqueName: \"kubernetes.io/projected/cf33614f-e014-473d-9e6b-b98b76e31b63-kube-api-access-nkxbn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v\" (UID: \"cf33614f-e014-473d-9e6b-b98b76e31b63\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.576487 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.576437    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:25:55.699526 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.699483    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"]
Jul 29 01:25:55.701715 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:25:55.701689    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf33614f_e014_473d_9e6b_b98b76e31b63.slice/crio-3bf1606bddb738130abfdc86c75e166a61ceb4aedd5a2c0ca5e6143b71917422 WatchSource:0}: Error finding container 3bf1606bddb738130abfdc86c75e166a61ceb4aedd5a2c0ca5e6143b71917422: Status 404 returned error can't find the container with id 3bf1606bddb738130abfdc86c75e166a61ceb4aedd5a2c0ca5e6143b71917422
Jul 29 01:25:55.703014 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:55.702995    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:25:56.454508 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:56.454471    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v" event={"ID":"cf33614f-e014-473d-9e6b-b98b76e31b63","Type":"ContainerStarted","Data":"0ffc7ae1f0ddd980e17f2d447866055b9369f37fa18d93d8365c1945d7190792"}
Jul 29 01:25:56.454945 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:56.454530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v" event={"ID":"cf33614f-e014-473d-9e6b-b98b76e31b63","Type":"ContainerStarted","Data":"3bf1606bddb738130abfdc86c75e166a61ceb4aedd5a2c0ca5e6143b71917422"}
Jul 29 01:25:56.471748 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:25:56.471699    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v" podStartSLOduration=1.293893571 podStartE2EDuration="1.471682725s" totalImagesPullingTime="177.789154ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:25:56.470511043 +0000 UTC m=+933.109607845" watchObservedRunningTime="2026-07-29 01:25:56.471682725 +0000 UTC m=+933.110779533"
Jul 29 01:26:05.577457 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:26:05.577423    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:26:05.577838 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:26:05.577481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:26:05.589529 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:26:05.589505    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:26:06.507562 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:26:06.507537    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v"
Jul 29 01:28:54.214254 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.214217    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-9c6zm"]
Jul 29 01:28:54.217366 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.217346    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:28:54.220568 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.220538    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h94bm\""
Jul 29 01:28:54.220568 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.220541    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 01:28:54.220743 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.220596    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 01:28:54.228377 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.228340    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-9c6zm"]
Jul 29 01:28:54.294804 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.294764    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e83d127a-a398-4649-a3d8-032ef860896f-webhook-cert\") pod \"maas-controller-76fb7fdd9-9c6zm\" (UID: \"e83d127a-a398-4649-a3d8-032ef860896f\") " pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:28:54.294994 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.294822    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/e83d127a-a398-4649-a3d8-032ef860896f-kube-api-access-v54z8\") pod \"maas-controller-76fb7fdd9-9c6zm\" (UID: \"e83d127a-a398-4649-a3d8-032ef860896f\") " pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:28:54.395733 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.395692    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e83d127a-a398-4649-a3d8-032ef860896f-webhook-cert\") pod \"maas-controller-76fb7fdd9-9c6zm\" (UID: \"e83d127a-a398-4649-a3d8-032ef860896f\") " pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:28:54.395979 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.395744    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/e83d127a-a398-4649-a3d8-032ef860896f-kube-api-access-v54z8\") pod \"maas-controller-76fb7fdd9-9c6zm\" (UID: \"e83d127a-a398-4649-a3d8-032ef860896f\") " pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:28:54.398512 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.398483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e83d127a-a398-4649-a3d8-032ef860896f-webhook-cert\") pod \"maas-controller-76fb7fdd9-9c6zm\" (UID: \"e83d127a-a398-4649-a3d8-032ef860896f\") " pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:28:54.403842 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.403819    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/e83d127a-a398-4649-a3d8-032ef860896f-kube-api-access-v54z8\") pod \"maas-controller-76fb7fdd9-9c6zm\" (UID: \"e83d127a-a398-4649-a3d8-032ef860896f\") " pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:28:54.527387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.527353    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:28:54.659212 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:54.659048    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-9c6zm"]
Jul 29 01:28:54.661842 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:28:54.661815    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83d127a_a398_4649_a3d8_032ef860896f.slice/crio-c265aebba873bb1261c3c1e57f5ca07f0aa6922b1f3cbd11d26b7e9c1ddc9510 WatchSource:0}: Error finding container c265aebba873bb1261c3c1e57f5ca07f0aa6922b1f3cbd11d26b7e9c1ddc9510: Status 404 returned error can't find the container with id c265aebba873bb1261c3c1e57f5ca07f0aa6922b1f3cbd11d26b7e9c1ddc9510
Jul 29 01:28:55.240427 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:55.240366    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm" event={"ID":"e83d127a-a398-4649-a3d8-032ef860896f","Type":"ContainerStarted","Data":"c265aebba873bb1261c3c1e57f5ca07f0aa6922b1f3cbd11d26b7e9c1ddc9510"}
Jul 29 01:28:57.251526 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:57.251442    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm" event={"ID":"e83d127a-a398-4649-a3d8-032ef860896f","Type":"ContainerStarted","Data":"0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625"}
Jul 29 01:28:57.251872 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:57.251577    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:28:57.268276 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:28:57.268224    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm" podStartSLOduration=1.040293282 podStartE2EDuration="3.2682078s" totalImagesPullingTime="2.227914518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:28:57.266351493 +0000 UTC m=+1113.905448310" watchObservedRunningTime="2026-07-29 01:28:57.2682078 +0000 UTC m=+1113.907304607"
Jul 29 01:29:08.258689 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:08.258659    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:29:12.870353 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:12.870298    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-9c6zm"]
Jul 29 01:29:12.870767 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:12.870520    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm" podUID="e83d127a-a398-4649-a3d8-032ef860896f" containerName="manager" containerID="cri-o://0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625" gracePeriod=30
Jul 29 01:29:13.119903 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.119876    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:29:13.268460 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.268419    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/e83d127a-a398-4649-a3d8-032ef860896f-kube-api-access-v54z8\") pod \"e83d127a-a398-4649-a3d8-032ef860896f\" (UID: \"e83d127a-a398-4649-a3d8-032ef860896f\") "
Jul 29 01:29:13.268626 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.268491    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e83d127a-a398-4649-a3d8-032ef860896f-webhook-cert\") pod \"e83d127a-a398-4649-a3d8-032ef860896f\" (UID: \"e83d127a-a398-4649-a3d8-032ef860896f\") "
Jul 29 01:29:13.270742 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.270710    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e83d127a-a398-4649-a3d8-032ef860896f-kube-api-access-v54z8" (OuterVolumeSpecName: "kube-api-access-v54z8") pod "e83d127a-a398-4649-a3d8-032ef860896f" (UID: "e83d127a-a398-4649-a3d8-032ef860896f"). InnerVolumeSpecName "kube-api-access-v54z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:29:13.270742 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.270733    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e83d127a-a398-4649-a3d8-032ef860896f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e83d127a-a398-4649-a3d8-032ef860896f" (UID: "e83d127a-a398-4649-a3d8-032ef860896f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:29:13.337170 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.337131    2565 generic.go:356] "Generic (PLEG): container finished" podID="e83d127a-a398-4649-a3d8-032ef860896f" containerID="0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625" exitCode=0
Jul 29 01:29:13.337382 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.337176    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm"
Jul 29 01:29:13.337382 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.337190    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm" event={"ID":"e83d127a-a398-4649-a3d8-032ef860896f","Type":"ContainerDied","Data":"0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625"}
Jul 29 01:29:13.337382 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.337233    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-9c6zm" event={"ID":"e83d127a-a398-4649-a3d8-032ef860896f","Type":"ContainerDied","Data":"c265aebba873bb1261c3c1e57f5ca07f0aa6922b1f3cbd11d26b7e9c1ddc9510"}
Jul 29 01:29:13.337382 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.337252    2565 scope.go:117] "RemoveContainer" containerID="0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625"
Jul 29 01:29:13.346049 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.346030    2565 scope.go:117] "RemoveContainer" containerID="0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625"
Jul 29 01:29:13.346405 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:29:13.346298    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625\": container with ID starting with 0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625 not found: ID does not exist" containerID="0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625"
Jul 29 01:29:13.346457 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.346416    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625"} err="failed to get container status \"0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625\": rpc error: code = NotFound desc = could not find container \"0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625\": container with ID starting with 0fd890cda1d16d12a3e5442fc622ad0b6a508f818c6e2908e590b632a33b1625 not found: ID does not exist"
Jul 29 01:29:13.359892 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.359864    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-9c6zm"]
Jul 29 01:29:13.364831 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.364811    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-9c6zm"]
Jul 29 01:29:13.369432 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.369412    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v54z8\" (UniqueName: \"kubernetes.io/projected/e83d127a-a398-4649-a3d8-032ef860896f-kube-api-access-v54z8\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:29:13.369571 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.369435    2565 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e83d127a-a398-4649-a3d8-032ef860896f-webhook-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:29:13.917193 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:13.917151    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e83d127a-a398-4649-a3d8-032ef860896f" path="/var/lib/kubelet/pods/e83d127a-a398-4649-a3d8-032ef860896f/volumes"
Jul 29 01:29:14.120200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.120166    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-2dz9l"]
Jul 29 01:29:14.120520 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.120508    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e83d127a-a398-4649-a3d8-032ef860896f" containerName="manager"
Jul 29 01:29:14.120569 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.120523    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e83d127a-a398-4649-a3d8-032ef860896f" containerName="manager"
Jul 29 01:29:14.120603 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.120578    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e83d127a-a398-4649-a3d8-032ef860896f" containerName="manager"
Jul 29 01:29:14.125119 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.125095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:29:14.128078 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.128058    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 29 01:29:14.128196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.128121    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 29 01:29:14.128196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.128066    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-h94bm\""
Jul 29 01:29:14.134221 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.134199    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-2dz9l"]
Jul 29 01:29:14.277703 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.277675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42f5m\" (UniqueName: \"kubernetes.io/projected/a471de76-f010-43de-bab0-8158c6f513fc-kube-api-access-42f5m\") pod \"maas-controller-76fb7fdd9-2dz9l\" (UID: \"a471de76-f010-43de-bab0-8158c6f513fc\") " pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:29:14.277874 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.277748    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a471de76-f010-43de-bab0-8158c6f513fc-webhook-cert\") pod \"maas-controller-76fb7fdd9-2dz9l\" (UID: \"a471de76-f010-43de-bab0-8158c6f513fc\") " pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:29:14.379175 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.379139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42f5m\" (UniqueName: \"kubernetes.io/projected/a471de76-f010-43de-bab0-8158c6f513fc-kube-api-access-42f5m\") pod \"maas-controller-76fb7fdd9-2dz9l\" (UID: \"a471de76-f010-43de-bab0-8158c6f513fc\") " pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:29:14.379405 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.379224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a471de76-f010-43de-bab0-8158c6f513fc-webhook-cert\") pod \"maas-controller-76fb7fdd9-2dz9l\" (UID: \"a471de76-f010-43de-bab0-8158c6f513fc\") " pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:29:14.381697 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.381676    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a471de76-f010-43de-bab0-8158c6f513fc-webhook-cert\") pod \"maas-controller-76fb7fdd9-2dz9l\" (UID: \"a471de76-f010-43de-bab0-8158c6f513fc\") " pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:29:14.387297 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.387268    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42f5m\" (UniqueName: \"kubernetes.io/projected/a471de76-f010-43de-bab0-8158c6f513fc-kube-api-access-42f5m\") pod \"maas-controller-76fb7fdd9-2dz9l\" (UID: \"a471de76-f010-43de-bab0-8158c6f513fc\") " pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:29:14.436354 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.436290    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:29:14.568782 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:14.568731    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76fb7fdd9-2dz9l"]
Jul 29 01:29:14.570925 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:29:14.570897    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda471de76_f010_43de_bab0_8158c6f513fc.slice/crio-ee1051f027ab60b2e83fd1481e68400ee1f16c9283e3f1713738a802231eb3db WatchSource:0}: Error finding container ee1051f027ab60b2e83fd1481e68400ee1f16c9283e3f1713738a802231eb3db: Status 404 returned error can't find the container with id ee1051f027ab60b2e83fd1481e68400ee1f16c9283e3f1713738a802231eb3db
Jul 29 01:29:15.353433 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:15.353398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-2dz9l" event={"ID":"a471de76-f010-43de-bab0-8158c6f513fc","Type":"ContainerStarted","Data":"e616e81ae551f2e5fba537f9d0ba409cd9bc4b6d2d2e116c205acccb77172d46"}
Jul 29 01:29:15.353853 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:15.353481    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76fb7fdd9-2dz9l" event={"ID":"a471de76-f010-43de-bab0-8158c6f513fc","Type":"ContainerStarted","Data":"ee1051f027ab60b2e83fd1481e68400ee1f16c9283e3f1713738a802231eb3db"}
Jul 29 01:29:15.353853 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:15.353523    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:29:15.371517 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:15.371461    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76fb7fdd9-2dz9l" podStartSLOduration=0.765096676 podStartE2EDuration="1.371443268s" totalImagesPullingTime="606.346592ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:29:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:29:15.37069872 +0000 UTC m=+1132.009795529" watchObservedRunningTime="2026-07-29 01:29:15.371443268 +0000 UTC m=+1132.010540108"
Jul 29 01:29:26.360451 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:29:26.360419    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76fb7fdd9-2dz9l"
Jul 29 01:30:23.995865 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:30:23.995841    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:30:23.999538 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:30:23.999517    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:30:24.002835 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:30:24.002814    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:30:24.006089 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:30:24.006074    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:35:24.026992 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:35:24.026964    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:35:24.030100 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:35:24.030073    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:35:24.035274 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:35:24.035254    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:35:24.038166 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:35:24.038144    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:40:24.055297 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:40:24.055169    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:40:24.062434 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:40:24.060257    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:40:24.068856 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:40:24.068830    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:40:24.072899 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:40:24.072879    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:42:40.279243 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.279203    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"]
Jul 29 01:42:40.283019 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.282998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.285437 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.285416    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d9d88784-openshift-default-dockercfg-vphcv\""
Jul 29 01:42:40.306374 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.306344    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"]
Jul 29 01:42:40.351558 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.351519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-credential-socket\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.351726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.351564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-envoy\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.351726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.351592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-socket\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.351726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.351683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-certs\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.351726 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.351716    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56hgw\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-kube-api-access-56hgw\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.351905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.351749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-data\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.351905 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.351792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-token\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.352005 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.351904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-podinfo\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.352005 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.351960    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istiod-ca-cert\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.452646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.452611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-envoy\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.452646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.452649    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-socket\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.452924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.452686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-certs\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.452924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.452759    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56hgw\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-kube-api-access-56hgw\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.452924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.452803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-data\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.452924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.452825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-token\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.452924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.452873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-podinfo\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.452924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.452916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istiod-ca-cert\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.453229 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.452979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-credential-socket\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.453229 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.453162    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-socket\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.453229 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.453190    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-certs\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.453426 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.453230    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-data\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.453426 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.453356    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-credential-socket\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.453775 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.453755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istiod-ca-cert\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.455160 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.455138    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-envoy\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.455564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.455546    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-podinfo\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.461607 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.461586    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-token\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.461715 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.461673    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56hgw\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-kube-api-access-56hgw\") pod \"e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") " pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.594587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.594503    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:40.735880 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.735732    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"]
Jul 29 01:42:40.738642 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:42:40.738606    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e0dbaf_edc8_49dc_b0f8_a9f68a867022.slice/crio-0a5110b2e0f871ffe7c52f28935eef36123bb83916eeb2a500fc265320603504 WatchSource:0}: Error finding container 0a5110b2e0f871ffe7c52f28935eef36123bb83916eeb2a500fc265320603504: Status 404 returned error can't find the container with id 0a5110b2e0f871ffe7c52f28935eef36123bb83916eeb2a500fc265320603504
Jul 29 01:42:40.740712 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.740682    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:42:40.740803 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.740748    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:42:40.740803 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:40.740779    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:42:41.030906 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:41.030864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" event={"ID":"67e0dbaf-edc8-49dc-b0f8-a9f68a867022","Type":"ContainerStarted","Data":"61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3"}
Jul 29 01:42:41.031145 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:41.030930    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" event={"ID":"67e0dbaf-edc8-49dc-b0f8-a9f68a867022","Type":"ContainerStarted","Data":"0a5110b2e0f871ffe7c52f28935eef36123bb83916eeb2a500fc265320603504"}
Jul 29 01:42:41.054150 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:41.054086    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" podStartSLOduration=1.054064506 podStartE2EDuration="1.054064506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:42:41.053270192 +0000 UTC m=+1937.692366992" watchObservedRunningTime="2026-07-29 01:42:41.054064506 +0000 UTC m=+1937.693161318"
Jul 29 01:42:41.595669 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:41.595636    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:41.600824 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:41.600800    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:42.036077 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.036045    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:42.037034 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.037013    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:42.693998 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.693968    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"]
Jul 29 01:42:42.697501 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.697482    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:42.701225 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.701202    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-d9d88784-serving-cert\""
Jul 29 01:42:42.701420 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.701344    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:42:42.701502 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.701488    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:42:42.702142 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.702118    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:42:42.708461 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.708436    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"]
Jul 29 01:42:42.775797 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.775763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3b3c8c-7789-4edc-8743-5be689f3145f-openshift-service-ca\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:42.775797 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.775801    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6wd9\" (UniqueName: \"kubernetes.io/projected/8a3b3c8c-7789-4edc-8743-5be689f3145f-kube-api-access-m6wd9\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:42.776008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.775900    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3b3c8c-7789-4edc-8743-5be689f3145f-maas-api-tls\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:42.877368 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.877287    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3b3c8c-7789-4edc-8743-5be689f3145f-maas-api-tls\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:42.877549 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:42:42.877433    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-serving-cert: secret "maas-api-e2e-ait-d9d88784-serving-cert" not found
Jul 29 01:42:42.877549 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.877468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3b3c8c-7789-4edc-8743-5be689f3145f-openshift-service-ca\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:42.877549 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:42:42.877511    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a3b3c8c-7789-4edc-8743-5be689f3145f-maas-api-tls podName:8a3b3c8c-7789-4edc-8743-5be689f3145f nodeName:}" failed. No retries permitted until 2026-07-29 01:42:43.377493317 +0000 UTC m=+1940.016590106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8a3b3c8c-7789-4edc-8743-5be689f3145f-maas-api-tls") pod "maas-api-e2e-ait-d9d88784-557b99cdfb-vk742" (UID: "8a3b3c8c-7789-4edc-8743-5be689f3145f") : secret "maas-api-e2e-ait-d9d88784-serving-cert" not found
Jul 29 01:42:42.877549 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.877531    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6wd9\" (UniqueName: \"kubernetes.io/projected/8a3b3c8c-7789-4edc-8743-5be689f3145f-kube-api-access-m6wd9\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:42.878225 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.878204    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3b3c8c-7789-4edc-8743-5be689f3145f-openshift-service-ca\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:42.889143 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:42.889106    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6wd9\" (UniqueName: \"kubernetes.io/projected/8a3b3c8c-7789-4edc-8743-5be689f3145f-kube-api-access-m6wd9\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:43.383720 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:43.383686    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3b3c8c-7789-4edc-8743-5be689f3145f-maas-api-tls\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:43.386547 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:43.386519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3b3c8c-7789-4edc-8743-5be689f3145f-maas-api-tls\") pod \"maas-api-e2e-ait-d9d88784-557b99cdfb-vk742\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:43.610892 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:43.610853    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:43.750206 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:43.750098    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"]
Jul 29 01:42:43.752556 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:42:43.752530    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a3b3c8c_7789_4edc_8743_5be689f3145f.slice/crio-dd0be0317cb1dd061ae0c56dd901a28ed489731c19071644629b64034d29d6c2 WatchSource:0}: Error finding container dd0be0317cb1dd061ae0c56dd901a28ed489731c19071644629b64034d29d6c2: Status 404 returned error can't find the container with id dd0be0317cb1dd061ae0c56dd901a28ed489731c19071644629b64034d29d6c2
Jul 29 01:42:43.754120 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:43.754101    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:42:44.053471 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:44.053439    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742" event={"ID":"8a3b3c8c-7789-4edc-8743-5be689f3145f","Type":"ContainerStarted","Data":"dd0be0317cb1dd061ae0c56dd901a28ed489731c19071644629b64034d29d6c2"}
Jul 29 01:42:46.065631 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:46.065585    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742" event={"ID":"8a3b3c8c-7789-4edc-8743-5be689f3145f","Type":"ContainerStarted","Data":"e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f"}
Jul 29 01:42:46.066121 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:46.065660    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:46.081476 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:46.081409    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742" podStartSLOduration=2.531665166 podStartE2EDuration="4.081387671s" totalImagesPullingTime="1.549722505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:42:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:42:46.08117385 +0000 UTC m=+1942.720270659" watchObservedRunningTime="2026-07-29 01:42:46.081387671 +0000 UTC m=+1942.720484484"
Jul 29 01:42:52.076516 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:52.076482    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:42:54.104876 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:54.104842    2565 generic.go:356] "Generic (PLEG): container finished" podID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerID="61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3" exitCode=0
Jul 29 01:42:54.105298 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:54.104910    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" event={"ID":"67e0dbaf-edc8-49dc-b0f8-a9f68a867022","Type":"ContainerDied","Data":"61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3"}
Jul 29 01:42:54.105298 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:54.105271    2565 scope.go:117] "RemoveContainer" containerID="61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3"
Jul 29 01:42:54.106406 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:54.106371    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:42:54.106492 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:54.106464    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:42:54.106539 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:54.106521    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:42:55.116973 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:55.116927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" event={"ID":"67e0dbaf-edc8-49dc-b0f8-a9f68a867022","Type":"ContainerStarted","Data":"dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c"}
Jul 29 01:42:55.595806 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:55.595773    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:55.611333 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:55.601267    2565 patch_prober.go:28] interesting pod/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:42:55.611333 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:55.601339    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:42:56.595223 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:56.595186    2565 patch_prober.go:28] interesting pod/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:42:56.596289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:56.596252    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:42:57.036678 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:57.036642    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:57.595300 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:57.594844    2565 patch_prober.go:28] interesting pod/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:42:57.595300 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:57.594914    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:42:58.595957 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:58.595919    2565 patch_prober.go:28] interesting pod/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body=
Jul 29 01:42:58.596564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:58.596533    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused"
Jul 29 01:42:59.599111 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:59.599085    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:42:59.599903 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:42:59.599882    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:43:23.183782 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.183691    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"]
Jul 29 01:43:23.184386 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.183927    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742" podUID="8a3b3c8c-7789-4edc-8743-5be689f3145f" containerName="maas-api" containerID="cri-o://e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f" gracePeriod=30
Jul 29 01:43:23.460564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.460532    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:43:23.562336 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.562269    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"]
Jul 29 01:43:23.563250 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.563029    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy" containerID="cri-o://dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c" gracePeriod=30
Jul 29 01:43:23.573649 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.573622    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3b3c8c-7789-4edc-8743-5be689f3145f-openshift-service-ca\") pod \"8a3b3c8c-7789-4edc-8743-5be689f3145f\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") "
Jul 29 01:43:23.573782 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.573687    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3b3c8c-7789-4edc-8743-5be689f3145f-maas-api-tls\") pod \"8a3b3c8c-7789-4edc-8743-5be689f3145f\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") "
Jul 29 01:43:23.573782 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.573741    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6wd9\" (UniqueName: \"kubernetes.io/projected/8a3b3c8c-7789-4edc-8743-5be689f3145f-kube-api-access-m6wd9\") pod \"8a3b3c8c-7789-4edc-8743-5be689f3145f\" (UID: \"8a3b3c8c-7789-4edc-8743-5be689f3145f\") "
Jul 29 01:43:23.574037 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.574007    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a3b3c8c-7789-4edc-8743-5be689f3145f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a3b3c8c-7789-4edc-8743-5be689f3145f" (UID: "8a3b3c8c-7789-4edc-8743-5be689f3145f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:43:23.576542 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.576507    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a3b3c8c-7789-4edc-8743-5be689f3145f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a3b3c8c-7789-4edc-8743-5be689f3145f" (UID: "8a3b3c8c-7789-4edc-8743-5be689f3145f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:43:23.576649 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.576541    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a3b3c8c-7789-4edc-8743-5be689f3145f-kube-api-access-m6wd9" (OuterVolumeSpecName: "kube-api-access-m6wd9") pod "8a3b3c8c-7789-4edc-8743-5be689f3145f" (UID: "8a3b3c8c-7789-4edc-8743-5be689f3145f"). InnerVolumeSpecName "kube-api-access-m6wd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:43:23.674862 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.674823    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a3b3c8c-7789-4edc-8743-5be689f3145f-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:23.674862 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.674856    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a3b3c8c-7789-4edc-8743-5be689f3145f-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:23.674862 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:23.674866    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6wd9\" (UniqueName: \"kubernetes.io/projected/8a3b3c8c-7789-4edc-8743-5be689f3145f-kube-api-access-m6wd9\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:24.258951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:24.258867    2565 generic.go:356] "Generic (PLEG): container finished" podID="8a3b3c8c-7789-4edc-8743-5be689f3145f" containerID="e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f" exitCode=0
Jul 29 01:43:24.258951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:24.258932    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"
Jul 29 01:43:24.259456 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:24.258956    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742" event={"ID":"8a3b3c8c-7789-4edc-8743-5be689f3145f","Type":"ContainerDied","Data":"e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f"}
Jul 29 01:43:24.259456 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:24.259012    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742" event={"ID":"8a3b3c8c-7789-4edc-8743-5be689f3145f","Type":"ContainerDied","Data":"dd0be0317cb1dd061ae0c56dd901a28ed489731c19071644629b64034d29d6c2"}
Jul 29 01:43:24.259456 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:24.259034    2565 scope.go:117] "RemoveContainer" containerID="e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f"
Jul 29 01:43:24.269688 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:24.269562    2565 scope.go:117] "RemoveContainer" containerID="e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f"
Jul 29 01:43:24.270124 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:43:24.270099    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f\": container with ID starting with e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f not found: ID does not exist" containerID="e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f"
Jul 29 01:43:24.270180 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:24.270135    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f"} err="failed to get container status \"e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f\": rpc error: code = NotFound desc = could not find container \"e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f\": container with ID starting with e0ab10ef2104adc7a3f428d8f0365e78e7b2acb89d73bdd797801b93e75cbc4f not found: ID does not exist"
Jul 29 01:43:24.280104 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:24.280068    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"]
Jul 29 01:43:24.286221 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:24.286200    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-d9d88784-557b99cdfb-vk742"]
Jul 29 01:43:25.916179 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:25.916140    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a3b3c8c-7789-4edc-8743-5be689f3145f" path="/var/lib/kubelet/pods/8a3b3c8c-7789-4edc-8743-5be689f3145f/volumes"
Jul 29 01:43:27.462559 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.462526    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"]
Jul 29 01:43:27.462952 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.462870    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a3b3c8c-7789-4edc-8743-5be689f3145f" containerName="maas-api"
Jul 29 01:43:27.462952 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.462880    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a3b3c8c-7789-4edc-8743-5be689f3145f" containerName="maas-api"
Jul 29 01:43:27.463036 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.462966    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a3b3c8c-7789-4edc-8743-5be689f3145f" containerName="maas-api"
Jul 29 01:43:27.465920 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.465899    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:27.468477 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.468450    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:43:27.469297 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.469149    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a63cc33b-serving-cert\""
Jul 29 01:43:27.469297 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.469191    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:43:27.469297 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.469231    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:43:27.476804 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.476759    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"]
Jul 29 01:43:27.611776 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.611745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6076d1bb-0ebb-4345-be91-088c0e44a280-maas-api-tls\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:27.611925 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.611795    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6076d1bb-0ebb-4345-be91-088c0e44a280-openshift-service-ca\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:27.611925 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.611890    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7bqj\" (UniqueName: \"kubernetes.io/projected/6076d1bb-0ebb-4345-be91-088c0e44a280-kube-api-access-t7bqj\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:27.713519 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.713399    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7bqj\" (UniqueName: \"kubernetes.io/projected/6076d1bb-0ebb-4345-be91-088c0e44a280-kube-api-access-t7bqj\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:27.713519 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.713493    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6076d1bb-0ebb-4345-be91-088c0e44a280-maas-api-tls\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:27.713807 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.713536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6076d1bb-0ebb-4345-be91-088c0e44a280-openshift-service-ca\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:27.713807 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:43:27.713674    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-serving-cert: secret "maas-api-e2e-migrate-a63cc33b-serving-cert" not found
Jul 29 01:43:27.713807 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:43:27.713758    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6076d1bb-0ebb-4345-be91-088c0e44a280-maas-api-tls podName:6076d1bb-0ebb-4345-be91-088c0e44a280 nodeName:}" failed. No retries permitted until 2026-07-29 01:43:28.213733124 +0000 UTC m=+1984.852829911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6076d1bb-0ebb-4345-be91-088c0e44a280-maas-api-tls") pod "maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv" (UID: "6076d1bb-0ebb-4345-be91-088c0e44a280") : secret "maas-api-e2e-migrate-a63cc33b-serving-cert" not found
Jul 29 01:43:27.714270 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.714251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6076d1bb-0ebb-4345-be91-088c0e44a280-openshift-service-ca\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:27.723434 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:27.723410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7bqj\" (UniqueName: \"kubernetes.io/projected/6076d1bb-0ebb-4345-be91-088c0e44a280-kube-api-access-t7bqj\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:28.219845 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.219800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6076d1bb-0ebb-4345-be91-088c0e44a280-maas-api-tls\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:28.222501 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.222474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6076d1bb-0ebb-4345-be91-088c0e44a280-maas-api-tls\") pod \"maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:28.380077 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.380042    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:28.535466 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.535435    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"]
Jul 29 01:43:28.536951 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:43:28.536926    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6076d1bb_0ebb_4345_be91_088c0e44a280.slice/crio-19ad6acf9751ee66f8d63fb5b3774c4286bf2504a5e1349f83c0c4fd2a0fae27 WatchSource:0}: Error finding container 19ad6acf9751ee66f8d63fb5b3774c4286bf2504a5e1349f83c0c4fd2a0fae27: Status 404 returned error can't find the container with id 19ad6acf9751ee66f8d63fb5b3774c4286bf2504a5e1349f83c0c4fd2a0fae27
Jul 29 01:43:28.822097 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.822069    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:43:28.926299 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926266    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-podinfo\") pod \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") "
Jul 29 01:43:28.926517 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926373    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-envoy\") pod \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") "
Jul 29 01:43:28.926517 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926399    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-socket\") pod \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") "
Jul 29 01:43:28.926517 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926446    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-certs\") pod \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") "
Jul 29 01:43:28.926517 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926474    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-token\") pod \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") "
Jul 29 01:43:28.926517 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926495    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istiod-ca-cert\") pod \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") "
Jul 29 01:43:28.926794 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926526    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-data\") pod \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") "
Jul 29 01:43:28.926794 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56hgw\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-kube-api-access-56hgw\") pod \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") "
Jul 29 01:43:28.926794 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926602    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-credential-socket\") pod \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\" (UID: \"67e0dbaf-edc8-49dc-b0f8-a9f68a867022\") "
Jul 29 01:43:28.926935 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926793    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "67e0dbaf-edc8-49dc-b0f8-a9f68a867022" (UID: "67e0dbaf-edc8-49dc-b0f8-a9f68a867022"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:43:28.926935 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926910    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "67e0dbaf-edc8-49dc-b0f8-a9f68a867022" (UID: "67e0dbaf-edc8-49dc-b0f8-a9f68a867022"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:43:28.927215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.926969    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:28.927215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.927023    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "67e0dbaf-edc8-49dc-b0f8-a9f68a867022" (UID: "67e0dbaf-edc8-49dc-b0f8-a9f68a867022"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:43:28.927423 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.927395    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "67e0dbaf-edc8-49dc-b0f8-a9f68a867022" (UID: "67e0dbaf-edc8-49dc-b0f8-a9f68a867022"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:43:28.927583 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.927560    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-data" (OuterVolumeSpecName: "istio-data") pod "67e0dbaf-edc8-49dc-b0f8-a9f68a867022" (UID: "67e0dbaf-edc8-49dc-b0f8-a9f68a867022"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:43:28.928907 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.928880    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "67e0dbaf-edc8-49dc-b0f8-a9f68a867022" (UID: "67e0dbaf-edc8-49dc-b0f8-a9f68a867022"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:43:28.928993 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.928966    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "67e0dbaf-edc8-49dc-b0f8-a9f68a867022" (UID: "67e0dbaf-edc8-49dc-b0f8-a9f68a867022"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:43:28.929159 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.929138    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-kube-api-access-56hgw" (OuterVolumeSpecName: "kube-api-access-56hgw") pod "67e0dbaf-edc8-49dc-b0f8-a9f68a867022" (UID: "67e0dbaf-edc8-49dc-b0f8-a9f68a867022"). InnerVolumeSpecName "kube-api-access-56hgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:43:28.929658 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:28.929635    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-token" (OuterVolumeSpecName: "istio-token") pod "67e0dbaf-edc8-49dc-b0f8-a9f68a867022" (UID: "67e0dbaf-edc8-49dc-b0f8-a9f68a867022"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:43:29.027539 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.027515    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:29.027539 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.027539    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:29.027686 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.027550    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:29.027686 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.027559    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:29.027686 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.027567    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:29.027686 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.027574    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56hgw\" (UniqueName: \"kubernetes.io/projected/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-kube-api-access-56hgw\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:29.027686 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.027583    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:29.027686 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.027592    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/67e0dbaf-edc8-49dc-b0f8-a9f68a867022-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:29.286208 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.286170    2565 generic.go:356] "Generic (PLEG): container finished" podID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerID="dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c" exitCode=0
Jul 29 01:43:29.286421 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.286217    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"
Jul 29 01:43:29.286421 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.286251    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" event={"ID":"67e0dbaf-edc8-49dc-b0f8-a9f68a867022","Type":"ContainerDied","Data":"dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c"}
Jul 29 01:43:29.286421 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.286337    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6" event={"ID":"67e0dbaf-edc8-49dc-b0f8-a9f68a867022","Type":"ContainerDied","Data":"0a5110b2e0f871ffe7c52f28935eef36123bb83916eeb2a500fc265320603504"}
Jul 29 01:43:29.286421 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.286372    2565 scope.go:117] "RemoveContainer" containerID="dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c"
Jul 29 01:43:29.288128 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.288100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv" event={"ID":"6076d1bb-0ebb-4345-be91-088c0e44a280","Type":"ContainerStarted","Data":"60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6"}
Jul 29 01:43:29.288251 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.288155    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv" event={"ID":"6076d1bb-0ebb-4345-be91-088c0e44a280","Type":"ContainerStarted","Data":"19ad6acf9751ee66f8d63fb5b3774c4286bf2504a5e1349f83c0c4fd2a0fae27"}
Jul 29 01:43:29.288251 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.288185    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:29.296554 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.296539    2565 scope.go:117] "RemoveContainer" containerID="61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3"
Jul 29 01:43:29.304380 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.304365    2565 scope.go:117] "RemoveContainer" containerID="dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c"
Jul 29 01:43:29.304668 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:43:29.304647    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c\": container with ID starting with dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c not found: ID does not exist" containerID="dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c"
Jul 29 01:43:29.304762 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.304676    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c"} err="failed to get container status \"dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c\": rpc error: code = NotFound desc = could not find container \"dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c\": container with ID starting with dfb62034aaee6839e5b8324257a43560b4487c90f0a1076f9947b66a3323403c not found: ID does not exist"
Jul 29 01:43:29.304762 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.304692    2565 scope.go:117] "RemoveContainer" containerID="61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3"
Jul 29 01:43:29.304958 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:43:29.304939    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3\": container with ID starting with 61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3 not found: ID does not exist" containerID="61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3"
Jul 29 01:43:29.305010 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.304964    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3"} err="failed to get container status \"61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3\": rpc error: code = NotFound desc = could not find container \"61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3\": container with ID starting with 61bdc22763228bb442cfce425174aabd49e8089c2cdd5a8ac0a6c9aed542f5a3 not found: ID does not exist"
Jul 29 01:43:29.308051 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.308009    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv" podStartSLOduration=1.883591528 podStartE2EDuration="2.307993918s" totalImagesPullingTime="424.40239ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:43:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:43:29.307065179 +0000 UTC m=+1985.946162058" watchObservedRunningTime="2026-07-29 01:43:29.307993918 +0000 UTC m=+1985.947090726"
Jul 29 01:43:29.322639 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.322613    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"]
Jul 29 01:43:29.329886 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.329858    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d9d88784-openshift-default-775cfc54d8-654r6"]
Jul 29 01:43:29.916133 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:29.916100    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" path="/var/lib/kubelet/pods/67e0dbaf-edc8-49dc-b0f8-a9f68a867022/volumes"
Jul 29 01:43:35.300293 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:35.300258    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:43:52.320815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.318026    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"]
Jul 29 01:43:52.320815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.318887    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy"
Jul 29 01:43:52.320815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.318910    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy"
Jul 29 01:43:52.320815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.318950    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy"
Jul 29 01:43:52.320815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.318960    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy"
Jul 29 01:43:52.320815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.319145    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy"
Jul 29 01:43:52.320815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.319162    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="67e0dbaf-edc8-49dc-b0f8-a9f68a867022" containerName="istio-proxy"
Jul 29 01:43:52.324351 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.324325    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"
Jul 29 01:43:52.327146 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.327122    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 01:43:52.329044 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.329014    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"]
Jul 29 01:43:52.337473 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.337448    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe90e44e-c3e5-4841-b6e9-5434cde5876c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg\" (UID: \"fe90e44e-c3e5-4841-b6e9-5434cde5876c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"
Jul 29 01:43:52.438223 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.438193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe90e44e-c3e5-4841-b6e9-5434cde5876c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg\" (UID: \"fe90e44e-c3e5-4841-b6e9-5434cde5876c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"
Jul 29 01:43:52.438866 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.438847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe90e44e-c3e5-4841-b6e9-5434cde5876c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg\" (UID: \"fe90e44e-c3e5-4841-b6e9-5434cde5876c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"
Jul 29 01:43:52.637921 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.637845    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"
Jul 29 01:43:52.773018 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:52.772994    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"]
Jul 29 01:43:52.774837 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:43:52.774811    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe90e44e_c3e5_4841_b6e9_5434cde5876c.slice/crio-89467da44e8bf0c11d1fd8ec4f5b7763e188dc0820b5ada56a15ef0c8ca1c02b WatchSource:0}: Error finding container 89467da44e8bf0c11d1fd8ec4f5b7763e188dc0820b5ada56a15ef0c8ca1c02b: Status 404 returned error can't find the container with id 89467da44e8bf0c11d1fd8ec4f5b7763e188dc0820b5ada56a15ef0c8ca1c02b
Jul 29 01:43:53.410754 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:53.410722    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg" event={"ID":"fe90e44e-c3e5-4841-b6e9-5434cde5876c","Type":"ContainerStarted","Data":"89467da44e8bf0c11d1fd8ec4f5b7763e188dc0820b5ada56a15ef0c8ca1c02b"}
Jul 29 01:43:56.427814 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:56.427788    2565 generic.go:356] "Generic (PLEG): container finished" podID="fe90e44e-c3e5-4841-b6e9-5434cde5876c" containerID="f10bd924c09145fdc947ccab30034b9c3ec93011df211ac8d22e82882a75011a" exitCode=0
Jul 29 01:43:56.428101 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:56.427864    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg" event={"ID":"fe90e44e-c3e5-4841-b6e9-5434cde5876c","Type":"ContainerDied","Data":"f10bd924c09145fdc947ccab30034b9c3ec93011df211ac8d22e82882a75011a"}
Jul 29 01:43:57.570386 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:57.570365    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"
Jul 29 01:43:57.687215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:57.687142    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe90e44e-c3e5-4841-b6e9-5434cde5876c-maas-api-service-ca\") pod \"fe90e44e-c3e5-4841-b6e9-5434cde5876c\" (UID: \"fe90e44e-c3e5-4841-b6e9-5434cde5876c\") "
Jul 29 01:43:57.687465 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:57.687444    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe90e44e-c3e5-4841-b6e9-5434cde5876c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe90e44e-c3e5-4841-b6e9-5434cde5876c" (UID: "fe90e44e-c3e5-4841-b6e9-5434cde5876c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:43:57.788441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:57.788415    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe90e44e-c3e5-4841-b6e9-5434cde5876c-maas-api-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:43:58.437668 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:58.437624    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"
Jul 29 01:43:58.437668 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:58.437655    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg" event={"ID":"fe90e44e-c3e5-4841-b6e9-5434cde5876c","Type":"ContainerDied","Data":"89467da44e8bf0c11d1fd8ec4f5b7763e188dc0820b5ada56a15ef0c8ca1c02b"}
Jul 29 01:43:58.437879 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:43:58.437724    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="89467da44e8bf0c11d1fd8ec4f5b7763e188dc0820b5ada56a15ef0c8ca1c02b"
Jul 29 01:44:08.141804 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.141771    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"]
Jul 29 01:44:08.142358 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.142027    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv" podUID="6076d1bb-0ebb-4345-be91-088c0e44a280" containerName="maas-api" containerID="cri-o://60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6" gracePeriod=30
Jul 29 01:44:08.359091 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.359053    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"]
Jul 29 01:44:08.362367 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.362341    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a63cc33b-gqbbg"]
Jul 29 01:44:08.407844 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.407554    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:44:08.484961 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.484275    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6076d1bb-0ebb-4345-be91-088c0e44a280-maas-api-tls\") pod \"6076d1bb-0ebb-4345-be91-088c0e44a280\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") "
Jul 29 01:44:08.484961 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.484371    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7bqj\" (UniqueName: \"kubernetes.io/projected/6076d1bb-0ebb-4345-be91-088c0e44a280-kube-api-access-t7bqj\") pod \"6076d1bb-0ebb-4345-be91-088c0e44a280\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") "
Jul 29 01:44:08.484961 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.484454    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6076d1bb-0ebb-4345-be91-088c0e44a280-openshift-service-ca\") pod \"6076d1bb-0ebb-4345-be91-088c0e44a280\" (UID: \"6076d1bb-0ebb-4345-be91-088c0e44a280\") "
Jul 29 01:44:08.485497 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.485444    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6076d1bb-0ebb-4345-be91-088c0e44a280-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6076d1bb-0ebb-4345-be91-088c0e44a280" (UID: "6076d1bb-0ebb-4345-be91-088c0e44a280"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:44:08.488694 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.488655    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6076d1bb-0ebb-4345-be91-088c0e44a280-kube-api-access-t7bqj" (OuterVolumeSpecName: "kube-api-access-t7bqj") pod "6076d1bb-0ebb-4345-be91-088c0e44a280" (UID: "6076d1bb-0ebb-4345-be91-088c0e44a280"). InnerVolumeSpecName "kube-api-access-t7bqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:08.488957 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.488934    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6076d1bb-0ebb-4345-be91-088c0e44a280-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6076d1bb-0ebb-4345-be91-088c0e44a280" (UID: "6076d1bb-0ebb-4345-be91-088c0e44a280"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:44:08.490708 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.490678    2565 generic.go:356] "Generic (PLEG): container finished" podID="6076d1bb-0ebb-4345-be91-088c0e44a280" containerID="60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6" exitCode=0
Jul 29 01:44:08.490840 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.490732    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"
Jul 29 01:44:08.490840 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.490767    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv" event={"ID":"6076d1bb-0ebb-4345-be91-088c0e44a280","Type":"ContainerDied","Data":"60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6"}
Jul 29 01:44:08.490941 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.490840    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv" event={"ID":"6076d1bb-0ebb-4345-be91-088c0e44a280","Type":"ContainerDied","Data":"19ad6acf9751ee66f8d63fb5b3774c4286bf2504a5e1349f83c0c4fd2a0fae27"}
Jul 29 01:44:08.490941 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.490874    2565 scope.go:117] "RemoveContainer" containerID="60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6"
Jul 29 01:44:08.506750 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.506728    2565 scope.go:117] "RemoveContainer" containerID="60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6"
Jul 29 01:44:08.507103 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:44:08.507077    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6\": container with ID starting with 60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6 not found: ID does not exist" containerID="60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6"
Jul 29 01:44:08.507184 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.507137    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6"} err="failed to get container status \"60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6\": rpc error: code = NotFound desc = could not find container \"60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6\": container with ID starting with 60cab14b30d0c88eba403d70292d9e4cf4a481f230bdb992e664d44c60bb59a6 not found: ID does not exist"
Jul 29 01:44:08.523502 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.523460    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"]
Jul 29 01:44:08.529640 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.529617    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a63cc33b-777dc49dc5-4h9kv"]
Jul 29 01:44:08.585322 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.585284    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6076d1bb-0ebb-4345-be91-088c0e44a280-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:08.585433 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.585328    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7bqj\" (UniqueName: \"kubernetes.io/projected/6076d1bb-0ebb-4345-be91-088c0e44a280-kube-api-access-t7bqj\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:08.585433 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:08.585346    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6076d1bb-0ebb-4345-be91-088c0e44a280-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:09.339225 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.339193    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"]
Jul 29 01:44:09.339615 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.339555    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe90e44e-c3e5-4841-b6e9-5434cde5876c" containerName="revoke-keys"
Jul 29 01:44:09.339615 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.339568    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe90e44e-c3e5-4841-b6e9-5434cde5876c" containerName="revoke-keys"
Jul 29 01:44:09.339615 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.339581    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6076d1bb-0ebb-4345-be91-088c0e44a280" containerName="maas-api"
Jul 29 01:44:09.339615 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.339587    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6076d1bb-0ebb-4345-be91-088c0e44a280" containerName="maas-api"
Jul 29 01:44:09.339737 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.339651    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe90e44e-c3e5-4841-b6e9-5434cde5876c" containerName="revoke-keys"
Jul 29 01:44:09.339737 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.339661    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6076d1bb-0ebb-4345-be91-088c0e44a280" containerName="maas-api"
Jul 29 01:44:09.344029 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.344011    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.346233 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.346217    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0187de68-openshift-default-dockercfg-vjxns\""
Jul 29 01:44:09.355013 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.354992    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"]
Jul 29 01:44:09.493091 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.493056    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-socket\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.493258 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.493098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-data\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.493258 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.493195    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-envoy\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.493258 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.493213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-credential-socket\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.493258 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.493237    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-certs\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.493258 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.493257    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istiod-ca-cert\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.493496 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.493344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c742s\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-kube-api-access-c742s\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.493496 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.493394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-token\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.493496 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.493430    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-podinfo\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.594694 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.594612    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-envoy\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.594694 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.594650    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-credential-socket\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.594908 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.594770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-certs\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.594908 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.594798    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istiod-ca-cert\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.594908 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.594824    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c742s\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-kube-api-access-c742s\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.595062 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.594899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-token\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.595062 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.594948    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-podinfo\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.595062 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.594987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-socket\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.595062 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.595021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-data\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.595062 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.595041    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-credential-socket\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.595275 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.595169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-certs\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.595474 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.595452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-socket\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.595557 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.595500    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istiod-ca-cert\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.595598 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.595545    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-data\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.597178 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.597160    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-envoy\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.597532 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.597515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-podinfo\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.603203 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.603181    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-token\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.603454 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.603431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c742s\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-kube-api-access-c742s\") pod \"e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") " pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.655483 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.655449    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:09.807112 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.807082    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"]
Jul 29 01:44:09.809619 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:44:09.809579    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27fa5171_cbaf_46c0_9881_9d6b92ea1c44.slice/crio-e2153e52bc603c79b4efa803ba7df5fa1d022c0488a58b2527b122f5f3be6a18 WatchSource:0}: Error finding container e2153e52bc603c79b4efa803ba7df5fa1d022c0488a58b2527b122f5f3be6a18: Status 404 returned error can't find the container with id e2153e52bc603c79b4efa803ba7df5fa1d022c0488a58b2527b122f5f3be6a18
Jul 29 01:44:09.811870 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.811825    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:44:09.811942 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.811916    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:44:09.811978 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.811959    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:44:09.917696 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.917667    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6076d1bb-0ebb-4345-be91-088c0e44a280" path="/var/lib/kubelet/pods/6076d1bb-0ebb-4345-be91-088c0e44a280/volumes"
Jul 29 01:44:09.917987 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:09.917975    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe90e44e-c3e5-4841-b6e9-5434cde5876c" path="/var/lib/kubelet/pods/fe90e44e-c3e5-4841-b6e9-5434cde5876c/volumes"
Jul 29 01:44:10.503967 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:10.503932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" event={"ID":"27fa5171-cbaf-46c0-9881-9d6b92ea1c44","Type":"ContainerStarted","Data":"77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa"}
Jul 29 01:44:10.504349 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:10.503983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" event={"ID":"27fa5171-cbaf-46c0-9881-9d6b92ea1c44","Type":"ContainerStarted","Data":"e2153e52bc603c79b4efa803ba7df5fa1d022c0488a58b2527b122f5f3be6a18"}
Jul 29 01:44:10.526699 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:10.526647    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" podStartSLOduration=1.5266282329999998 podStartE2EDuration="1.526628233s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:10.525330118 +0000 UTC m=+2027.164426919" watchObservedRunningTime="2026-07-29 01:44:10.526628233 +0000 UTC m=+2027.165725043"
Jul 29 01:44:10.656612 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:10.656581    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:10.661247 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:10.661214    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:11.508906 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:11.508877    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:11.509722 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:11.509702    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:12.049021 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.048986    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"]
Jul 29 01:44:12.053795 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.053766    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.056252 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.056228    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:44:12.056388 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.056295    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:44:12.056463 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.056451    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0187de68-serving-cert\""
Jul 29 01:44:12.057037 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.057019    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:44:12.065577 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.065553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"]
Jul 29 01:44:12.119339 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.119298    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvz5t\" (UniqueName: \"kubernetes.io/projected/b95c2166-c187-4365-8dcf-e445a1596d56-kube-api-access-gvz5t\") pod \"maas-api-e2e-ait-0187de68-775cff7765-9kvqz\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.119455 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.119414    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b95c2166-c187-4365-8dcf-e445a1596d56-maas-api-tls\") pod \"maas-api-e2e-ait-0187de68-775cff7765-9kvqz\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.119544 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.119527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b95c2166-c187-4365-8dcf-e445a1596d56-openshift-service-ca\") pod \"maas-api-e2e-ait-0187de68-775cff7765-9kvqz\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.220719 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.220684    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b95c2166-c187-4365-8dcf-e445a1596d56-maas-api-tls\") pod \"maas-api-e2e-ait-0187de68-775cff7765-9kvqz\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.220898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.220764    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b95c2166-c187-4365-8dcf-e445a1596d56-openshift-service-ca\") pod \"maas-api-e2e-ait-0187de68-775cff7765-9kvqz\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.220898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.220791    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvz5t\" (UniqueName: \"kubernetes.io/projected/b95c2166-c187-4365-8dcf-e445a1596d56-kube-api-access-gvz5t\") pod \"maas-api-e2e-ait-0187de68-775cff7765-9kvqz\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.221349 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.221330    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b95c2166-c187-4365-8dcf-e445a1596d56-openshift-service-ca\") pod \"maas-api-e2e-ait-0187de68-775cff7765-9kvqz\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.223323 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.223289    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b95c2166-c187-4365-8dcf-e445a1596d56-maas-api-tls\") pod \"maas-api-e2e-ait-0187de68-775cff7765-9kvqz\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.229185 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.229161    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvz5t\" (UniqueName: \"kubernetes.io/projected/b95c2166-c187-4365-8dcf-e445a1596d56-kube-api-access-gvz5t\") pod \"maas-api-e2e-ait-0187de68-775cff7765-9kvqz\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.366349 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.366256    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:12.499575 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.499549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"]
Jul 29 01:44:12.501725 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:44:12.501697    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb95c2166_c187_4365_8dcf_e445a1596d56.slice/crio-5f7a07ef8eac4fae51c2b32239f7d1b9776092812ab36ec1e2dbfe30203ab08f WatchSource:0}: Error finding container 5f7a07ef8eac4fae51c2b32239f7d1b9776092812ab36ec1e2dbfe30203ab08f: Status 404 returned error can't find the container with id 5f7a07ef8eac4fae51c2b32239f7d1b9776092812ab36ec1e2dbfe30203ab08f
Jul 29 01:44:12.514488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:12.514461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz" event={"ID":"b95c2166-c187-4365-8dcf-e445a1596d56","Type":"ContainerStarted","Data":"5f7a07ef8eac4fae51c2b32239f7d1b9776092812ab36ec1e2dbfe30203ab08f"}
Jul 29 01:44:13.521109 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:13.521064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz" event={"ID":"b95c2166-c187-4365-8dcf-e445a1596d56","Type":"ContainerStarted","Data":"b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a"}
Jul 29 01:44:13.541817 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:13.541773    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz" podStartSLOduration=1.1602378230000001 podStartE2EDuration="1.541755978s" totalImagesPullingTime="381.518155ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:13.540443466 +0000 UTC m=+2030.179540275" watchObservedRunningTime="2026-07-29 01:44:13.541755978 +0000 UTC m=+2030.180852785"
Jul 29 01:44:14.525864 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:14.525827    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:20.536163 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:20.536127    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:26.510124 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:26.510052    2565 patch_prober.go:28] interesting pod/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 29 01:44:26.510489 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:26.510114    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 29 01:44:26.585196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:26.585139    2565 generic.go:356] "Generic (PLEG): container finished" podID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerID="77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa" exitCode=0
Jul 29 01:44:26.585196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:26.585173    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" event={"ID":"27fa5171-cbaf-46c0-9881-9d6b92ea1c44","Type":"ContainerDied","Data":"77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa"}
Jul 29 01:44:26.585567 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:26.585552    2565 scope.go:117] "RemoveContainer" containerID="77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa"
Jul 29 01:44:26.586574 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:26.586547    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:44:26.586645 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:26.586616    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:44:26.586686 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:26.586648    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:44:27.592281 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:27.592237    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" event={"ID":"27fa5171-cbaf-46c0-9881-9d6b92ea1c44","Type":"ContainerStarted","Data":"f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c"}
Jul 29 01:44:27.656187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:27.656159    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:27.656376 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:27.656360    2565 patch_prober.go:28] interesting pod/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 29 01:44:27.656427 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:27.656409    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 29 01:44:28.655994 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:28.655959    2565 patch_prober.go:28] interesting pod/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 29 01:44:28.656414 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:28.656017    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 29 01:44:29.656096 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:29.656063    2565 patch_prober.go:28] interesting pod/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 29 01:44:29.656488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:29.656117    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 29 01:44:30.656377 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:30.656341    2565 patch_prober.go:28] interesting pod/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Jul 29 01:44:30.656745 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:30.656396    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Jul 29 01:44:31.659652 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:31.659624    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:31.660033 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:31.659889    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:31.660602 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:31.660583    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:42.615525 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:42.615494    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"]
Jul 29 01:44:42.615900 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:42.615690    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz" podUID="b95c2166-c187-4365-8dcf-e445a1596d56" containerName="maas-api" containerID="cri-o://b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a" gracePeriod=30
Jul 29 01:44:42.866610 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:42.866537    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:42.914758 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:42.914704    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b95c2166-c187-4365-8dcf-e445a1596d56-maas-api-tls\") pod \"b95c2166-c187-4365-8dcf-e445a1596d56\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") "
Jul 29 01:44:42.914956 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:42.914795    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b95c2166-c187-4365-8dcf-e445a1596d56-openshift-service-ca\") pod \"b95c2166-c187-4365-8dcf-e445a1596d56\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") "
Jul 29 01:44:42.914956 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:42.914887    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvz5t\" (UniqueName: \"kubernetes.io/projected/b95c2166-c187-4365-8dcf-e445a1596d56-kube-api-access-gvz5t\") pod \"b95c2166-c187-4365-8dcf-e445a1596d56\" (UID: \"b95c2166-c187-4365-8dcf-e445a1596d56\") "
Jul 29 01:44:42.915278 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:42.915234    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b95c2166-c187-4365-8dcf-e445a1596d56-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b95c2166-c187-4365-8dcf-e445a1596d56" (UID: "b95c2166-c187-4365-8dcf-e445a1596d56"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:44:42.917130 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:42.917090    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b95c2166-c187-4365-8dcf-e445a1596d56-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b95c2166-c187-4365-8dcf-e445a1596d56" (UID: "b95c2166-c187-4365-8dcf-e445a1596d56"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:44:42.917271 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:42.917252    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b95c2166-c187-4365-8dcf-e445a1596d56-kube-api-access-gvz5t" (OuterVolumeSpecName: "kube-api-access-gvz5t") pod "b95c2166-c187-4365-8dcf-e445a1596d56" (UID: "b95c2166-c187-4365-8dcf-e445a1596d56"). InnerVolumeSpecName "kube-api-access-gvz5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:43.016335 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.016277    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b95c2166-c187-4365-8dcf-e445a1596d56-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:43.016493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.016346    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvz5t\" (UniqueName: \"kubernetes.io/projected/b95c2166-c187-4365-8dcf-e445a1596d56-kube-api-access-gvz5t\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:43.016493 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.016360    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b95c2166-c187-4365-8dcf-e445a1596d56-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:43.679897 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.679856    2565 generic.go:356] "Generic (PLEG): container finished" podID="b95c2166-c187-4365-8dcf-e445a1596d56" containerID="b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a" exitCode=0
Jul 29 01:44:43.679897 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.679902    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"
Jul 29 01:44:43.680432 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.679906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz" event={"ID":"b95c2166-c187-4365-8dcf-e445a1596d56","Type":"ContainerDied","Data":"b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a"}
Jul 29 01:44:43.680432 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.679964    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz" event={"ID":"b95c2166-c187-4365-8dcf-e445a1596d56","Type":"ContainerDied","Data":"5f7a07ef8eac4fae51c2b32239f7d1b9776092812ab36ec1e2dbfe30203ab08f"}
Jul 29 01:44:43.680432 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.679986    2565 scope.go:117] "RemoveContainer" containerID="b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a"
Jul 29 01:44:43.694382 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.694353    2565 scope.go:117] "RemoveContainer" containerID="b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a"
Jul 29 01:44:43.694707 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:44:43.694678    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a\": container with ID starting with b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a not found: ID does not exist" containerID="b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a"
Jul 29 01:44:43.694770 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.694706    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a"} err="failed to get container status \"b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a\": rpc error: code = NotFound desc = could not find container \"b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a\": container with ID starting with b0bb41c2daa0914f3a85d2a4ae027b8e5f68884a0712a86f5daf5572c59bc44a not found: ID does not exist"
Jul 29 01:44:43.711100 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.711073    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"]
Jul 29 01:44:43.715452 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.715431    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0187de68-775cff7765-9kvqz"]
Jul 29 01:44:43.916708 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:43.916678    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b95c2166-c187-4365-8dcf-e445a1596d56" path="/var/lib/kubelet/pods/b95c2166-c187-4365-8dcf-e445a1596d56/volumes"
Jul 29 01:44:44.326171 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:44.326089    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"]
Jul 29 01:44:44.326376 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:44.326352    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy" containerID="cri-o://f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c" gracePeriod=30
Jul 29 01:44:46.662193 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:46.662154    2565 patch_prober.go:28] interesting pod/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:44:46.662594 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:46.662220    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:44:47.895821 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.895788    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"]
Jul 29 01:44:47.896191 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.896130    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b95c2166-c187-4365-8dcf-e445a1596d56" containerName="maas-api"
Jul 29 01:44:47.896191 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.896142    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b95c2166-c187-4365-8dcf-e445a1596d56" containerName="maas-api"
Jul 29 01:44:47.896261 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.896209    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b95c2166-c187-4365-8dcf-e445a1596d56" containerName="maas-api"
Jul 29 01:44:47.900609 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.900586    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:47.903144 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.903120    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-ff6a497a-serving-cert\""
Jul 29 01:44:47.903845 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.903828    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:44:47.903928 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.903849    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:44:47.904203 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.904186    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:44:47.918214 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.918185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"]
Jul 29 01:44:47.961454 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.961412    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6225739d-5b39-4c46-8abe-96001175df64-openshift-service-ca\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:47.961657 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.961568    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7rtk\" (UniqueName: \"kubernetes.io/projected/6225739d-5b39-4c46-8abe-96001175df64-kube-api-access-v7rtk\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:47.961728 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:47.961663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6225739d-5b39-4c46-8abe-96001175df64-maas-api-tls\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:48.062751 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:48.062716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6225739d-5b39-4c46-8abe-96001175df64-openshift-service-ca\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:48.062912 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:48.062774    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7rtk\" (UniqueName: \"kubernetes.io/projected/6225739d-5b39-4c46-8abe-96001175df64-kube-api-access-v7rtk\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:48.062912 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:48.062799    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6225739d-5b39-4c46-8abe-96001175df64-maas-api-tls\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:48.062988 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:44:48.062914    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-serving-cert: secret "maas-api-e2e-derive-ff6a497a-serving-cert" not found
Jul 29 01:44:48.062988 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:44:48.062972    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6225739d-5b39-4c46-8abe-96001175df64-maas-api-tls podName:6225739d-5b39-4c46-8abe-96001175df64 nodeName:}" failed. No retries permitted until 2026-07-29 01:44:48.562956817 +0000 UTC m=+2065.202053603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6225739d-5b39-4c46-8abe-96001175df64-maas-api-tls") pod "maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr" (UID: "6225739d-5b39-4c46-8abe-96001175df64") : secret "maas-api-e2e-derive-ff6a497a-serving-cert" not found
Jul 29 01:44:48.063426 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:48.063407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6225739d-5b39-4c46-8abe-96001175df64-openshift-service-ca\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:48.072041 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:48.072019    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7rtk\" (UniqueName: \"kubernetes.io/projected/6225739d-5b39-4c46-8abe-96001175df64-kube-api-access-v7rtk\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:48.567901 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:48.567868    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6225739d-5b39-4c46-8abe-96001175df64-maas-api-tls\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:48.570260 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:48.570241    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6225739d-5b39-4c46-8abe-96001175df64-maas-api-tls\") pod \"maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:48.811992 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:48.811942    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:48.948929 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:48.948894    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"]
Jul 29 01:44:48.951784 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:44:48.951753    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6225739d_5b39_4c46_8abe_96001175df64.slice/crio-efc8e3821a775925835e0653f11abc75082636cfbb337995634b9621995b5916 WatchSource:0}: Error finding container efc8e3821a775925835e0653f11abc75082636cfbb337995634b9621995b5916: Status 404 returned error can't find the container with id efc8e3821a775925835e0653f11abc75082636cfbb337995634b9621995b5916
Jul 29 01:44:49.585842 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.585783    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:49.678680 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.678649    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-podinfo\") pod \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") "
Jul 29 01:44:49.678680 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.678684    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-certs\") pod \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") "
Jul 29 01:44:49.678894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.678705    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c742s\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-kube-api-access-c742s\") pod \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") "
Jul 29 01:44:49.678894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.678719    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-token\") pod \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") "
Jul 29 01:44:49.678894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.678769    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-envoy\") pod \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") "
Jul 29 01:44:49.678894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.678786    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-credential-socket\") pod \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") "
Jul 29 01:44:49.678894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.678802    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istiod-ca-cert\") pod \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") "
Jul 29 01:44:49.678894 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.678864    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-socket\") pod \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") "
Jul 29 01:44:49.679187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.678993    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-data\") pod \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\" (UID: \"27fa5171-cbaf-46c0-9881-9d6b92ea1c44\") "
Jul 29 01:44:49.679187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.679015    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27fa5171-cbaf-46c0-9881-9d6b92ea1c44" (UID: "27fa5171-cbaf-46c0-9881-9d6b92ea1c44"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:44:49.679187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.679139    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27fa5171-cbaf-46c0-9881-9d6b92ea1c44" (UID: "27fa5171-cbaf-46c0-9881-9d6b92ea1c44"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:44:49.679445 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.679253    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27fa5171-cbaf-46c0-9881-9d6b92ea1c44" (UID: "27fa5171-cbaf-46c0-9881-9d6b92ea1c44"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:44:49.679445 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.679273    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27fa5171-cbaf-46c0-9881-9d6b92ea1c44" (UID: "27fa5171-cbaf-46c0-9881-9d6b92ea1c44"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:44:49.679597 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.679494    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:49.679672 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.679630    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:49.679672 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.679644    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:49.679672 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.679656    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:49.680162 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.680136    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-data" (OuterVolumeSpecName: "istio-data") pod "27fa5171-cbaf-46c0-9881-9d6b92ea1c44" (UID: "27fa5171-cbaf-46c0-9881-9d6b92ea1c44"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:44:49.681206 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.681181    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27fa5171-cbaf-46c0-9881-9d6b92ea1c44" (UID: "27fa5171-cbaf-46c0-9881-9d6b92ea1c44"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:44:49.681293 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.681206    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27fa5171-cbaf-46c0-9881-9d6b92ea1c44" (UID: "27fa5171-cbaf-46c0-9881-9d6b92ea1c44"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:44:49.681293 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.681217    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-kube-api-access-c742s" (OuterVolumeSpecName: "kube-api-access-c742s") pod "27fa5171-cbaf-46c0-9881-9d6b92ea1c44" (UID: "27fa5171-cbaf-46c0-9881-9d6b92ea1c44"). InnerVolumeSpecName "kube-api-access-c742s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:49.681455 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.681432    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-token" (OuterVolumeSpecName: "istio-token") pod "27fa5171-cbaf-46c0-9881-9d6b92ea1c44" (UID: "27fa5171-cbaf-46c0-9881-9d6b92ea1c44"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:44:49.713099 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.713058    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr" event={"ID":"6225739d-5b39-4c46-8abe-96001175df64","Type":"ContainerStarted","Data":"7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3"}
Jul 29 01:44:49.713264 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.713232    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:44:49.713372 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.713279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr" event={"ID":"6225739d-5b39-4c46-8abe-96001175df64","Type":"ContainerStarted","Data":"efc8e3821a775925835e0653f11abc75082636cfbb337995634b9621995b5916"}
Jul 29 01:44:49.714645 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.714621    2565 generic.go:356] "Generic (PLEG): container finished" podID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerID="f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c" exitCode=0
Jul 29 01:44:49.714718 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.714653    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" event={"ID":"27fa5171-cbaf-46c0-9881-9d6b92ea1c44","Type":"ContainerDied","Data":"f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c"}
Jul 29 01:44:49.714718 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.714663    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"
Jul 29 01:44:49.714718 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.714683    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj" event={"ID":"27fa5171-cbaf-46c0-9881-9d6b92ea1c44","Type":"ContainerDied","Data":"e2153e52bc603c79b4efa803ba7df5fa1d022c0488a58b2527b122f5f3be6a18"}
Jul 29 01:44:49.714718 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.714704    2565 scope.go:117] "RemoveContainer" containerID="f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c"
Jul 29 01:44:49.723507 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.723486    2565 scope.go:117] "RemoveContainer" containerID="77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa"
Jul 29 01:44:49.731169 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.731153    2565 scope.go:117] "RemoveContainer" containerID="f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c"
Jul 29 01:44:49.731445 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:44:49.731426    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c\": container with ID starting with f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c not found: ID does not exist" containerID="f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c"
Jul 29 01:44:49.731488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.731454    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c"} err="failed to get container status \"f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c\": rpc error: code = NotFound desc = could not find container \"f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c\": container with ID starting with f0d8515cbac8a679f056eb2d08caf293c40de3a411d9add17a83676a0b72067c not found: ID does not exist"
Jul 29 01:44:49.731488 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.731472    2565 scope.go:117] "RemoveContainer" containerID="77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa"
Jul 29 01:44:49.731730 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:44:49.731701    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa\": container with ID starting with 77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa not found: ID does not exist" containerID="77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa"
Jul 29 01:44:49.731819 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.731735    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa"} err="failed to get container status \"77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa\": rpc error: code = NotFound desc = could not find container \"77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa\": container with ID starting with 77f6cf4bbc162795b8b7b917af830329785832b7ab10119517fbc547249a81aa not found: ID does not exist"
Jul 29 01:44:49.749233 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.749190    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr" podStartSLOduration=2.30718912 podStartE2EDuration="2.749176207s" totalImagesPullingTime="441.987087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:44:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:44:49.745059434 +0000 UTC m=+2066.384156242" watchObservedRunningTime="2026-07-29 01:44:49.749176207 +0000 UTC m=+2066.388273014"
Jul 29 01:44:49.768359 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.768329    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"]
Jul 29 01:44:49.780692 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.780660    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:49.780692 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.780688    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:49.780872 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.780699    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c742s\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-kube-api-access-c742s\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:49.780872 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.780712    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:49.780872 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.780723    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27fa5171-cbaf-46c0-9881-9d6b92ea1c44-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:44:49.781339 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.781295    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0187de68-openshift-default-6b8776b5c4-7j7kj"]
Jul 29 01:44:49.916767 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:49.916676    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" path="/var/lib/kubelet/pods/27fa5171-cbaf-46c0-9881-9d6b92ea1c44/volumes"
Jul 29 01:44:55.725931 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:44:55.725902    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:45:00.133429 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.133396    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m"]
Jul 29 01:45:00.133825 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.133769    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy"
Jul 29 01:45:00.133825 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.133781    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy"
Jul 29 01:45:00.133825 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.133796    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy"
Jul 29 01:45:00.133825 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.133802    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy"
Jul 29 01:45:00.133960 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.133867    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy"
Jul 29 01:45:00.133960 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.133874    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="27fa5171-cbaf-46c0-9881-9d6b92ea1c44" containerName="istio-proxy"
Jul 29 01:45:00.138059 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.138028    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f"]
Jul 29 01:45:00.139673 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.139650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m"
Jul 29 01:45:00.142698 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.142674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f"
Jul 29 01:45:00.143758 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.143739    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 01:45:00.147874 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.147851    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f"]
Jul 29 01:45:00.150666 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.150637    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m"]
Jul 29 01:45:00.154449 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.154433    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m"
Jul 29 01:45:00.162484 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.162461    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f"
Jul 29 01:45:00.306710 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.306669    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m"]
Jul 29 01:45:00.309482 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:45:00.309436    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecbdd87a_c73f_42b8_a995_2edf73f09f26.slice/crio-49f6277115515c38eabf6af6f92a947887e738188e72a2d3a5d4f1000423f00e WatchSource:0}: Error finding container 49f6277115515c38eabf6af6f92a947887e738188e72a2d3a5d4f1000423f00e: Status 404 returned error can't find the container with id 49f6277115515c38eabf6af6f92a947887e738188e72a2d3a5d4f1000423f00e
Jul 29 01:45:00.321227 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.321204    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f"]
Jul 29 01:45:00.325132 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:45:00.325104    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08957cc6_1439_4257_b101_59c06880fe1c.slice/crio-00fd99ec641c1a865039b833d05cba4c34fa9e6e9f88d276b13fb59861f1f007 WatchSource:0}: Error finding container 00fd99ec641c1a865039b833d05cba4c34fa9e6e9f88d276b13fb59861f1f007: Status 404 returned error can't find the container with id 00fd99ec641c1a865039b833d05cba4c34fa9e6e9f88d276b13fb59861f1f007
Jul 29 01:45:00.767534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.767503    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m" event={"ID":"ecbdd87a-c73f-42b8-a995-2edf73f09f26","Type":"ContainerStarted","Data":"3faf7852027dd3e6d9eb33b2ea80d7b73e9efa40054a581683544798d75a2163"}
Jul 29 01:45:00.767714 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.767553    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m" event={"ID":"ecbdd87a-c73f-42b8-a995-2edf73f09f26","Type":"ContainerStarted","Data":"49f6277115515c38eabf6af6f92a947887e738188e72a2d3a5d4f1000423f00e"}
Jul 29 01:45:00.768950 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.768919    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f" event={"ID":"08957cc6-1439-4257-b101-59c06880fe1c","Type":"ContainerStarted","Data":"c8223f317dfb0797016497aee4b5af99e68cb713b56fc6dec695c264d07ee33d"}
Jul 29 01:45:00.769081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.768968    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f" event={"ID":"08957cc6-1439-4257-b101-59c06880fe1c","Type":"ContainerStarted","Data":"00fd99ec641c1a865039b833d05cba4c34fa9e6e9f88d276b13fb59861f1f007"}
Jul 29 01:45:00.782597 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.782559    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m" podStartSLOduration=0.782546165 podStartE2EDuration="782.546165ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:45:00.781185483 +0000 UTC m=+2077.420282291" watchObservedRunningTime="2026-07-29 01:45:00.782546165 +0000 UTC m=+2077.421642972"
Jul 29 01:45:00.797193 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:00.797155    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f" podStartSLOduration=0.797141792 podStartE2EDuration="797.141792ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:45:00.79675209 +0000 UTC m=+2077.435848930" watchObservedRunningTime="2026-07-29 01:45:00.797141792 +0000 UTC m=+2077.436238599"
Jul 29 01:45:01.774563 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:01.774527    2565 generic.go:356] "Generic (PLEG): container finished" podID="ecbdd87a-c73f-42b8-a995-2edf73f09f26" containerID="3faf7852027dd3e6d9eb33b2ea80d7b73e9efa40054a581683544798d75a2163" exitCode=0
Jul 29 01:45:01.774987 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:01.774616    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m" event={"ID":"ecbdd87a-c73f-42b8-a995-2edf73f09f26","Type":"ContainerDied","Data":"3faf7852027dd3e6d9eb33b2ea80d7b73e9efa40054a581683544798d75a2163"}
Jul 29 01:45:01.776073 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:01.776043    2565 generic.go:356] "Generic (PLEG): container finished" podID="08957cc6-1439-4257-b101-59c06880fe1c" containerID="c8223f317dfb0797016497aee4b5af99e68cb713b56fc6dec695c264d07ee33d" exitCode=0
Jul 29 01:45:01.776198 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:01.776075    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f" event={"ID":"08957cc6-1439-4257-b101-59c06880fe1c","Type":"ContainerDied","Data":"c8223f317dfb0797016497aee4b5af99e68cb713b56fc6dec695c264d07ee33d"}
Jul 29 01:45:02.918623 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:02.918602    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m"
Jul 29 01:45:02.921122 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:02.921106    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f"
Jul 29 01:45:03.786370 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:03.786334    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f" event={"ID":"08957cc6-1439-4257-b101-59c06880fe1c","Type":"ContainerDied","Data":"00fd99ec641c1a865039b833d05cba4c34fa9e6e9f88d276b13fb59861f1f007"}
Jul 29 01:45:03.786537 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:03.786377    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f"
Jul 29 01:45:03.786537 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:03.786387    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00fd99ec641c1a865039b833d05cba4c34fa9e6e9f88d276b13fb59861f1f007"
Jul 29 01:45:03.787632 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:03.787615    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m"
Jul 29 01:45:03.787632 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:03.787626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754825-4m74m" event={"ID":"ecbdd87a-c73f-42b8-a995-2edf73f09f26","Type":"ContainerDied","Data":"49f6277115515c38eabf6af6f92a947887e738188e72a2d3a5d4f1000423f00e"}
Jul 29 01:45:03.787810 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:03.787657    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49f6277115515c38eabf6af6f92a947887e738188e72a2d3a5d4f1000423f00e"
Jul 29 01:45:17.568069 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.568029    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"]
Jul 29 01:45:17.568559 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.568543    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecbdd87a-c73f-42b8-a995-2edf73f09f26" containerName="cleanup"
Jul 29 01:45:17.568609 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.568562    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecbdd87a-c73f-42b8-a995-2edf73f09f26" containerName="cleanup"
Jul 29 01:45:17.568609 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.568598    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08957cc6-1439-4257-b101-59c06880fe1c" containerName="cleanup"
Jul 29 01:45:17.568609 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.568606    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="08957cc6-1439-4257-b101-59c06880fe1c" containerName="cleanup"
Jul 29 01:45:17.568709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.568688    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecbdd87a-c73f-42b8-a995-2edf73f09f26" containerName="cleanup"
Jul 29 01:45:17.568709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.568701    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="08957cc6-1439-4257-b101-59c06880fe1c" containerName="cleanup"
Jul 29 01:45:17.572244 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.572227    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"
Jul 29 01:45:17.574777 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.574754    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 01:45:17.578238 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.578212    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"]
Jul 29 01:45:17.727027 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.726991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b7aa4b-1ce1-44eb-bb34-a484764d3084-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh\" (UID: \"64b7aa4b-1ce1-44eb-bb34-a484764d3084\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"
Jul 29 01:45:17.828029 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.827949    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b7aa4b-1ce1-44eb-bb34-a484764d3084-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh\" (UID: \"64b7aa4b-1ce1-44eb-bb34-a484764d3084\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"
Jul 29 01:45:17.828593 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.828575    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b7aa4b-1ce1-44eb-bb34-a484764d3084-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh\" (UID: \"64b7aa4b-1ce1-44eb-bb34-a484764d3084\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"
Jul 29 01:45:17.885253 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:17.885222    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"
Jul 29 01:45:18.048805 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:18.048770    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"]
Jul 29 01:45:18.049792 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:45:18.049764    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b7aa4b_1ce1_44eb_bb34_a484764d3084.slice/crio-368a70bfbde44b64a91181692300de83ea663a53852c04e57258b0b847e9c5be WatchSource:0}: Error finding container 368a70bfbde44b64a91181692300de83ea663a53852c04e57258b0b847e9c5be: Status 404 returned error can't find the container with id 368a70bfbde44b64a91181692300de83ea663a53852c04e57258b0b847e9c5be
Jul 29 01:45:18.862009 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:18.861912    2565 generic.go:356] "Generic (PLEG): container finished" podID="64b7aa4b-1ce1-44eb-bb34-a484764d3084" containerID="ab88195b3399410f0e88a0529b11ee9324bfb2d98f357c17c758176dbe6d37e5" exitCode=0
Jul 29 01:45:18.862409 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:18.862000    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh" event={"ID":"64b7aa4b-1ce1-44eb-bb34-a484764d3084","Type":"ContainerDied","Data":"ab88195b3399410f0e88a0529b11ee9324bfb2d98f357c17c758176dbe6d37e5"}
Jul 29 01:45:18.862409 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:18.862051    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh" event={"ID":"64b7aa4b-1ce1-44eb-bb34-a484764d3084","Type":"ContainerStarted","Data":"368a70bfbde44b64a91181692300de83ea663a53852c04e57258b0b847e9c5be"}
Jul 29 01:45:20.000708 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:20.000678    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"
Jul 29 01:45:20.150763 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:20.150676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b7aa4b-1ce1-44eb-bb34-a484764d3084-maas-api-service-ca\") pod \"64b7aa4b-1ce1-44eb-bb34-a484764d3084\" (UID: \"64b7aa4b-1ce1-44eb-bb34-a484764d3084\") "
Jul 29 01:45:20.151082 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:20.151050    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64b7aa4b-1ce1-44eb-bb34-a484764d3084-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "64b7aa4b-1ce1-44eb-bb34-a484764d3084" (UID: "64b7aa4b-1ce1-44eb-bb34-a484764d3084"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:45:20.252006 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:20.251981    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/64b7aa4b-1ce1-44eb-bb34-a484764d3084-maas-api-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:45:20.873019 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:20.872980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh" event={"ID":"64b7aa4b-1ce1-44eb-bb34-a484764d3084","Type":"ContainerDied","Data":"368a70bfbde44b64a91181692300de83ea663a53852c04e57258b0b847e9c5be"}
Jul 29 01:45:20.873019 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:20.873011    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"
Jul 29 01:45:20.873215 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:20.873053    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="368a70bfbde44b64a91181692300de83ea663a53852c04e57258b0b847e9c5be"
Jul 29 01:45:24.089830 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:24.089799    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:45:24.095476 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:24.095457    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:45:24.097023 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:24.097005    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:45:24.102210 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:24.102195    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:45:28.549369 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.549339    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"]
Jul 29 01:45:28.549872 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.549556    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr" podUID="6225739d-5b39-4c46-8abe-96001175df64" containerName="maas-api" containerID="cri-o://7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3" gracePeriod=30
Jul 29 01:45:28.589292 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.589268    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f"]
Jul 29 01:45:28.595273 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.595251    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-ff6a497a-29754825-8vm7f"]
Jul 29 01:45:28.793494 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.793462    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:45:28.825583 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.825518    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7rtk\" (UniqueName: \"kubernetes.io/projected/6225739d-5b39-4c46-8abe-96001175df64-kube-api-access-v7rtk\") pod \"6225739d-5b39-4c46-8abe-96001175df64\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") "
Jul 29 01:45:28.825706 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.825584    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6225739d-5b39-4c46-8abe-96001175df64-maas-api-tls\") pod \"6225739d-5b39-4c46-8abe-96001175df64\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") "
Jul 29 01:45:28.825706 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.825620    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6225739d-5b39-4c46-8abe-96001175df64-openshift-service-ca\") pod \"6225739d-5b39-4c46-8abe-96001175df64\" (UID: \"6225739d-5b39-4c46-8abe-96001175df64\") "
Jul 29 01:45:28.826041 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.826002    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6225739d-5b39-4c46-8abe-96001175df64-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6225739d-5b39-4c46-8abe-96001175df64" (UID: "6225739d-5b39-4c46-8abe-96001175df64"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:45:28.828036 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.827978    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6225739d-5b39-4c46-8abe-96001175df64-kube-api-access-v7rtk" (OuterVolumeSpecName: "kube-api-access-v7rtk") pod "6225739d-5b39-4c46-8abe-96001175df64" (UID: "6225739d-5b39-4c46-8abe-96001175df64"). InnerVolumeSpecName "kube-api-access-v7rtk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:45:28.828600 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.828555    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6225739d-5b39-4c46-8abe-96001175df64-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6225739d-5b39-4c46-8abe-96001175df64" (UID: "6225739d-5b39-4c46-8abe-96001175df64"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:45:28.911805 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.911773    2565 generic.go:356] "Generic (PLEG): container finished" podID="6225739d-5b39-4c46-8abe-96001175df64" containerID="7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3" exitCode=0
Jul 29 01:45:28.911971 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.911819    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"
Jul 29 01:45:28.911971 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.911836    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr" event={"ID":"6225739d-5b39-4c46-8abe-96001175df64","Type":"ContainerDied","Data":"7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3"}
Jul 29 01:45:28.911971 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.911871    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr" event={"ID":"6225739d-5b39-4c46-8abe-96001175df64","Type":"ContainerDied","Data":"efc8e3821a775925835e0653f11abc75082636cfbb337995634b9621995b5916"}
Jul 29 01:45:28.911971 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.911892    2565 scope.go:117] "RemoveContainer" containerID="7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3"
Jul 29 01:45:28.921658 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.921633    2565 scope.go:117] "RemoveContainer" containerID="7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3"
Jul 29 01:45:28.921926 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:45:28.921907    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3\": container with ID starting with 7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3 not found: ID does not exist" containerID="7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3"
Jul 29 01:45:28.922000 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.921939    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3"} err="failed to get container status \"7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3\": rpc error: code = NotFound desc = could not find container \"7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3\": container with ID starting with 7cddbc49795c1a7c28d5cccad63e3ff92a5ce585aea6e8dcfca59d1c70290db3 not found: ID does not exist"
Jul 29 01:45:28.926432 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.926415    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7rtk\" (UniqueName: \"kubernetes.io/projected/6225739d-5b39-4c46-8abe-96001175df64-kube-api-access-v7rtk\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:45:28.926510 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.926434    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6225739d-5b39-4c46-8abe-96001175df64-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:45:28.926510 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.926443    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6225739d-5b39-4c46-8abe-96001175df64-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:45:28.960409 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.960385    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"]
Jul 29 01:45:28.974548 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.974515    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-ff6a497a-6c5d4f4ccc-wlqlr"]
Jul 29 01:45:28.983335 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:28.983297    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"]
Jul 29 01:45:29.001797 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:29.001772    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff6a497a-7n7bh"]
Jul 29 01:45:29.918540 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:29.918501    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08957cc6-1439-4257-b101-59c06880fe1c" path="/var/lib/kubelet/pods/08957cc6-1439-4257-b101-59c06880fe1c/volumes"
Jul 29 01:45:29.919631 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:29.919605    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6225739d-5b39-4c46-8abe-96001175df64" path="/var/lib/kubelet/pods/6225739d-5b39-4c46-8abe-96001175df64/volumes"
Jul 29 01:45:29.920240 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:45:29.920220    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64b7aa4b-1ce1-44eb-bb34-a484764d3084" path="/var/lib/kubelet/pods/64b7aa4b-1ce1-44eb-bb34-a484764d3084/volumes"
Jul 29 01:47:19.200948 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.200914    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"]
Jul 29 01:47:19.201423 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.201299    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6225739d-5b39-4c46-8abe-96001175df64" containerName="maas-api"
Jul 29 01:47:19.201423 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.201332    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6225739d-5b39-4c46-8abe-96001175df64" containerName="maas-api"
Jul 29 01:47:19.201423 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.201352    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64b7aa4b-1ce1-44eb-bb34-a484764d3084" containerName="revoke-keys"
Jul 29 01:47:19.201423 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.201357    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="64b7aa4b-1ce1-44eb-bb34-a484764d3084" containerName="revoke-keys"
Jul 29 01:47:19.201423 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.201409    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6225739d-5b39-4c46-8abe-96001175df64" containerName="maas-api"
Jul 29 01:47:19.201423 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.201416    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="64b7aa4b-1ce1-44eb-bb34-a484764d3084" containerName="revoke-keys"
Jul 29 01:47:19.204457 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.204441    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.207553 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.207536    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-689dd84c-openshift-default-dockercfg-wqg98\""
Jul 29 01:47:19.225277 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.225251    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"]
Jul 29 01:47:19.240446 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.240413    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-credential-socket\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.240563 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.240468    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-socket\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.240607 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.240554    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-certs\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.240650 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.240605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvh2h\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-kube-api-access-lvh2h\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.240650 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.240640    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-token\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.240729 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.240660    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ff843c-6772-4b16-8033-3d1aa762954b-istiod-ca-cert\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.240729 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.240674    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-envoy\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.240729 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.240720    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-data\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.240824 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.240750    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-podinfo\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342110 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-podinfo\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342110 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342122    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-credential-socket\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-socket\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-certs\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342211    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvh2h\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-kube-api-access-lvh2h\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342259    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-token\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342288    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ff843c-6772-4b16-8033-3d1aa762954b-istiod-ca-cert\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342319    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-envoy\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342353    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-data\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342789 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-socket\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342789 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342682    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-data\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342887 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342872    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-certs\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.342938 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.342919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-credential-socket\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.343225 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.343205    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ff843c-6772-4b16-8033-3d1aa762954b-istiod-ca-cert\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.344758 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.344727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-envoy\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.344864 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.344794    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-podinfo\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.354549 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.354522    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvh2h\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-kube-api-access-lvh2h\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.354647 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.354558    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-token\") pod \"e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") " pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.516288 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.516265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:19.651125 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.650022    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"]
Jul 29 01:47:19.652787 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:47:19.652761    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1ff843c_6772_4b16_8033_3d1aa762954b.slice/crio-9167ba21c79399c86c63a220607a6386a0529f5215442e53f165bf25d5f14a66 WatchSource:0}: Error finding container 9167ba21c79399c86c63a220607a6386a0529f5215442e53f165bf25d5f14a66: Status 404 returned error can't find the container with id 9167ba21c79399c86c63a220607a6386a0529f5215442e53f165bf25d5f14a66
Jul 29 01:47:19.654998 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.654968    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:47:19.655069 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.655042    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:47:19.655105 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:19.655070    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:47:20.420150 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:20.420118    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" event={"ID":"f1ff843c-6772-4b16-8033-3d1aa762954b","Type":"ContainerStarted","Data":"98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf"}
Jul 29 01:47:20.420535 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:20.420174    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" event={"ID":"f1ff843c-6772-4b16-8033-3d1aa762954b","Type":"ContainerStarted","Data":"9167ba21c79399c86c63a220607a6386a0529f5215442e53f165bf25d5f14a66"}
Jul 29 01:47:20.441323 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:20.441271    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" podStartSLOduration=1.441256911 podStartE2EDuration="1.441256911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:47:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:47:20.438770581 +0000 UTC m=+2217.077867607" watchObservedRunningTime="2026-07-29 01:47:20.441256911 +0000 UTC m=+2217.080353719"
Jul 29 01:47:20.516720 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:20.516697    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:20.521347 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:20.521317    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:21.424370 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:21.424341    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:21.425207 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:21.425188    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:22.766195 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.766163    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"]
Jul 29 01:47:22.770107 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.770089    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:22.772562 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.772542    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-689dd84c-serving-cert\""
Jul 29 01:47:22.772562 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.772557    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:47:22.772927 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.772913    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:47:22.773008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.772994    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:47:22.778886 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.778854    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"]
Jul 29 01:47:22.873368 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.873333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18e0742-1738-42c4-8066-0e9b348dd904-openshift-service-ca\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:22.873539 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.873395    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm9p5\" (UniqueName: \"kubernetes.io/projected/b18e0742-1738-42c4-8066-0e9b348dd904-kube-api-access-wm9p5\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:22.873539 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.873428    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18e0742-1738-42c4-8066-0e9b348dd904-maas-api-tls\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:22.974520 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.974495    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18e0742-1738-42c4-8066-0e9b348dd904-openshift-service-ca\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:22.974665 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.974533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm9p5\" (UniqueName: \"kubernetes.io/projected/b18e0742-1738-42c4-8066-0e9b348dd904-kube-api-access-wm9p5\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:22.974665 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.974577    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18e0742-1738-42c4-8066-0e9b348dd904-maas-api-tls\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:22.974794 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:47:22.974688    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-serving-cert: secret "maas-api-e2e-mt-689dd84c-serving-cert" not found
Jul 29 01:47:22.974794 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:47:22.974752    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b18e0742-1738-42c4-8066-0e9b348dd904-maas-api-tls podName:b18e0742-1738-42c4-8066-0e9b348dd904 nodeName:}" failed. No retries permitted until 2026-07-29 01:47:23.474732134 +0000 UTC m=+2220.113828922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b18e0742-1738-42c4-8066-0e9b348dd904-maas-api-tls") pod "maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg" (UID: "b18e0742-1738-42c4-8066-0e9b348dd904") : secret "maas-api-e2e-mt-689dd84c-serving-cert" not found
Jul 29 01:47:22.975264 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.975239    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18e0742-1738-42c4-8066-0e9b348dd904-openshift-service-ca\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:22.984614 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:22.984591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm9p5\" (UniqueName: \"kubernetes.io/projected/b18e0742-1738-42c4-8066-0e9b348dd904-kube-api-access-wm9p5\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:23.480346 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:23.480295    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18e0742-1738-42c4-8066-0e9b348dd904-maas-api-tls\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:23.482646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:23.482616    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18e0742-1738-42c4-8066-0e9b348dd904-maas-api-tls\") pod \"maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:23.682234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:23.682202    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:23.834752 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:23.834727    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"]
Jul 29 01:47:23.836880 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:47:23.836854    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18e0742_1738_42c4_8066_0e9b348dd904.slice/crio-85909595f820d1f7b1adf14a82185cb52c52f4dfb2cea93e42f5cdb26f050591 WatchSource:0}: Error finding container 85909595f820d1f7b1adf14a82185cb52c52f4dfb2cea93e42f5cdb26f050591: Status 404 returned error can't find the container with id 85909595f820d1f7b1adf14a82185cb52c52f4dfb2cea93e42f5cdb26f050591
Jul 29 01:47:24.439200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:24.439169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg" event={"ID":"b18e0742-1738-42c4-8066-0e9b348dd904","Type":"ContainerStarted","Data":"85909595f820d1f7b1adf14a82185cb52c52f4dfb2cea93e42f5cdb26f050591"}
Jul 29 01:47:25.445917 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:25.445877    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg" event={"ID":"b18e0742-1738-42c4-8066-0e9b348dd904","Type":"ContainerStarted","Data":"64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f"}
Jul 29 01:47:25.446335 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:25.445956    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:25.462383 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:25.462344    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg" podStartSLOduration=2.77506861 podStartE2EDuration="3.462329074s" totalImagesPullingTime="687.260464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:47:25.460841193 +0000 UTC m=+2222.099938003" watchObservedRunningTime="2026-07-29 01:47:25.462329074 +0000 UTC m=+2222.101425873"
Jul 29 01:47:31.455958 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:31.455931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:47:39.514421 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:39.514384    2565 generic.go:356] "Generic (PLEG): container finished" podID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerID="98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf" exitCode=0
Jul 29 01:47:39.514807 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:39.514455    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" event={"ID":"f1ff843c-6772-4b16-8033-3d1aa762954b","Type":"ContainerDied","Data":"98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf"}
Jul 29 01:47:39.514878 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:39.514862    2565 scope.go:117] "RemoveContainer" containerID="98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf"
Jul 29 01:47:39.515857 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:39.515828    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:47:39.515912 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:39.515895    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:47:39.515946 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:39.515924    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:47:40.520459 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:40.520431    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" event={"ID":"f1ff843c-6772-4b16-8033-3d1aa762954b","Type":"ContainerStarted","Data":"42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376"}
Jul 29 01:47:41.516962 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:41.516926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:41.517129 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:41.517065    2565 patch_prober.go:28] interesting pod/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 29 01:47:41.517129 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:41.517118    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 29 01:47:42.517597 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:42.517565    2565 patch_prober.go:28] interesting pod/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 29 01:47:42.518081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:42.517617    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 29 01:47:43.517591 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:43.517550    2565 patch_prober.go:28] interesting pod/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 29 01:47:43.517793 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:43.517619    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 29 01:47:44.517450 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:44.517367    2565 patch_prober.go:28] interesting pod/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Jul 29 01:47:44.517450 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:44.517422    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Jul 29 01:47:45.520744 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:45.520709    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:45.521122 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:45.520972    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:47:45.521658 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:47:45.521642    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:48:05.316208 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.316178    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"]
Jul 29 01:48:05.316734 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.316386    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg" podUID="b18e0742-1738-42c4-8066-0e9b348dd904" containerName="maas-api" containerID="cri-o://64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f" gracePeriod=30
Jul 29 01:48:05.569449 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.569386    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:48:05.640541 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.640508    2565 generic.go:356] "Generic (PLEG): container finished" podID="b18e0742-1738-42c4-8066-0e9b348dd904" containerID="64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f" exitCode=0
Jul 29 01:48:05.640678 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.640552    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"
Jul 29 01:48:05.640678 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.640596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg" event={"ID":"b18e0742-1738-42c4-8066-0e9b348dd904","Type":"ContainerDied","Data":"64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f"}
Jul 29 01:48:05.640678 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.640647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg" event={"ID":"b18e0742-1738-42c4-8066-0e9b348dd904","Type":"ContainerDied","Data":"85909595f820d1f7b1adf14a82185cb52c52f4dfb2cea93e42f5cdb26f050591"}
Jul 29 01:48:05.640779 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.640669    2565 scope.go:117] "RemoveContainer" containerID="64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f"
Jul 29 01:48:05.642923 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.642905    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18e0742-1738-42c4-8066-0e9b348dd904-maas-api-tls\") pod \"b18e0742-1738-42c4-8066-0e9b348dd904\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") "
Jul 29 01:48:05.642997 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.642968    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm9p5\" (UniqueName: \"kubernetes.io/projected/b18e0742-1738-42c4-8066-0e9b348dd904-kube-api-access-wm9p5\") pod \"b18e0742-1738-42c4-8066-0e9b348dd904\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") "
Jul 29 01:48:05.643040 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.643013    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18e0742-1738-42c4-8066-0e9b348dd904-openshift-service-ca\") pod \"b18e0742-1738-42c4-8066-0e9b348dd904\" (UID: \"b18e0742-1738-42c4-8066-0e9b348dd904\") "
Jul 29 01:48:05.643411 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.643386    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b18e0742-1738-42c4-8066-0e9b348dd904-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b18e0742-1738-42c4-8066-0e9b348dd904" (UID: "b18e0742-1738-42c4-8066-0e9b348dd904"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:48:05.645086 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.645066    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b18e0742-1738-42c4-8066-0e9b348dd904-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b18e0742-1738-42c4-8066-0e9b348dd904" (UID: "b18e0742-1738-42c4-8066-0e9b348dd904"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:48:05.645506 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.645486    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b18e0742-1738-42c4-8066-0e9b348dd904-kube-api-access-wm9p5" (OuterVolumeSpecName: "kube-api-access-wm9p5") pod "b18e0742-1738-42c4-8066-0e9b348dd904" (UID: "b18e0742-1738-42c4-8066-0e9b348dd904"). InnerVolumeSpecName "kube-api-access-wm9p5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:48:05.650779 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.650760    2565 scope.go:117] "RemoveContainer" containerID="64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f"
Jul 29 01:48:05.651067 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:48:05.651049    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f\": container with ID starting with 64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f not found: ID does not exist" containerID="64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f"
Jul 29 01:48:05.651127 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.651074    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f"} err="failed to get container status \"64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f\": rpc error: code = NotFound desc = could not find container \"64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f\": container with ID starting with 64cc17c73c04c47dcc6df8b5d3f0582c43feeae6efa52200a829847d5ce3577f not found: ID does not exist"
Jul 29 01:48:05.743725 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.743698    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b18e0742-1738-42c4-8066-0e9b348dd904-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:05.743725 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.743722    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm9p5\" (UniqueName: \"kubernetes.io/projected/b18e0742-1738-42c4-8066-0e9b348dd904-kube-api-access-wm9p5\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:05.743876 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.743732    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b18e0742-1738-42c4-8066-0e9b348dd904-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:05.956246 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.956214    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"]
Jul 29 01:48:05.962779 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:05.962751    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-689dd84c-7b9cfccf67-whwzg"]
Jul 29 01:48:07.915801 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:07.915769    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b18e0742-1738-42c4-8066-0e9b348dd904" path="/var/lib/kubelet/pods/b18e0742-1738-42c4-8066-0e9b348dd904/volumes"
Jul 29 01:48:11.806914 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:11.806884    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"]
Jul 29 01:48:11.807282 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:11.807118    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy" containerID="cri-o://42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376" gracePeriod=30
Jul 29 01:48:15.523634 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:15.523595    2565 patch_prober.go:28] interesting pod/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 01:48:15.524057 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:15.523659    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 01:48:17.063729 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.063700    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:48:17.140885 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.140814    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvh2h\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-kube-api-access-lvh2h\") pod \"f1ff843c-6772-4b16-8033-3d1aa762954b\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") "
Jul 29 01:48:17.140885 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.140878    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-podinfo\") pod \"f1ff843c-6772-4b16-8033-3d1aa762954b\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") "
Jul 29 01:48:17.141095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.140898    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ff843c-6772-4b16-8033-3d1aa762954b-istiod-ca-cert\") pod \"f1ff843c-6772-4b16-8033-3d1aa762954b\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") "
Jul 29 01:48:17.141095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.140916    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-token\") pod \"f1ff843c-6772-4b16-8033-3d1aa762954b\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") "
Jul 29 01:48:17.141095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.140937    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-envoy\") pod \"f1ff843c-6772-4b16-8033-3d1aa762954b\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") "
Jul 29 01:48:17.141095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.140952    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-data\") pod \"f1ff843c-6772-4b16-8033-3d1aa762954b\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") "
Jul 29 01:48:17.141095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141030    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-credential-socket\") pod \"f1ff843c-6772-4b16-8033-3d1aa762954b\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") "
Jul 29 01:48:17.141095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141056    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-socket\") pod \"f1ff843c-6772-4b16-8033-3d1aa762954b\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") "
Jul 29 01:48:17.141390 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-certs\") pod \"f1ff843c-6772-4b16-8033-3d1aa762954b\" (UID: \"f1ff843c-6772-4b16-8033-3d1aa762954b\") "
Jul 29 01:48:17.141390 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141327    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1ff843c-6772-4b16-8033-3d1aa762954b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f1ff843c-6772-4b16-8033-3d1aa762954b" (UID: "f1ff843c-6772-4b16-8033-3d1aa762954b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:48:17.141504 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141394    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f1ff843c-6772-4b16-8033-3d1aa762954b" (UID: "f1ff843c-6772-4b16-8033-3d1aa762954b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:48:17.141504 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141492    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:17.141622 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141510    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f1ff843c-6772-4b16-8033-3d1aa762954b-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:17.141622 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141554    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f1ff843c-6772-4b16-8033-3d1aa762954b" (UID: "f1ff843c-6772-4b16-8033-3d1aa762954b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:48:17.141622 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f1ff843c-6772-4b16-8033-3d1aa762954b" (UID: "f1ff843c-6772-4b16-8033-3d1aa762954b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:48:17.141942 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.141919    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-data" (OuterVolumeSpecName: "istio-data") pod "f1ff843c-6772-4b16-8033-3d1aa762954b" (UID: "f1ff843c-6772-4b16-8033-3d1aa762954b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:48:17.143210 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.143189    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f1ff843c-6772-4b16-8033-3d1aa762954b" (UID: "f1ff843c-6772-4b16-8033-3d1aa762954b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:48:17.143701 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.143678    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f1ff843c-6772-4b16-8033-3d1aa762954b" (UID: "f1ff843c-6772-4b16-8033-3d1aa762954b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:48:17.143701 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.143686    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f1ff843c-6772-4b16-8033-3d1aa762954b" (UID: "f1ff843c-6772-4b16-8033-3d1aa762954b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:48:17.143821 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.143680    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-kube-api-access-lvh2h" (OuterVolumeSpecName: "kube-api-access-lvh2h") pod "f1ff843c-6772-4b16-8033-3d1aa762954b" (UID: "f1ff843c-6772-4b16-8033-3d1aa762954b"). InnerVolumeSpecName "kube-api-access-lvh2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:48:17.242255 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.242223    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:17.242255 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.242251    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvh2h\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-kube-api-access-lvh2h\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:17.242255 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.242260    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:17.242491 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.242269    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:17.242491 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.242278    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:17.242491 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.242285    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:17.242491 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.242292    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f1ff843c-6772-4b16-8033-3d1aa762954b-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:48:17.697140 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.697103    2565 generic.go:356] "Generic (PLEG): container finished" podID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerID="42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376" exitCode=0
Jul 29 01:48:17.697289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.697143    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" event={"ID":"f1ff843c-6772-4b16-8033-3d1aa762954b","Type":"ContainerDied","Data":"42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376"}
Jul 29 01:48:17.697289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.697161    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"
Jul 29 01:48:17.697289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.697205    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8" event={"ID":"f1ff843c-6772-4b16-8033-3d1aa762954b","Type":"ContainerDied","Data":"9167ba21c79399c86c63a220607a6386a0529f5215442e53f165bf25d5f14a66"}
Jul 29 01:48:17.697289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.697232    2565 scope.go:117] "RemoveContainer" containerID="42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376"
Jul 29 01:48:17.706137 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.706121    2565 scope.go:117] "RemoveContainer" containerID="98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf"
Jul 29 01:48:17.713789 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.713771    2565 scope.go:117] "RemoveContainer" containerID="42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376"
Jul 29 01:48:17.714005 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:48:17.713988    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376\": container with ID starting with 42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376 not found: ID does not exist" containerID="42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376"
Jul 29 01:48:17.714059 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.714013    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376"} err="failed to get container status \"42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376\": rpc error: code = NotFound desc = could not find container \"42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376\": container with ID starting with 42a989213c285370a5695a5a1207440d2636d0910f32cc5649a25de497cd6376 not found: ID does not exist"
Jul 29 01:48:17.714059 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.714028    2565 scope.go:117] "RemoveContainer" containerID="98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf"
Jul 29 01:48:17.714236 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:48:17.714217    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf\": container with ID starting with 98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf not found: ID does not exist" containerID="98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf"
Jul 29 01:48:17.714289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.714247    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf"} err="failed to get container status \"98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf\": rpc error: code = NotFound desc = could not find container \"98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf\": container with ID starting with 98a9ef7409e9cc2f288c25f7e759be3827fcb9b38c568c5ae268da39cea1fbbf not found: ID does not exist"
Jul 29 01:48:17.718425 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.718404    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"]
Jul 29 01:48:17.721958 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.721939    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-689dd84c-openshift-default-757fb799b4-7djh8"]
Jul 29 01:48:17.915395 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:17.915371    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" path="/var/lib/kubelet/pods/f1ff843c-6772-4b16-8033-3d1aa762954b/volumes"
Jul 29 01:48:31.682700 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.682662    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"]
Jul 29 01:48:31.683046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.682992    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b18e0742-1738-42c4-8066-0e9b348dd904" containerName="maas-api"
Jul 29 01:48:31.683046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.683003    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b18e0742-1738-42c4-8066-0e9b348dd904" containerName="maas-api"
Jul 29 01:48:31.683046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.683015    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy"
Jul 29 01:48:31.683046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.683021    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy"
Jul 29 01:48:31.683046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.683030    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy"
Jul 29 01:48:31.683046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.683035    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy"
Jul 29 01:48:31.683237 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.683088    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy"
Jul 29 01:48:31.683237 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.683097    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b18e0742-1738-42c4-8066-0e9b348dd904" containerName="maas-api"
Jul 29 01:48:31.686117 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.686100    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.688704 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.688682    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-12321b47-openshift-default-dockercfg-8ljcm\""
Jul 29 01:48:31.697114 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.697092    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"]
Jul 29 01:48:31.758951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.758910    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-credential-socket\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.758951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.758953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-podinfo\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.759155 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.758987    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-socket\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.759155 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.759062    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-data\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.759155 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.759107    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-certs\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.759155 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.759133    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-token\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.759368 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.759168    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-envoy\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.759368 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.759212    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istiod-ca-cert\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.759368 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.759232    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqnwn\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-kube-api-access-bqnwn\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.859836 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.859800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istiod-ca-cert\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.859836 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.859837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqnwn\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-kube-api-access-bqnwn\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860054 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860021    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-credential-socket\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-podinfo\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860171 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860135    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-socket\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860238 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860220    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-data\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860288 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860277    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-certs\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860377 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-credential-socket\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860377 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860341    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-token\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860482 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860373    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-envoy\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860519    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-socket\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860587 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860574    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-certs\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860644 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860622    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istiod-ca-cert\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.860730 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.860707    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-data\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.862610 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.862591    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-envoy\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.862705 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.862690    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-podinfo\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.868205 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.868179    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-token\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.868471 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.868449    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqnwn\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-kube-api-access-bqnwn\") pod \"e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") " pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:31.996449 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:31.996383    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:32.130022 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:32.130001    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"]
Jul 29 01:48:32.132020 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:48:32.131995    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7703ea24_845e_4a00_88d7_5ea1a2ab1524.slice/crio-647d94a61cb6d8be401419d5dd770addec732033a659f071bdb80ff573664646 WatchSource:0}: Error finding container 647d94a61cb6d8be401419d5dd770addec732033a659f071bdb80ff573664646: Status 404 returned error can't find the container with id 647d94a61cb6d8be401419d5dd770addec732033a659f071bdb80ff573664646
Jul 29 01:48:32.134169 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:32.134141    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:48:32.134238 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:32.134205    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:48:32.134238 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:32.134232    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:48:32.767656 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:32.767619    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" event={"ID":"7703ea24-845e-4a00-88d7-5ea1a2ab1524","Type":"ContainerStarted","Data":"01b916cbcca2cd6ad287884fd70ff63fc11cfa100f05205f4ee3f07a7185d47c"}
Jul 29 01:48:32.768046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:32.767685    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" event={"ID":"7703ea24-845e-4a00-88d7-5ea1a2ab1524","Type":"ContainerStarted","Data":"647d94a61cb6d8be401419d5dd770addec732033a659f071bdb80ff573664646"}
Jul 29 01:48:32.789035 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:32.788987    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" podStartSLOduration=1.7889720489999998 podStartE2EDuration="1.788972049s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:48:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:48:32.787214361 +0000 UTC m=+2289.426311170" watchObservedRunningTime="2026-07-29 01:48:32.788972049 +0000 UTC m=+2289.428068858"
Jul 29 01:48:32.996826 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:32.996801    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:34.002333 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.002275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:34.776839 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.776806    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:34.783897 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.783873    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:34.823374 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.823340    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"]
Jul 29 01:48:34.823978 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.823958    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1ff843c-6772-4b16-8033-3d1aa762954b" containerName="istio-proxy"
Jul 29 01:48:34.827570 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.827547    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:34.829962 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.829940    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-12321b47-serving-cert\""
Jul 29 01:48:34.829962 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.829955    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:48:34.830127 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.829999    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:48:34.830127 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.829955    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:48:34.836376 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.836155    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"]
Jul 29 01:48:34.888573 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.888547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zpnh\" (UniqueName: \"kubernetes.io/projected/58f40b93-6147-4afc-aaa3-6ec320891b5b-kube-api-access-8zpnh\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:34.888698 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.888605    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58f40b93-6147-4afc-aaa3-6ec320891b5b-maas-api-tls\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:34.888849 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.888826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f40b93-6147-4afc-aaa3-6ec320891b5b-openshift-service-ca\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:34.989523 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.989484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zpnh\" (UniqueName: \"kubernetes.io/projected/58f40b93-6147-4afc-aaa3-6ec320891b5b-kube-api-access-8zpnh\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:34.989710 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.989536    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58f40b93-6147-4afc-aaa3-6ec320891b5b-maas-api-tls\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:34.989710 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:48:34.989625    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-serving-cert: secret "maas-api-e2e-mt-12321b47-serving-cert" not found
Jul 29 01:48:34.989710 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:48:34.989680    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f40b93-6147-4afc-aaa3-6ec320891b5b-maas-api-tls podName:58f40b93-6147-4afc-aaa3-6ec320891b5b nodeName:}" failed. No retries permitted until 2026-07-29 01:48:35.489658494 +0000 UTC m=+2292.128755280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/58f40b93-6147-4afc-aaa3-6ec320891b5b-maas-api-tls") pod "maas-api-e2e-mt-12321b47-b69cd496f-6xk24" (UID: "58f40b93-6147-4afc-aaa3-6ec320891b5b") : secret "maas-api-e2e-mt-12321b47-serving-cert" not found
Jul 29 01:48:34.989841 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.989755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f40b93-6147-4afc-aaa3-6ec320891b5b-openshift-service-ca\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:34.990342 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.990324    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f40b93-6147-4afc-aaa3-6ec320891b5b-openshift-service-ca\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:34.998455 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:34.998434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zpnh\" (UniqueName: \"kubernetes.io/projected/58f40b93-6147-4afc-aaa3-6ec320891b5b-kube-api-access-8zpnh\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:35.494202 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:35.494169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58f40b93-6147-4afc-aaa3-6ec320891b5b-maas-api-tls\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:35.497615 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:35.497584    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58f40b93-6147-4afc-aaa3-6ec320891b5b-maas-api-tls\") pod \"maas-api-e2e-mt-12321b47-b69cd496f-6xk24\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:35.745067 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:35.744993    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:35.892130 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:35.892106    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"]
Jul 29 01:48:35.894798 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:48:35.894765    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f40b93_6147_4afc_aaa3_6ec320891b5b.slice/crio-24b404a0b604509cfa9741d64e2f7b6127a12599305c00282c98bcf0fef33b8c WatchSource:0}: Error finding container 24b404a0b604509cfa9741d64e2f7b6127a12599305c00282c98bcf0fef33b8c: Status 404 returned error can't find the container with id 24b404a0b604509cfa9741d64e2f7b6127a12599305c00282c98bcf0fef33b8c
Jul 29 01:48:35.896347 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:35.896302    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:48:36.788386 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:36.788351    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24" event={"ID":"58f40b93-6147-4afc-aaa3-6ec320891b5b","Type":"ContainerStarted","Data":"63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92"}
Jul 29 01:48:36.788831 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:36.788407    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24" event={"ID":"58f40b93-6147-4afc-aaa3-6ec320891b5b","Type":"ContainerStarted","Data":"24b404a0b604509cfa9741d64e2f7b6127a12599305c00282c98bcf0fef33b8c"}
Jul 29 01:48:36.788831 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:36.788690    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:36.808138 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:36.808095    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24" podStartSLOduration=2.333733969 podStartE2EDuration="2.80808162s" totalImagesPullingTime="474.347651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:48:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:48:36.805359914 +0000 UTC m=+2293.444456723" watchObservedRunningTime="2026-07-29 01:48:36.80808162 +0000 UTC m=+2293.447178426"
Jul 29 01:48:42.804625 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:42.804589    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:48:47.857015 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:47.856985    2565 generic.go:356] "Generic (PLEG): container finished" podID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerID="01b916cbcca2cd6ad287884fd70ff63fc11cfa100f05205f4ee3f07a7185d47c" exitCode=0
Jul 29 01:48:47.857455 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:47.857034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" event={"ID":"7703ea24-845e-4a00-88d7-5ea1a2ab1524","Type":"ContainerDied","Data":"01b916cbcca2cd6ad287884fd70ff63fc11cfa100f05205f4ee3f07a7185d47c"}
Jul 29 01:48:47.857455 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:47.857409    2565 scope.go:117] "RemoveContainer" containerID="01b916cbcca2cd6ad287884fd70ff63fc11cfa100f05205f4ee3f07a7185d47c"
Jul 29 01:48:47.858437 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:47.858403    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:48:47.858527 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:47.858471    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:48:47.858527 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:47.858505    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:48:48.863284 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:48.863249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" event={"ID":"7703ea24-845e-4a00-88d7-5ea1a2ab1524","Type":"ContainerStarted","Data":"75657ebbed11bf39cca091306142c430a4db3e903cdf9fc1d0c8856565ab2111"}
Jul 29 01:48:48.996839 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:48.996804    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:48.998128 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:48.998096    2565 patch_prober.go:28] interesting pod/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 29 01:48:48.998266 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:48.998158    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 29 01:48:49.776783 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:49.776751    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:49.997348 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:49.997280    2565 patch_prober.go:28] interesting pod/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 29 01:48:49.997837 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:49.997383    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 29 01:48:50.996844 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:50.996806    2565 patch_prober.go:28] interesting pod/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 29 01:48:50.997045 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:50.996871    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 29 01:48:51.997618 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:51.997580    2565 patch_prober.go:28] interesting pod/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Jul 29 01:48:51.998086 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:51.997646    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Jul 29 01:48:53.001280 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:53.001253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:48:53.002367 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:48:53.002351    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:49:29.351512 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:29.351475    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"]
Jul 29 01:49:29.354875 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:29.354856    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"
Jul 29 01:49:29.357182 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:29.357161    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 01:49:29.362782 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:29.362762    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"]
Jul 29 01:49:29.471762 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:29.471683    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/542e76c7-8bd7-4ef7-8fe7-a8071c93f04b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12321b47-qbrwg\" (UID: \"542e76c7-8bd7-4ef7-8fe7-a8071c93f04b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"
Jul 29 01:49:29.572499 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:29.572467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/542e76c7-8bd7-4ef7-8fe7-a8071c93f04b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12321b47-qbrwg\" (UID: \"542e76c7-8bd7-4ef7-8fe7-a8071c93f04b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"
Jul 29 01:49:29.573059 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:29.573040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/542e76c7-8bd7-4ef7-8fe7-a8071c93f04b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-12321b47-qbrwg\" (UID: \"542e76c7-8bd7-4ef7-8fe7-a8071c93f04b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"
Jul 29 01:49:29.667614 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:29.667589    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"
Jul 29 01:49:29.805970 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:29.805942    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"]
Jul 29 01:49:29.807449 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:49:29.807418    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542e76c7_8bd7_4ef7_8fe7_a8071c93f04b.slice/crio-3d214a8611bd7697053605be74e7d753e033168f9208ecc50f32685750665b5c WatchSource:0}: Error finding container 3d214a8611bd7697053605be74e7d753e033168f9208ecc50f32685750665b5c: Status 404 returned error can't find the container with id 3d214a8611bd7697053605be74e7d753e033168f9208ecc50f32685750665b5c
Jul 29 01:49:30.044965 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:30.044932    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg" event={"ID":"542e76c7-8bd7-4ef7-8fe7-a8071c93f04b","Type":"ContainerStarted","Data":"78b5caca83ba9c771d3296fbf4cf2e5628f49822cd6784b9d00debdeaa0798bb"}
Jul 29 01:49:30.045070 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:30.044987    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg" event={"ID":"542e76c7-8bd7-4ef7-8fe7-a8071c93f04b","Type":"ContainerStarted","Data":"3d214a8611bd7697053605be74e7d753e033168f9208ecc50f32685750665b5c"}
Jul 29 01:49:30.059788 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:30.059748    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg" podStartSLOduration=1.059733602 podStartE2EDuration="1.059733602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:49:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:49:30.058291398 +0000 UTC m=+2346.697388206" watchObservedRunningTime="2026-07-29 01:49:30.059733602 +0000 UTC m=+2346.698830409"
Jul 29 01:49:31.051441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:31.051407    2565 generic.go:356] "Generic (PLEG): container finished" podID="542e76c7-8bd7-4ef7-8fe7-a8071c93f04b" containerID="78b5caca83ba9c771d3296fbf4cf2e5628f49822cd6784b9d00debdeaa0798bb" exitCode=0
Jul 29 01:49:31.051795 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:31.051498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg" event={"ID":"542e76c7-8bd7-4ef7-8fe7-a8071c93f04b","Type":"ContainerDied","Data":"78b5caca83ba9c771d3296fbf4cf2e5628f49822cd6784b9d00debdeaa0798bb"}
Jul 29 01:49:32.183068 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:32.183043    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"
Jul 29 01:49:32.297508 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:32.297483    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/542e76c7-8bd7-4ef7-8fe7-a8071c93f04b-maas-api-service-ca\") pod \"542e76c7-8bd7-4ef7-8fe7-a8071c93f04b\" (UID: \"542e76c7-8bd7-4ef7-8fe7-a8071c93f04b\") "
Jul 29 01:49:32.297823 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:32.297802    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/542e76c7-8bd7-4ef7-8fe7-a8071c93f04b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "542e76c7-8bd7-4ef7-8fe7-a8071c93f04b" (UID: "542e76c7-8bd7-4ef7-8fe7-a8071c93f04b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:49:32.398602 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:32.398544    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/542e76c7-8bd7-4ef7-8fe7-a8071c93f04b-maas-api-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:49:33.062329 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:33.062284    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"
Jul 29 01:49:33.062498 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:33.062282    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg" event={"ID":"542e76c7-8bd7-4ef7-8fe7-a8071c93f04b","Type":"ContainerDied","Data":"3d214a8611bd7697053605be74e7d753e033168f9208ecc50f32685750665b5c"}
Jul 29 01:49:33.062498 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:33.062429    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d214a8611bd7697053605be74e7d753e033168f9208ecc50f32685750665b5c"
Jul 29 01:49:38.030400 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.030372    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"]
Jul 29 01:49:38.030920 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.030628    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24" podUID="58f40b93-6147-4afc-aaa3-6ec320891b5b" containerName="maas-api" containerID="cri-o://63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92" gracePeriod=30
Jul 29 01:49:38.239706 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.239583    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"]
Jul 29 01:49:38.241434 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.241413    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-12321b47-qbrwg"]
Jul 29 01:49:38.293600 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.293502    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:49:38.346352 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.346292    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f40b93-6147-4afc-aaa3-6ec320891b5b-openshift-service-ca\") pod \"58f40b93-6147-4afc-aaa3-6ec320891b5b\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") "
Jul 29 01:49:38.346509 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.346370    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58f40b93-6147-4afc-aaa3-6ec320891b5b-maas-api-tls\") pod \"58f40b93-6147-4afc-aaa3-6ec320891b5b\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") "
Jul 29 01:49:38.346557 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.346505    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zpnh\" (UniqueName: \"kubernetes.io/projected/58f40b93-6147-4afc-aaa3-6ec320891b5b-kube-api-access-8zpnh\") pod \"58f40b93-6147-4afc-aaa3-6ec320891b5b\" (UID: \"58f40b93-6147-4afc-aaa3-6ec320891b5b\") "
Jul 29 01:49:38.346637 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.346612    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58f40b93-6147-4afc-aaa3-6ec320891b5b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58f40b93-6147-4afc-aaa3-6ec320891b5b" (UID: "58f40b93-6147-4afc-aaa3-6ec320891b5b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:49:38.346825 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.346808    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58f40b93-6147-4afc-aaa3-6ec320891b5b-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:49:38.348520 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.348502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f40b93-6147-4afc-aaa3-6ec320891b5b-kube-api-access-8zpnh" (OuterVolumeSpecName: "kube-api-access-8zpnh") pod "58f40b93-6147-4afc-aaa3-6ec320891b5b" (UID: "58f40b93-6147-4afc-aaa3-6ec320891b5b"). InnerVolumeSpecName "kube-api-access-8zpnh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:49:38.348630 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.348615    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58f40b93-6147-4afc-aaa3-6ec320891b5b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58f40b93-6147-4afc-aaa3-6ec320891b5b" (UID: "58f40b93-6147-4afc-aaa3-6ec320891b5b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:49:38.447202 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.447175    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58f40b93-6147-4afc-aaa3-6ec320891b5b-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:49:38.447202 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:38.447199    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zpnh\" (UniqueName: \"kubernetes.io/projected/58f40b93-6147-4afc-aaa3-6ec320891b5b-kube-api-access-8zpnh\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:49:39.093762 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.093723    2565 generic.go:356] "Generic (PLEG): container finished" podID="58f40b93-6147-4afc-aaa3-6ec320891b5b" containerID="63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92" exitCode=0
Jul 29 01:49:39.094152 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.093789    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"
Jul 29 01:49:39.094152 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.093806    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24" event={"ID":"58f40b93-6147-4afc-aaa3-6ec320891b5b","Type":"ContainerDied","Data":"63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92"}
Jul 29 01:49:39.094152 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.093863    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24" event={"ID":"58f40b93-6147-4afc-aaa3-6ec320891b5b","Type":"ContainerDied","Data":"24b404a0b604509cfa9741d64e2f7b6127a12599305c00282c98bcf0fef33b8c"}
Jul 29 01:49:39.094152 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.093884    2565 scope.go:117] "RemoveContainer" containerID="63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92"
Jul 29 01:49:39.108721 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.108181    2565 scope.go:117] "RemoveContainer" containerID="63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92"
Jul 29 01:49:39.108904 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:49:39.108872    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92\": container with ID starting with 63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92 not found: ID does not exist" containerID="63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92"
Jul 29 01:49:39.109017 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.108915    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92"} err="failed to get container status \"63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92\": rpc error: code = NotFound desc = could not find container \"63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92\": container with ID starting with 63ec7008cf059f4c9f4c40c14688ca257fde08a5eb4a6e5cf13df1381042bc92 not found: ID does not exist"
Jul 29 01:49:39.120896 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.120843    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"]
Jul 29 01:49:39.122736 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.122707    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-12321b47-b69cd496f-6xk24"]
Jul 29 01:49:39.917217 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.917184    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="542e76c7-8bd7-4ef7-8fe7-a8071c93f04b" path="/var/lib/kubelet/pods/542e76c7-8bd7-4ef7-8fe7-a8071c93f04b/volumes"
Jul 29 01:49:39.917614 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:49:39.917599    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58f40b93-6147-4afc-aaa3-6ec320891b5b" path="/var/lib/kubelet/pods/58f40b93-6147-4afc-aaa3-6ec320891b5b/volumes"
Jul 29 01:50:15.103829 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:15.103798    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"]
Jul 29 01:50:15.104301 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:15.104014    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy" containerID="cri-o://75657ebbed11bf39cca091306142c430a4db3e903cdf9fc1d0c8856565ab2111" gracePeriod=30
Jul 29 01:50:20.295915 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.295864    2565 generic.go:356] "Generic (PLEG): container finished" podID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerID="75657ebbed11bf39cca091306142c430a4db3e903cdf9fc1d0c8856565ab2111" exitCode=0
Jul 29 01:50:20.296363 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.295950    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" event={"ID":"7703ea24-845e-4a00-88d7-5ea1a2ab1524","Type":"ContainerDied","Data":"75657ebbed11bf39cca091306142c430a4db3e903cdf9fc1d0c8856565ab2111"}
Jul 29 01:50:20.296363 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.296017    2565 scope.go:117] "RemoveContainer" containerID="01b916cbcca2cd6ad287884fd70ff63fc11cfa100f05205f4ee3f07a7185d47c"
Jul 29 01:50:20.357608 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.357585    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:50:20.504572 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504486    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-envoy\") pod \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") "
Jul 29 01:50:20.504572 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504534    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-credential-socket\") pod \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") "
Jul 29 01:50:20.504572 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504564    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-token\") pod \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") "
Jul 29 01:50:20.504883 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504588    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqnwn\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-kube-api-access-bqnwn\") pod \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") "
Jul 29 01:50:20.504883 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504618    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-podinfo\") pod \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") "
Jul 29 01:50:20.504883 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504673    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-certs\") pod \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") "
Jul 29 01:50:20.504883 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504713    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-socket\") pod \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") "
Jul 29 01:50:20.504883 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504761    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-data\") pod \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") "
Jul 29 01:50:20.504883 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504799    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istiod-ca-cert\") pod \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\" (UID: \"7703ea24-845e-4a00-88d7-5ea1a2ab1524\") "
Jul 29 01:50:20.504883 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.504847    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7703ea24-845e-4a00-88d7-5ea1a2ab1524" (UID: "7703ea24-845e-4a00-88d7-5ea1a2ab1524"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:20.505289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.505025    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7703ea24-845e-4a00-88d7-5ea1a2ab1524" (UID: "7703ea24-845e-4a00-88d7-5ea1a2ab1524"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:20.505289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.505134    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:50:20.505289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.505172    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:50:20.505479 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.505299    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7703ea24-845e-4a00-88d7-5ea1a2ab1524" (UID: "7703ea24-845e-4a00-88d7-5ea1a2ab1524"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:50:20.505956 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.505922    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7703ea24-845e-4a00-88d7-5ea1a2ab1524" (UID: "7703ea24-845e-4a00-88d7-5ea1a2ab1524"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:20.506138 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.506116    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-data" (OuterVolumeSpecName: "istio-data") pod "7703ea24-845e-4a00-88d7-5ea1a2ab1524" (UID: "7703ea24-845e-4a00-88d7-5ea1a2ab1524"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:20.507566 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.507529    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7703ea24-845e-4a00-88d7-5ea1a2ab1524" (UID: "7703ea24-845e-4a00-88d7-5ea1a2ab1524"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:50:20.507889 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.507849    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7703ea24-845e-4a00-88d7-5ea1a2ab1524" (UID: "7703ea24-845e-4a00-88d7-5ea1a2ab1524"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:50:20.507889 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.507875    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-kube-api-access-bqnwn" (OuterVolumeSpecName: "kube-api-access-bqnwn") pod "7703ea24-845e-4a00-88d7-5ea1a2ab1524" (UID: "7703ea24-845e-4a00-88d7-5ea1a2ab1524"). InnerVolumeSpecName "kube-api-access-bqnwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:50:20.508425 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.508402    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-token" (OuterVolumeSpecName: "istio-token") pod "7703ea24-845e-4a00-88d7-5ea1a2ab1524" (UID: "7703ea24-845e-4a00-88d7-5ea1a2ab1524"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:50:20.606433 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.606405    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:50:20.606433 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.606429    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:50:20.606433 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.606438    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqnwn\" (UniqueName: \"kubernetes.io/projected/7703ea24-845e-4a00-88d7-5ea1a2ab1524-kube-api-access-bqnwn\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:50:20.606690 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.606448    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:50:20.606690 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.606457    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:50:20.606690 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.606465    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:50:20.606690 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:20.606474    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7703ea24-845e-4a00-88d7-5ea1a2ab1524-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:50:21.301498 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:21.301468    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"
Jul 29 01:50:21.301498 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:21.301496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2" event={"ID":"7703ea24-845e-4a00-88d7-5ea1a2ab1524","Type":"ContainerDied","Data":"647d94a61cb6d8be401419d5dd770addec732033a659f071bdb80ff573664646"}
Jul 29 01:50:21.301970 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:21.301552    2565 scope.go:117] "RemoveContainer" containerID="75657ebbed11bf39cca091306142c430a4db3e903cdf9fc1d0c8856565ab2111"
Jul 29 01:50:21.322876 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:21.322855    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"]
Jul 29 01:50:21.328362 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:21.328341    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-12321b47-openshift-default-78d6f574d8-dfmd2"]
Jul 29 01:50:21.916423 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:21.916388    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" path="/var/lib/kubelet/pods/7703ea24-845e-4a00-88d7-5ea1a2ab1524/volumes"
Jul 29 01:50:23.974665 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:23.974635    2565 scope.go:117] "RemoveContainer" containerID="f10bd924c09145fdc947ccab30034b9c3ec93011df211ac8d22e82882a75011a"
Jul 29 01:50:24.119907 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:24.119880    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:50:24.127223 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:24.127200    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:50:24.128497 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:24.128475    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:50:24.134447 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:50:24.134427    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:51:10.826898 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.826823    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"]
Jul 29 01:51:10.827360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827184    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy"
Jul 29 01:51:10.827360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827201    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy"
Jul 29 01:51:10.827360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827215    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy"
Jul 29 01:51:10.827360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827225    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy"
Jul 29 01:51:10.827360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827245    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f40b93-6147-4afc-aaa3-6ec320891b5b" containerName="maas-api"
Jul 29 01:51:10.827360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827254    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f40b93-6147-4afc-aaa3-6ec320891b5b" containerName="maas-api"
Jul 29 01:51:10.827360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827262    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="542e76c7-8bd7-4ef7-8fe7-a8071c93f04b" containerName="revoke-keys"
Jul 29 01:51:10.827360 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827271    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="542e76c7-8bd7-4ef7-8fe7-a8071c93f04b" containerName="revoke-keys"
Jul 29 01:51:10.827677 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827384    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy"
Jul 29 01:51:10.827677 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827397    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="58f40b93-6147-4afc-aaa3-6ec320891b5b" containerName="maas-api"
Jul 29 01:51:10.827677 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827408    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7703ea24-845e-4a00-88d7-5ea1a2ab1524" containerName="istio-proxy"
Jul 29 01:51:10.827677 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.827419    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="542e76c7-8bd7-4ef7-8fe7-a8071c93f04b" containerName="revoke-keys"
Jul 29 01:51:10.830459 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.830444    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:10.835280 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.835259    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-560096-openshift-default-dockercfg-zv9bg\""
Jul 29 01:51:10.847063 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.847031    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"]
Jul 29 01:51:10.942424 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.942383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-podinfo\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:10.942640 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.942433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mstx\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-kube-api-access-5mstx\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:10.942640 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.942519    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bde01fa-4686-4d94-ad7f-01384ba75f90-istiod-ca-cert\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:10.942640 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.942572    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-envoy\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:10.942640 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.942596    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-credential-socket\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:10.942815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.942641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-data\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:10.942815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.942675    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-certs\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:10.942815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.942725    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-token\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:10.942815 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:10.942741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-socket\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.043421 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043385    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bde01fa-4686-4d94-ad7f-01384ba75f90-istiod-ca-cert\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.043603 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043445    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-envoy\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.043603 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043467    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-credential-socket\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.043708 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043663    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-data\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.043767 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043721    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-certs\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.043819 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043802    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-token\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.043869 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043832    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-socket\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.043924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043888    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-podinfo\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.043924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mstx\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-kube-api-access-5mstx\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.044039 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.043934    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-credential-socket\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.044039 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.044009    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-data\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.044197 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.044173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bde01fa-4686-4d94-ad7f-01384ba75f90-istiod-ca-cert\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.044356 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.044336    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-certs\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.044428 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.044383    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-socket\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.046189 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.046168    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-envoy\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.046494 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.046475    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-podinfo\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.059507 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.059478    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-token\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.060873 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.060856    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mstx\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-kube-api-access-5mstx\") pod \"e2e-inf-a-560096-openshift-default-7b88889b78-4bskx\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") " pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.140994 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.140914    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:11.285734 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.285708    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"]
Jul 29 01:51:11.288078 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:51:11.288054    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bde01fa_4686_4d94_ad7f_01384ba75f90.slice/crio-a3123d24e814881a79a8ce27eefffbc44c7185ea457b6fad1130769277128b38 WatchSource:0}: Error finding container a3123d24e814881a79a8ce27eefffbc44c7185ea457b6fad1130769277128b38: Status 404 returned error can't find the container with id a3123d24e814881a79a8ce27eefffbc44c7185ea457b6fad1130769277128b38
Jul 29 01:51:11.290185 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.290150    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:11.290260 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.290214    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:11.290260 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.290241    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:11.542755 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.542719    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" event={"ID":"9bde01fa-4686-4d94-ad7f-01384ba75f90","Type":"ContainerStarted","Data":"c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570"}
Jul 29 01:51:11.542918 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.542774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" event={"ID":"9bde01fa-4686-4d94-ad7f-01384ba75f90","Type":"ContainerStarted","Data":"a3123d24e814881a79a8ce27eefffbc44c7185ea457b6fad1130769277128b38"}
Jul 29 01:51:11.561816 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:11.561764    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" podStartSLOduration=1.561747738 podStartE2EDuration="1.561747738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:51:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:51:11.560924351 +0000 UTC m=+2448.200021162" watchObservedRunningTime="2026-07-29 01:51:11.561747738 +0000 UTC m=+2448.200844545"
Jul 29 01:51:12.141953 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:12.141920    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:12.147295 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:12.147263    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:12.547463 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:12.547433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:12.548363 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:12.548343    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:13.759923 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.759883    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"]
Jul 29 01:51:13.763784 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.763759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:13.765951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.765930    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-560096-serving-cert\""
Jul 29 01:51:13.766323 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.766117    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:51:13.766323 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.766140    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:51:13.766869 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.766851    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:51:13.775635 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.775610    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"]
Jul 29 01:51:13.872649 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.872606    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzrpj\" (UniqueName: \"kubernetes.io/projected/44562cef-037c-4bdc-82c8-57af2762a67c-kube-api-access-kzrpj\") pod \"maas-api-e2e-inf-a-560096-66b4584595-qn8fm\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:13.872855 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.872665    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44562cef-037c-4bdc-82c8-57af2762a67c-maas-api-tls\") pod \"maas-api-e2e-inf-a-560096-66b4584595-qn8fm\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:13.872855 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.872691    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44562cef-037c-4bdc-82c8-57af2762a67c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-560096-66b4584595-qn8fm\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:13.973531 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.973498    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44562cef-037c-4bdc-82c8-57af2762a67c-maas-api-tls\") pod \"maas-api-e2e-inf-a-560096-66b4584595-qn8fm\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:13.973531 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.973534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44562cef-037c-4bdc-82c8-57af2762a67c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-560096-66b4584595-qn8fm\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:13.973768 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.973625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzrpj\" (UniqueName: \"kubernetes.io/projected/44562cef-037c-4bdc-82c8-57af2762a67c-kube-api-access-kzrpj\") pod \"maas-api-e2e-inf-a-560096-66b4584595-qn8fm\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:13.974254 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.974236    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44562cef-037c-4bdc-82c8-57af2762a67c-openshift-service-ca\") pod \"maas-api-e2e-inf-a-560096-66b4584595-qn8fm\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:13.976045 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.976013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44562cef-037c-4bdc-82c8-57af2762a67c-maas-api-tls\") pod \"maas-api-e2e-inf-a-560096-66b4584595-qn8fm\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:13.982588 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:13.982555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzrpj\" (UniqueName: \"kubernetes.io/projected/44562cef-037c-4bdc-82c8-57af2762a67c-kube-api-access-kzrpj\") pod \"maas-api-e2e-inf-a-560096-66b4584595-qn8fm\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:14.076030 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:14.075991    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:14.214966 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:14.214923    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"]
Jul 29 01:51:14.216926 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:51:14.216903    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44562cef_037c_4bdc_82c8_57af2762a67c.slice/crio-4ebb9b2d0c7865863b6a4b1e92af39817d654ada36dd107f3920c4afdf2f6934 WatchSource:0}: Error finding container 4ebb9b2d0c7865863b6a4b1e92af39817d654ada36dd107f3920c4afdf2f6934: Status 404 returned error can't find the container with id 4ebb9b2d0c7865863b6a4b1e92af39817d654ada36dd107f3920c4afdf2f6934
Jul 29 01:51:14.557908 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:14.557872    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm" event={"ID":"44562cef-037c-4bdc-82c8-57af2762a67c","Type":"ContainerStarted","Data":"4ebb9b2d0c7865863b6a4b1e92af39817d654ada36dd107f3920c4afdf2f6934"}
Jul 29 01:51:15.564474 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:15.564435    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm" event={"ID":"44562cef-037c-4bdc-82c8-57af2762a67c","Type":"ContainerStarted","Data":"6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08"}
Jul 29 01:51:15.564872 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:15.564611    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:15.582217 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:15.582168    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm" podStartSLOduration=2.101068526 podStartE2EDuration="2.582152885s" totalImagesPullingTime="481.084359ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:51:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:51:15.580774849 +0000 UTC m=+2452.219871669" watchObservedRunningTime="2026-07-29 01:51:15.582152885 +0000 UTC m=+2452.221249692"
Jul 29 01:51:21.574895 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:21.574868    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:51:24.000433 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:24.000395    2565 scope.go:117] "RemoveContainer" containerID="ab88195b3399410f0e88a0529b11ee9324bfb2d98f357c17c758176dbe6d37e5"
Jul 29 01:51:24.017893 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:24.017851    2565 scope.go:117] "RemoveContainer" containerID="c8223f317dfb0797016497aee4b5af99e68cb713b56fc6dec695c264d07ee33d"
Jul 29 01:51:28.269110 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:28.268996    2565 patch_prober.go:28] interesting pod/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": read tcp 10.134.0.2:43500->10.134.0.46:15021: read: connection reset by peer" start-of-body=
Jul 29 01:51:28.269110 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:28.269063    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": read tcp 10.134.0.2:43500->10.134.0.46:15021: read: connection reset by peer"
Jul 29 01:51:28.642296 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:28.642198    2565 generic.go:356] "Generic (PLEG): container finished" podID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerID="c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570" exitCode=0
Jul 29 01:51:28.642296 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:28.642274    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" event={"ID":"9bde01fa-4686-4d94-ad7f-01384ba75f90","Type":"ContainerDied","Data":"c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570"}
Jul 29 01:51:28.642759 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:28.642746    2565 scope.go:117] "RemoveContainer" containerID="c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570"
Jul 29 01:51:28.643875 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:28.643849    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:28.643929 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:28.643920    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:28.643966 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:28.643955    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:29.648871 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:29.648839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" event={"ID":"9bde01fa-4686-4d94-ad7f-01384ba75f90","Type":"ContainerStarted","Data":"7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2"}
Jul 29 01:51:30.141821 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:30.141785    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:30.142018 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:30.142000    2565 patch_prober.go:28] interesting pod/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 29 01:51:30.142071 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:30.142044    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 29 01:51:31.141961 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:31.141926    2565 patch_prober.go:28] interesting pod/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 29 01:51:31.142415 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:31.142011    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 29 01:51:32.141497 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:32.141459    2565 patch_prober.go:28] interesting pod/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 29 01:51:32.141656 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:32.141521    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 29 01:51:33.141998 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:33.141952    2565 patch_prober.go:28] interesting pod/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Jul 29 01:51:33.142432 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:33.142028    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Jul 29 01:51:34.144925 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:34.144897    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:34.145320 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:34.145206    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:34.145881 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:34.145866    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:51:39.223590 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.223554    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"]
Jul 29 01:51:39.226912 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.226889    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.229160 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.229143    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5ee5b9-openshift-default-dockercfg-85h74\""
Jul 29 01:51:39.243870 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.243846    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"]
Jul 29 01:51:39.309544 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.309486    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-envoy\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.309737 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.309564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-socket\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.309737 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.309594    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-data\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.309737 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.309633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-token\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.309737 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.309662    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e17647-60e7-4f2c-a458-6f05c014e6b8-istiod-ca-cert\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.309737 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.309702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-certs\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.310008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.309763    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-credential-socket\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.310008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.309812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq4dv\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-kube-api-access-cq4dv\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.310008 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.309845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-podinfo\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.410919 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.410876    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq4dv\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-kube-api-access-cq4dv\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.410919 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.410926    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-podinfo\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.410964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-envoy\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.410996    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-socket\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.411013    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-data\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.411048    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-token\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.411076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e17647-60e7-4f2c-a458-6f05c014e6b8-istiod-ca-cert\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.411115    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-certs\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.411149    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-credential-socket\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411564 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.411517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-socket\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411628 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.411565    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-data\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411628 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.411581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-credential-socket\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.411786 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.411766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-certs\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.412162 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.412137    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e17647-60e7-4f2c-a458-6f05c014e6b8-istiod-ca-cert\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.413518 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.413498    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-envoy\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.413861 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.413827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-podinfo\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.419432 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.419410    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-token\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.419557 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.419523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq4dv\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-kube-api-access-cq4dv\") pod \"e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") " pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.537195 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.537153    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:39.681484 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.681457    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"]
Jul 29 01:51:39.683065 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:51:39.683036    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e17647_60e7_4f2c_a458_6f05c014e6b8.slice/crio-35489f311bf80c8198b9992ba8592b40553758afaabbb6be0fcff29f17a1d0e2 WatchSource:0}: Error finding container 35489f311bf80c8198b9992ba8592b40553758afaabbb6be0fcff29f17a1d0e2: Status 404 returned error can't find the container with id 35489f311bf80c8198b9992ba8592b40553758afaabbb6be0fcff29f17a1d0e2
Jul 29 01:51:39.685480 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.685435    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:39.685602 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.685583    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:39.685678 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.685635    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:39.697390 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:39.697360    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" event={"ID":"66e17647-60e7-4f2c-a458-6f05c014e6b8","Type":"ContainerStarted","Data":"35489f311bf80c8198b9992ba8592b40553758afaabbb6be0fcff29f17a1d0e2"}
Jul 29 01:51:40.703921 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:40.703879    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" event={"ID":"66e17647-60e7-4f2c-a458-6f05c014e6b8","Type":"ContainerStarted","Data":"dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89"}
Jul 29 01:51:40.726961 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:40.726909    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" podStartSLOduration=1.726891743 podStartE2EDuration="1.726891743s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:51:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:51:40.724937533 +0000 UTC m=+2477.364034342" watchObservedRunningTime="2026-07-29 01:51:40.726891743 +0000 UTC m=+2477.365988551"
Jul 29 01:51:41.537805 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:41.537774    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:41.542536 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:41.542515    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:41.709249 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:41.709215    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:41.710126 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:41.710106    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:51:57.750494 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:57.750450    2565 patch_prober.go:28] interesting pod/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 01:51:57.751697 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:57.750537    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 01:51:58.792354 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:58.792321    2565 generic.go:356] "Generic (PLEG): container finished" podID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerID="dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89" exitCode=0
Jul 29 01:51:58.792705 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:58.792370    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" event={"ID":"66e17647-60e7-4f2c-a458-6f05c014e6b8","Type":"ContainerDied","Data":"dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89"}
Jul 29 01:51:58.792779 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:58.792761    2565 scope.go:117] "RemoveContainer" containerID="dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89"
Jul 29 01:51:58.793896 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:58.793862    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:58.793952 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:58.793934    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:58.793991 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:58.793967    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:51:59.809729 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:51:59.809664    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" event={"ID":"66e17647-60e7-4f2c-a458-6f05c014e6b8","Type":"ContainerStarted","Data":"d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106"}
Jul 29 01:52:00.538126 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:00.538090    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:52:00.538336 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:00.538260    2565 patch_prober.go:28] interesting pod/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 01:52:00.538387 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:00.538330    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 01:52:01.538182 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:01.538142    2565 patch_prober.go:28] interesting pod/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 01:52:01.538584 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:01.538200    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 01:52:02.538159 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:02.538126    2565 patch_prober.go:28] interesting pod/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 01:52:02.538362 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:02.538180    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 01:52:03.537736 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:03.537698    2565 patch_prober.go:28] interesting pod/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Jul 29 01:52:03.537961 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:03.537753    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Jul 29 01:52:04.541520 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:04.541486    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:52:04.541969 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:04.541869    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:52:04.542550 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:52:04.542526    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:53:33.380453 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:33.380421    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"]
Jul 29 01:53:33.383836 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:33.383821    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"
Jul 29 01:53:33.386924 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:33.386899    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 01:53:33.392372 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:33.392350    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"]
Jul 29 01:53:33.528813 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:33.528786    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ef8b93-21f8-4158-a46a-96510c6ea56b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-560096-zxlsz\" (UID: \"03ef8b93-21f8-4158-a46a-96510c6ea56b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"
Jul 29 01:53:33.630037 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:33.630005    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ef8b93-21f8-4158-a46a-96510c6ea56b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-560096-zxlsz\" (UID: \"03ef8b93-21f8-4158-a46a-96510c6ea56b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"
Jul 29 01:53:33.630692 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:33.630637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ef8b93-21f8-4158-a46a-96510c6ea56b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-560096-zxlsz\" (UID: \"03ef8b93-21f8-4158-a46a-96510c6ea56b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"
Jul 29 01:53:33.695832 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:33.695810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"
Jul 29 01:53:33.825881 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:33.825855    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"]
Jul 29 01:53:33.828242 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:53:33.828183    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03ef8b93_21f8_4158_a46a_96510c6ea56b.slice/crio-6d39b483fe6fb09985f4470131b6d280ceed4368ea503ba94ef5a8040925fdf9 WatchSource:0}: Error finding container 6d39b483fe6fb09985f4470131b6d280ceed4368ea503ba94ef5a8040925fdf9: Status 404 returned error can't find the container with id 6d39b483fe6fb09985f4470131b6d280ceed4368ea503ba94ef5a8040925fdf9
Jul 29 01:53:34.260522 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:34.260486    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz" event={"ID":"03ef8b93-21f8-4158-a46a-96510c6ea56b","Type":"ContainerStarted","Data":"78e68825adad79cd7113b900610d58a0841a70dbf556e6fd8141d2e1fe1ae82d"}
Jul 29 01:53:34.260684 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:34.260563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz" event={"ID":"03ef8b93-21f8-4158-a46a-96510c6ea56b","Type":"ContainerStarted","Data":"6d39b483fe6fb09985f4470131b6d280ceed4368ea503ba94ef5a8040925fdf9"}
Jul 29 01:53:34.279502 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:34.279412    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz" podStartSLOduration=1.279398841 podStartE2EDuration="1.279398841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:53:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:53:34.277514922 +0000 UTC m=+2590.916611732" watchObservedRunningTime="2026-07-29 01:53:34.279398841 +0000 UTC m=+2590.918495650"
Jul 29 01:53:35.266840 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:35.266808    2565 generic.go:356] "Generic (PLEG): container finished" podID="03ef8b93-21f8-4158-a46a-96510c6ea56b" containerID="78e68825adad79cd7113b900610d58a0841a70dbf556e6fd8141d2e1fe1ae82d" exitCode=0
Jul 29 01:53:35.267345 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:35.266899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz" event={"ID":"03ef8b93-21f8-4158-a46a-96510c6ea56b","Type":"ContainerDied","Data":"78e68825adad79cd7113b900610d58a0841a70dbf556e6fd8141d2e1fe1ae82d"}
Jul 29 01:53:36.402255 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:36.402235    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"
Jul 29 01:53:36.555340 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:36.555243    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ef8b93-21f8-4158-a46a-96510c6ea56b-maas-api-service-ca\") pod \"03ef8b93-21f8-4158-a46a-96510c6ea56b\" (UID: \"03ef8b93-21f8-4158-a46a-96510c6ea56b\") "
Jul 29 01:53:36.555579 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:36.555557    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03ef8b93-21f8-4158-a46a-96510c6ea56b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "03ef8b93-21f8-4158-a46a-96510c6ea56b" (UID: "03ef8b93-21f8-4158-a46a-96510c6ea56b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:53:36.656943 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:36.656906    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/03ef8b93-21f8-4158-a46a-96510c6ea56b-maas-api-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:37.277642 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:37.277615    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"
Jul 29 01:53:37.277807 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:37.277647    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz" event={"ID":"03ef8b93-21f8-4158-a46a-96510c6ea56b","Type":"ContainerDied","Data":"6d39b483fe6fb09985f4470131b6d280ceed4368ea503ba94ef5a8040925fdf9"}
Jul 29 01:53:37.277807 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:37.277688    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6d39b483fe6fb09985f4470131b6d280ceed4368ea503ba94ef5a8040925fdf9"
Jul 29 01:53:43.814863 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:43.814828    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"]
Jul 29 01:53:43.815269 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:43.815052    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm" podUID="44562cef-037c-4bdc-82c8-57af2762a67c" containerName="maas-api" containerID="cri-o://6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08" gracePeriod=30
Jul 29 01:53:44.063209 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.063136    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"]
Jul 29 01:53:44.066074 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.065841    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-560096-zxlsz"]
Jul 29 01:53:44.091696 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.091673    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:53:44.229126 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.229081    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44562cef-037c-4bdc-82c8-57af2762a67c-maas-api-tls\") pod \"44562cef-037c-4bdc-82c8-57af2762a67c\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") "
Jul 29 01:53:44.229289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.229216    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzrpj\" (UniqueName: \"kubernetes.io/projected/44562cef-037c-4bdc-82c8-57af2762a67c-kube-api-access-kzrpj\") pod \"44562cef-037c-4bdc-82c8-57af2762a67c\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") "
Jul 29 01:53:44.229289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.229260    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44562cef-037c-4bdc-82c8-57af2762a67c-openshift-service-ca\") pod \"44562cef-037c-4bdc-82c8-57af2762a67c\" (UID: \"44562cef-037c-4bdc-82c8-57af2762a67c\") "
Jul 29 01:53:44.229669 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.229647    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44562cef-037c-4bdc-82c8-57af2762a67c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "44562cef-037c-4bdc-82c8-57af2762a67c" (UID: "44562cef-037c-4bdc-82c8-57af2762a67c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:53:44.231379 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.231356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44562cef-037c-4bdc-82c8-57af2762a67c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "44562cef-037c-4bdc-82c8-57af2762a67c" (UID: "44562cef-037c-4bdc-82c8-57af2762a67c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:53:44.231478 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.231388    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44562cef-037c-4bdc-82c8-57af2762a67c-kube-api-access-kzrpj" (OuterVolumeSpecName: "kube-api-access-kzrpj") pod "44562cef-037c-4bdc-82c8-57af2762a67c" (UID: "44562cef-037c-4bdc-82c8-57af2762a67c"). InnerVolumeSpecName "kube-api-access-kzrpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:53:44.311447 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.311412    2565 generic.go:356] "Generic (PLEG): container finished" podID="44562cef-037c-4bdc-82c8-57af2762a67c" containerID="6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08" exitCode=0
Jul 29 01:53:44.311647 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.311458    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"
Jul 29 01:53:44.311647 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.311504    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm" event={"ID":"44562cef-037c-4bdc-82c8-57af2762a67c","Type":"ContainerDied","Data":"6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08"}
Jul 29 01:53:44.311647 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.311564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm" event={"ID":"44562cef-037c-4bdc-82c8-57af2762a67c","Type":"ContainerDied","Data":"4ebb9b2d0c7865863b6a4b1e92af39817d654ada36dd107f3920c4afdf2f6934"}
Jul 29 01:53:44.311647 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.311595    2565 scope.go:117] "RemoveContainer" containerID="6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08"
Jul 29 01:53:44.320661 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.320644    2565 scope.go:117] "RemoveContainer" containerID="6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08"
Jul 29 01:53:44.320907 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:53:44.320889    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08\": container with ID starting with 6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08 not found: ID does not exist" containerID="6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08"
Jul 29 01:53:44.320951 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.320915    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08"} err="failed to get container status \"6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08\": rpc error: code = NotFound desc = could not find container \"6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08\": container with ID starting with 6b94aae54362db246c544bff2a3a86640dc43fe57e56dd91ad3cd0a46f4aeb08 not found: ID does not exist"
Jul 29 01:53:44.330783 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.330744    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44562cef-037c-4bdc-82c8-57af2762a67c-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:44.330783 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.330771    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzrpj\" (UniqueName: \"kubernetes.io/projected/44562cef-037c-4bdc-82c8-57af2762a67c-kube-api-access-kzrpj\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:44.330783 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.330786    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44562cef-037c-4bdc-82c8-57af2762a67c-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:44.333095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.333067    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"]
Jul 29 01:53:44.334748 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:44.334729    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-560096-66b4584595-qn8fm"]
Jul 29 01:53:45.916976 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:45.916942    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03ef8b93-21f8-4158-a46a-96510c6ea56b" path="/var/lib/kubelet/pods/03ef8b93-21f8-4158-a46a-96510c6ea56b/volumes"
Jul 29 01:53:45.917368 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:45.917344    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44562cef-037c-4bdc-82c8-57af2762a67c" path="/var/lib/kubelet/pods/44562cef-037c-4bdc-82c8-57af2762a67c/volumes"
Jul 29 01:53:50.460119 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:50.460091    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"]
Jul 29 01:53:50.460585 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:50.460336    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy" containerID="cri-o://7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2" gracePeriod=30
Jul 29 01:53:55.710244 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.710212    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:53:55.727709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.727617    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-token\") pod \"9bde01fa-4686-4d94-ad7f-01384ba75f90\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") "
Jul 29 01:53:55.727709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.727663    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mstx\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-kube-api-access-5mstx\") pod \"9bde01fa-4686-4d94-ad7f-01384ba75f90\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") "
Jul 29 01:53:55.727709 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.727694    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-credential-socket\") pod \"9bde01fa-4686-4d94-ad7f-01384ba75f90\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") "
Jul 29 01:53:55.727970 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.727722    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-socket\") pod \"9bde01fa-4686-4d94-ad7f-01384ba75f90\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") "
Jul 29 01:53:55.727970 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.727781    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-podinfo\") pod \"9bde01fa-4686-4d94-ad7f-01384ba75f90\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") "
Jul 29 01:53:55.727970 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.727801    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-envoy\") pod \"9bde01fa-4686-4d94-ad7f-01384ba75f90\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") "
Jul 29 01:53:55.728129 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728042    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bde01fa-4686-4d94-ad7f-01384ba75f90" (UID: "9bde01fa-4686-4d94-ad7f-01384ba75f90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:55.728129 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728079    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bde01fa-4686-4d94-ad7f-01384ba75f90" (UID: "9bde01fa-4686-4d94-ad7f-01384ba75f90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:55.728243 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728130    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bde01fa-4686-4d94-ad7f-01384ba75f90-istiod-ca-cert\") pod \"9bde01fa-4686-4d94-ad7f-01384ba75f90\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") "
Jul 29 01:53:55.728243 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728189    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-certs\") pod \"9bde01fa-4686-4d94-ad7f-01384ba75f90\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") "
Jul 29 01:53:55.728364 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-data\") pod \"9bde01fa-4686-4d94-ad7f-01384ba75f90\" (UID: \"9bde01fa-4686-4d94-ad7f-01384ba75f90\") "
Jul 29 01:53:55.728569 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728508    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bde01fa-4686-4d94-ad7f-01384ba75f90" (UID: "9bde01fa-4686-4d94-ad7f-01384ba75f90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:55.728569 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728534    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bde01fa-4686-4d94-ad7f-01384ba75f90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bde01fa-4686-4d94-ad7f-01384ba75f90" (UID: "9bde01fa-4686-4d94-ad7f-01384ba75f90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:53:55.728773 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728690    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bde01fa-4686-4d94-ad7f-01384ba75f90-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:55.728773 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728707    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:55.728773 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728722    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:55.728773 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.728735    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:55.729126 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.729101    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bde01fa-4686-4d94-ad7f-01384ba75f90" (UID: "9bde01fa-4686-4d94-ad7f-01384ba75f90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:55.731355 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.731329    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bde01fa-4686-4d94-ad7f-01384ba75f90" (UID: "9bde01fa-4686-4d94-ad7f-01384ba75f90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:53:55.731475 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.731371    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bde01fa-4686-4d94-ad7f-01384ba75f90" (UID: "9bde01fa-4686-4d94-ad7f-01384ba75f90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:53:55.731921 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.731801    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-kube-api-access-5mstx" (OuterVolumeSpecName: "kube-api-access-5mstx") pod "9bde01fa-4686-4d94-ad7f-01384ba75f90" (UID: "9bde01fa-4686-4d94-ad7f-01384ba75f90"). InnerVolumeSpecName "kube-api-access-5mstx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:53:55.732558 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.732523    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bde01fa-4686-4d94-ad7f-01384ba75f90" (UID: "9bde01fa-4686-4d94-ad7f-01384ba75f90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:53:55.830269 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.830227    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:55.830269 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.830263    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:55.830269 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.830277    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mstx\" (UniqueName: \"kubernetes.io/projected/9bde01fa-4686-4d94-ad7f-01384ba75f90-kube-api-access-5mstx\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:55.830535 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.830289    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:55.830535 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:55.830301    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bde01fa-4686-4d94-ad7f-01384ba75f90-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:53:56.371985 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.371949    2565 generic.go:356] "Generic (PLEG): container finished" podID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerID="7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2" exitCode=0
Jul 29 01:53:56.372187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.372008    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"
Jul 29 01:53:56.372187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.372010    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" event={"ID":"9bde01fa-4686-4d94-ad7f-01384ba75f90","Type":"ContainerDied","Data":"7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2"}
Jul 29 01:53:56.372187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.372125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx" event={"ID":"9bde01fa-4686-4d94-ad7f-01384ba75f90","Type":"ContainerDied","Data":"a3123d24e814881a79a8ce27eefffbc44c7185ea457b6fad1130769277128b38"}
Jul 29 01:53:56.372187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.372145    2565 scope.go:117] "RemoveContainer" containerID="7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2"
Jul 29 01:53:56.387134 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.387115    2565 scope.go:117] "RemoveContainer" containerID="c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570"
Jul 29 01:53:56.394119 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.394095    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"]
Jul 29 01:53:56.395577 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.395562    2565 scope.go:117] "RemoveContainer" containerID="7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2"
Jul 29 01:53:56.395886 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:53:56.395858    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2\": container with ID starting with 7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2 not found: ID does not exist" containerID="7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2"
Jul 29 01:53:56.395940 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.395899    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2"} err="failed to get container status \"7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2\": rpc error: code = NotFound desc = could not find container \"7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2\": container with ID starting with 7f0ec174cdff1f2bde0e98983d8809dc527aa4699b179cbead627ef1ce82c4a2 not found: ID does not exist"
Jul 29 01:53:56.395940 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.395918    2565 scope.go:117] "RemoveContainer" containerID="c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570"
Jul 29 01:53:56.396235 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:53:56.396200    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570\": container with ID starting with c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570 not found: ID does not exist" containerID="c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570"
Jul 29 01:53:56.396335 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.396233    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570"} err="failed to get container status \"c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570\": rpc error: code = NotFound desc = could not find container \"c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570\": container with ID starting with c82ab5fc95a4f435389ed0e56987f3889de26047feba3ce7b94b380c28a97570 not found: ID does not exist"
Jul 29 01:53:56.398703 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:56.398684    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-560096-openshift-default-7b88889b78-4bskx"]
Jul 29 01:53:57.916106 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:53:57.916070    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" path="/var/lib/kubelet/pods/9bde01fa-4686-4d94-ad7f-01384ba75f90/volumes"
Jul 29 01:54:08.140996 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:08.140958    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"]
Jul 29 01:54:08.141590 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:08.141174    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy" containerID="cri-o://d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106" gracePeriod=30
Jul 29 01:54:11.787672 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.787638    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"]
Jul 29 01:54:11.788028 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.787972    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy"
Jul 29 01:54:11.788028 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.787982    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy"
Jul 29 01:54:11.788028 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.787992    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44562cef-037c-4bdc-82c8-57af2762a67c" containerName="maas-api"
Jul 29 01:54:11.788028 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.787997    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="44562cef-037c-4bdc-82c8-57af2762a67c" containerName="maas-api"
Jul 29 01:54:11.788028 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.788007    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy"
Jul 29 01:54:11.788028 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.788013    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy"
Jul 29 01:54:11.788028 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.788025    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03ef8b93-21f8-4158-a46a-96510c6ea56b" containerName="revoke-keys"
Jul 29 01:54:11.788028 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.788031    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="03ef8b93-21f8-4158-a46a-96510c6ea56b" containerName="revoke-keys"
Jul 29 01:54:11.788353 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.788091    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="03ef8b93-21f8-4158-a46a-96510c6ea56b" containerName="revoke-keys"
Jul 29 01:54:11.788353 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.788101    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy"
Jul 29 01:54:11.788353 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.788107    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bde01fa-4686-4d94-ad7f-01384ba75f90" containerName="istio-proxy"
Jul 29 01:54:11.788353 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.788111    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="44562cef-037c-4bdc-82c8-57af2762a67c" containerName="maas-api"
Jul 29 01:54:11.791196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.791177    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:11.793527 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.793499    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-2f7b9a-serving-cert\""
Jul 29 01:54:11.793656 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.793530    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:54:11.794197 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.794176    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:54:11.794357 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.794242    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:54:11.802097 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.802075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"]
Jul 29 01:54:11.885428 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.885392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f156855-5897-4da9-9e4c-dee0c247de3b-maas-api-tls\") pod \"maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:11.885613 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.885433    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkr28\" (UniqueName: \"kubernetes.io/projected/6f156855-5897-4da9-9e4c-dee0c247de3b-kube-api-access-dkr28\") pod \"maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:11.885613 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.885464    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f156855-5897-4da9-9e4c-dee0c247de3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:11.986318 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.986281    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f156855-5897-4da9-9e4c-dee0c247de3b-maas-api-tls\") pod \"maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:11.986483 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.986359    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkr28\" (UniqueName: \"kubernetes.io/projected/6f156855-5897-4da9-9e4c-dee0c247de3b-kube-api-access-dkr28\") pod \"maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:11.986483 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.986405    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f156855-5897-4da9-9e4c-dee0c247de3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:11.987147 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.987097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f156855-5897-4da9-9e4c-dee0c247de3b-openshift-service-ca\") pod \"maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:11.991754 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:11.991727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f156855-5897-4da9-9e4c-dee0c247de3b-maas-api-tls\") pod \"maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:12.000517 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:12.000493    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkr28\" (UniqueName: \"kubernetes.io/projected/6f156855-5897-4da9-9e4c-dee0c247de3b-kube-api-access-dkr28\") pod \"maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:12.103161 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:12.103071    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:12.250101 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:12.250077    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"]
Jul 29 01:54:12.252186 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:54:12.252154    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f156855_5897_4da9_9e4c_dee0c247de3b.slice/crio-dc11e8b248aad1b33ad0913416f6fe8587084fb5bd4d7c26562f960dafc152d3 WatchSource:0}: Error finding container dc11e8b248aad1b33ad0913416f6fe8587084fb5bd4d7c26562f960dafc152d3: Status 404 returned error can't find the container with id dc11e8b248aad1b33ad0913416f6fe8587084fb5bd4d7c26562f960dafc152d3
Jul 29 01:54:12.253595 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:12.253575    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 01:54:12.458046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:12.457966    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6" event={"ID":"6f156855-5897-4da9-9e4c-dee0c247de3b","Type":"ContainerStarted","Data":"dc11e8b248aad1b33ad0913416f6fe8587084fb5bd4d7c26562f960dafc152d3"}
Jul 29 01:54:13.400213 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.400186    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:54:13.465486 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.465408    2565 generic.go:356] "Generic (PLEG): container finished" podID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerID="d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106" exitCode=0
Jul 29 01:54:13.465486 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.465454    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"
Jul 29 01:54:13.465690 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.465488    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" event={"ID":"66e17647-60e7-4f2c-a458-6f05c014e6b8","Type":"ContainerDied","Data":"d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106"}
Jul 29 01:54:13.465690 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.465546    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2" event={"ID":"66e17647-60e7-4f2c-a458-6f05c014e6b8","Type":"ContainerDied","Data":"35489f311bf80c8198b9992ba8592b40553758afaabbb6be0fcff29f17a1d0e2"}
Jul 29 01:54:13.465690 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.465582    2565 scope.go:117] "RemoveContainer" containerID="d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106"
Jul 29 01:54:13.467079 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.467057    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6" event={"ID":"6f156855-5897-4da9-9e4c-dee0c247de3b","Type":"ContainerStarted","Data":"9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411"}
Jul 29 01:54:13.467200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.467175    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:13.475121 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.475099    2565 scope.go:117] "RemoveContainer" containerID="dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89"
Jul 29 01:54:13.483382 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.483292    2565 scope.go:117] "RemoveContainer" containerID="d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106"
Jul 29 01:54:13.483668 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:54:13.483634    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106\": container with ID starting with d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106 not found: ID does not exist" containerID="d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106"
Jul 29 01:54:13.483765 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.483678    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106"} err="failed to get container status \"d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106\": rpc error: code = NotFound desc = could not find container \"d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106\": container with ID starting with d5884af19f9fe3be201286fffecd91c58768379c63ba59d4fd3f11ec25610106 not found: ID does not exist"
Jul 29 01:54:13.483765 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.483706    2565 scope.go:117] "RemoveContainer" containerID="dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89"
Jul 29 01:54:13.483942 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:54:13.483925    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89\": container with ID starting with dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89 not found: ID does not exist" containerID="dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89"
Jul 29 01:54:13.484014 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.483946    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89"} err="failed to get container status \"dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89\": rpc error: code = NotFound desc = could not find container \"dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89\": container with ID starting with dee1d1191ae396d7a5af537834690b9dd5a14916231d19af71a1f32d7a2cfa89 not found: ID does not exist"
Jul 29 01:54:13.487933 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.487889    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6" podStartSLOduration=1.917370324 podStartE2EDuration="2.487874774s" totalImagesPullingTime="570.50445ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:13.485437868 +0000 UTC m=+2630.124534677" watchObservedRunningTime="2026-07-29 01:54:13.487874774 +0000 UTC m=+2630.126971581"
Jul 29 01:54:13.501532 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501506    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cq4dv\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-kube-api-access-cq4dv\") pod \"66e17647-60e7-4f2c-a458-6f05c014e6b8\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") "
Jul 29 01:54:13.501681 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501550    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-socket\") pod \"66e17647-60e7-4f2c-a458-6f05c014e6b8\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") "
Jul 29 01:54:13.501681 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501576    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-data\") pod \"66e17647-60e7-4f2c-a458-6f05c014e6b8\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") "
Jul 29 01:54:13.501681 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501597    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e17647-60e7-4f2c-a458-6f05c014e6b8-istiod-ca-cert\") pod \"66e17647-60e7-4f2c-a458-6f05c014e6b8\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") "
Jul 29 01:54:13.501681 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501636    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-certs\") pod \"66e17647-60e7-4f2c-a458-6f05c014e6b8\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") "
Jul 29 01:54:13.501681 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501676    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-podinfo\") pod \"66e17647-60e7-4f2c-a458-6f05c014e6b8\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") "
Jul 29 01:54:13.501934 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501746    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-credential-socket\") pod \"66e17647-60e7-4f2c-a458-6f05c014e6b8\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") "
Jul 29 01:54:13.501934 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501776    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-envoy\") pod \"66e17647-60e7-4f2c-a458-6f05c014e6b8\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") "
Jul 29 01:54:13.501934 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501801    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-token\") pod \"66e17647-60e7-4f2c-a458-6f05c014e6b8\" (UID: \"66e17647-60e7-4f2c-a458-6f05c014e6b8\") "
Jul 29 01:54:13.501934 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.501830    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "66e17647-60e7-4f2c-a458-6f05c014e6b8" (UID: "66e17647-60e7-4f2c-a458-6f05c014e6b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:54:13.502134 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.502119    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:54:13.502187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.502125    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "66e17647-60e7-4f2c-a458-6f05c014e6b8" (UID: "66e17647-60e7-4f2c-a458-6f05c014e6b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:54:13.502187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.502135    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/66e17647-60e7-4f2c-a458-6f05c014e6b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "66e17647-60e7-4f2c-a458-6f05c014e6b8" (UID: "66e17647-60e7-4f2c-a458-6f05c014e6b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:54:13.502187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.502138    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "66e17647-60e7-4f2c-a458-6f05c014e6b8" (UID: "66e17647-60e7-4f2c-a458-6f05c014e6b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:54:13.502581 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.502559    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "66e17647-60e7-4f2c-a458-6f05c014e6b8" (UID: "66e17647-60e7-4f2c-a458-6f05c014e6b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:54:13.504059 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.504018    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-kube-api-access-cq4dv" (OuterVolumeSpecName: "kube-api-access-cq4dv") pod "66e17647-60e7-4f2c-a458-6f05c014e6b8" (UID: "66e17647-60e7-4f2c-a458-6f05c014e6b8"). InnerVolumeSpecName "kube-api-access-cq4dv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:54:13.504595 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.504574    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "66e17647-60e7-4f2c-a458-6f05c014e6b8" (UID: "66e17647-60e7-4f2c-a458-6f05c014e6b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:54:13.504706 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.504600    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "66e17647-60e7-4f2c-a458-6f05c014e6b8" (UID: "66e17647-60e7-4f2c-a458-6f05c014e6b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:54:13.504764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.504719    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "66e17647-60e7-4f2c-a458-6f05c014e6b8" (UID: "66e17647-60e7-4f2c-a458-6f05c014e6b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:54:13.603245 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.603208    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:54:13.603245 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.603245    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:54:13.603245 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.603258    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:54:13.603548 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.603270    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:54:13.603548 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.603281    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cq4dv\" (UniqueName: \"kubernetes.io/projected/66e17647-60e7-4f2c-a458-6f05c014e6b8-kube-api-access-cq4dv\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:54:13.603548 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.603295    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:54:13.603548 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.603326    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/66e17647-60e7-4f2c-a458-6f05c014e6b8-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:54:13.603548 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.603337    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/66e17647-60e7-4f2c-a458-6f05c014e6b8-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:54:13.786455 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.786429    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"]
Jul 29 01:54:13.790502 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.790475    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5ee5b9-openshift-default-5b5854c86b-rnsh2"]
Jul 29 01:54:13.916389 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:13.916359    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" path="/var/lib/kubelet/pods/66e17647-60e7-4f2c-a458-6f05c014e6b8/volumes"
Jul 29 01:54:19.477772 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:19.477743    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:54:37.522627 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.522582    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"]
Jul 29 01:54:37.523075 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.522952    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy"
Jul 29 01:54:37.523075 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.522963    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy"
Jul 29 01:54:37.523075 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.523027    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy"
Jul 29 01:54:37.523075 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.523035    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy"
Jul 29 01:54:37.525844 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.525823    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.528080 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.528063    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9132e3-openshift-default-dockercfg-4gln8\""
Jul 29 01:54:37.538535 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.538511    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"]
Jul 29 01:54:37.634081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.634047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-token\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.634081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.634082    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-podinfo\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.634283 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.634101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgfw5\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-kube-api-access-dgfw5\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.634283 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.634140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-socket\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.634283 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.634160    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-envoy\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.634283 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.634202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-data\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.634283 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.634223    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istiod-ca-cert\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.634283 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.634255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-certs\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.634283 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.634275    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-credential-socket\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.734736 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.734702    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgfw5\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-kube-api-access-dgfw5\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.734921 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.734749    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-socket\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.734921 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.734784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-envoy\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.734921 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.734820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-data\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.734921 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.734857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istiod-ca-cert\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.734921 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.734914    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-certs\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.735169 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.734940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-credential-socket\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.735169 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.735099    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-token\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.735169 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.735141    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-podinfo\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.735351 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.735169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-socket\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.735351 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.735213    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-data\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.735450 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.735430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-certs\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.735500 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.735434    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-credential-socket\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.735836 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.735808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istiod-ca-cert\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.737248 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.737226    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-envoy\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.737633 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.737612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-podinfo\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.744079 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.744060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-token\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.744283 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.744263    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgfw5\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-kube-api-access-dgfw5\") pod \"e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") " pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.836095 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.836034    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:37.968711 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.968687    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"]
Jul 29 01:54:37.970486 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:54:37.970457    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c7fadeb_b681_4208_b90a_f2b15d07bae7.slice/crio-5af619bbf897b2c66bf2f4f39aa6df242f2612fdbb9b40f8967a7ae52940f412 WatchSource:0}: Error finding container 5af619bbf897b2c66bf2f4f39aa6df242f2612fdbb9b40f8967a7ae52940f412: Status 404 returned error can't find the container with id 5af619bbf897b2c66bf2f4f39aa6df242f2612fdbb9b40f8967a7ae52940f412
Jul 29 01:54:37.972712 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.972674    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:54:37.972808 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.972777    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:54:37.972847 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:37.972820    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:54:38.585760 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:38.585730    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" event={"ID":"8c7fadeb-b681-4208-b90a-f2b15d07bae7","Type":"ContainerStarted","Data":"313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308"}
Jul 29 01:54:38.586122 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:38.585780    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" event={"ID":"8c7fadeb-b681-4208-b90a-f2b15d07bae7","Type":"ContainerStarted","Data":"5af619bbf897b2c66bf2f4f39aa6df242f2612fdbb9b40f8967a7ae52940f412"}
Jul 29 01:54:38.605140 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:38.605092    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" podStartSLOduration=1.605077071 podStartE2EDuration="1.605077071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:38.603687754 +0000 UTC m=+2655.242784580" watchObservedRunningTime="2026-07-29 01:54:38.605077071 +0000 UTC m=+2655.244173879"
Jul 29 01:54:38.836154 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:38.836083    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:39.840952 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:39.840924    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:40.594917 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:40.594889    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:40.595957 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:40.595931    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:41.085234 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.085204    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"]
Jul 29 01:54:41.085801 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.085780    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy"
Jul 29 01:54:41.085801 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.085802    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="66e17647-60e7-4f2c-a458-6f05c014e6b8" containerName="istio-proxy"
Jul 29 01:54:41.089090 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.089066    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.091516 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.091490    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9132e3-serving-cert\""
Jul 29 01:54:41.099063 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.099043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"]
Jul 29 01:54:41.168369 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.168341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-maas-api-tls\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.168523 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.168415    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl8b5\" (UniqueName: \"kubernetes.io/projected/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-kube-api-access-cl8b5\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.168523 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.168489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-openshift-service-ca\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.268994 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.268960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-openshift-service-ca\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.269178 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.269046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-maas-api-tls\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.269178 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.269085    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl8b5\" (UniqueName: \"kubernetes.io/projected/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-kube-api-access-cl8b5\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.269178 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:54:41.269150    2565 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-serving-cert: secret "maas-api-e2e-api-b-9132e3-serving-cert" not found
Jul 29 01:54:41.269399 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:54:41.269230    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-maas-api-tls podName:d34248c6-ad58-4ead-9d69-80c0ae98c3d2 nodeName:}" failed. No retries permitted until 2026-07-29 01:54:41.769208007 +0000 UTC m=+2658.408304799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-maas-api-tls") pod "maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5" (UID: "d34248c6-ad58-4ead-9d69-80c0ae98c3d2") : secret "maas-api-e2e-api-b-9132e3-serving-cert" not found
Jul 29 01:54:41.269739 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.269716    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-openshift-service-ca\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.277324 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.277292    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl8b5\" (UniqueName: \"kubernetes.io/projected/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-kube-api-access-cl8b5\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.773781 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.773743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-maas-api-tls\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:41.776327 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:41.776288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-maas-api-tls\") pod \"maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:42.004668 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:42.004625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:42.174110 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:42.174086    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"]
Jul 29 01:54:42.175598 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:54:42.175566    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34248c6_ad58_4ead_9d69_80c0ae98c3d2.slice/crio-36aa3f3afc64280dce87d33868022ab100e44a2a5d237c6aa38c2d8528a291d2 WatchSource:0}: Error finding container 36aa3f3afc64280dce87d33868022ab100e44a2a5d237c6aa38c2d8528a291d2: Status 404 returned error can't find the container with id 36aa3f3afc64280dce87d33868022ab100e44a2a5d237c6aa38c2d8528a291d2
Jul 29 01:54:42.605167 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:42.605137    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5" event={"ID":"d34248c6-ad58-4ead-9d69-80c0ae98c3d2","Type":"ContainerStarted","Data":"36aa3f3afc64280dce87d33868022ab100e44a2a5d237c6aa38c2d8528a291d2"}
Jul 29 01:54:43.611656 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:43.611617    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5" event={"ID":"d34248c6-ad58-4ead-9d69-80c0ae98c3d2","Type":"ContainerStarted","Data":"162cc707b416dec32fc04d981571e183751f2709dd80cb0449579bdbe248a0cd"}
Jul 29 01:54:43.612042 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:43.611700    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:43.633389 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:43.633338    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5" podStartSLOduration=2.237605772 podStartE2EDuration="2.633320061s" totalImagesPullingTime="395.714289ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:54:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:54:43.630795529 +0000 UTC m=+2660.269892337" watchObservedRunningTime="2026-07-29 01:54:43.633320061 +0000 UTC m=+2660.272416861"
Jul 29 01:54:49.621733 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:49.621705    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:54:56.486268 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:56.486233    2565 patch_prober.go:28] interesting pod/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:52202->10.134.0.51:15021: read: connection reset by peer" start-of-body=
Jul 29 01:54:56.486876 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:56.486339    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": read tcp 10.134.0.2:52202->10.134.0.51:15021: read: connection reset by peer"
Jul 29 01:54:56.684153 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:56.684086    2565 generic.go:356] "Generic (PLEG): container finished" podID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerID="313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308" exitCode=0
Jul 29 01:54:56.684153 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:56.684140    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" event={"ID":"8c7fadeb-b681-4208-b90a-f2b15d07bae7","Type":"ContainerDied","Data":"313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308"}
Jul 29 01:54:56.684542 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:56.684528    2565 scope.go:117] "RemoveContainer" containerID="313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308"
Jul 29 01:54:56.685505 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:56.685477    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:54:56.685571 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:56.685548    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:54:56.685612 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:56.685581    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:54:57.690428 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:57.690398    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" event={"ID":"8c7fadeb-b681-4208-b90a-f2b15d07bae7","Type":"ContainerStarted","Data":"3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885"}
Jul 29 01:54:57.837132 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:57.837102    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:54:57.837397 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:57.837374    2565 patch_prober.go:28] interesting pod/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 29 01:54:57.837503 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:57.837439    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 29 01:54:58.837191 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:58.837158    2565 patch_prober.go:28] interesting pod/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 29 01:54:58.837702 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:58.837209    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 29 01:54:59.837248 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:59.837207    2565 patch_prober.go:28] interesting pod/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 29 01:54:59.837670 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:54:59.837279    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 29 01:55:00.836716 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:00.836686    2565 patch_prober.go:28] interesting pod/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Jul 29 01:55:00.836886 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:00.836734    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Jul 29 01:55:01.839947 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:01.839918    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:55:01.840336 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:01.840276    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:55:01.840943 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:01.840926    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:55:24.094738 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.094645    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"]
Jul 29 01:55:24.095255 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.094888    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6" podUID="6f156855-5897-4da9-9e4c-dee0c247de3b" containerName="maas-api" containerID="cri-o://9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411" gracePeriod=30
Jul 29 01:55:24.158959 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.157495    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:55:24.178212 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.178183    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:55:24.179052 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.179028    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 01:55:24.189062 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.189032    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 01:55:24.360331 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.360294    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:55:24.458327 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.458277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkr28\" (UniqueName: \"kubernetes.io/projected/6f156855-5897-4da9-9e4c-dee0c247de3b-kube-api-access-dkr28\") pod \"6f156855-5897-4da9-9e4c-dee0c247de3b\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") "
Jul 29 01:55:24.458480 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.458366    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f156855-5897-4da9-9e4c-dee0c247de3b-maas-api-tls\") pod \"6f156855-5897-4da9-9e4c-dee0c247de3b\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") "
Jul 29 01:55:24.458534 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.458479    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f156855-5897-4da9-9e4c-dee0c247de3b-openshift-service-ca\") pod \"6f156855-5897-4da9-9e4c-dee0c247de3b\" (UID: \"6f156855-5897-4da9-9e4c-dee0c247de3b\") "
Jul 29 01:55:24.458817 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.458794    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f156855-5897-4da9-9e4c-dee0c247de3b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6f156855-5897-4da9-9e4c-dee0c247de3b" (UID: "6f156855-5897-4da9-9e4c-dee0c247de3b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:55:24.460545 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.460521    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f156855-5897-4da9-9e4c-dee0c247de3b-kube-api-access-dkr28" (OuterVolumeSpecName: "kube-api-access-dkr28") pod "6f156855-5897-4da9-9e4c-dee0c247de3b" (UID: "6f156855-5897-4da9-9e4c-dee0c247de3b"). InnerVolumeSpecName "kube-api-access-dkr28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:55:24.460655 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.460632    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f156855-5897-4da9-9e4c-dee0c247de3b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6f156855-5897-4da9-9e4c-dee0c247de3b" (UID: "6f156855-5897-4da9-9e4c-dee0c247de3b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:55:24.559278 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.559243    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkr28\" (UniqueName: \"kubernetes.io/projected/6f156855-5897-4da9-9e4c-dee0c247de3b-kube-api-access-dkr28\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:24.559278 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.559275    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6f156855-5897-4da9-9e4c-dee0c247de3b-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:24.559278 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.559284    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f156855-5897-4da9-9e4c-dee0c247de3b-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:24.822804 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.822764    2565 generic.go:356] "Generic (PLEG): container finished" podID="6f156855-5897-4da9-9e4c-dee0c247de3b" containerID="9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411" exitCode=0
Jul 29 01:55:24.823004 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.822823    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6" event={"ID":"6f156855-5897-4da9-9e4c-dee0c247de3b","Type":"ContainerDied","Data":"9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411"}
Jul 29 01:55:24.823004 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.822832    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"
Jul 29 01:55:24.823004 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.822906    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6" event={"ID":"6f156855-5897-4da9-9e4c-dee0c247de3b","Type":"ContainerDied","Data":"dc11e8b248aad1b33ad0913416f6fe8587084fb5bd4d7c26562f960dafc152d3"}
Jul 29 01:55:24.823004 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.822929    2565 scope.go:117] "RemoveContainer" containerID="9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411"
Jul 29 01:55:24.835249 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.835222    2565 scope.go:117] "RemoveContainer" containerID="9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411"
Jul 29 01:55:24.835583 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:55:24.835562    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411\": container with ID starting with 9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411 not found: ID does not exist" containerID="9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411"
Jul 29 01:55:24.835637 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.835593    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411"} err="failed to get container status \"9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411\": rpc error: code = NotFound desc = could not find container \"9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411\": container with ID starting with 9466bc66ae535ba24136dead35895feba43004514d185dda40494ca86ea49411 not found: ID does not exist"
Jul 29 01:55:24.843441 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.843413    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"]
Jul 29 01:55:24.849353 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:24.849330    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-2f7b9a-7f48c9d85c-2hds6"]
Jul 29 01:55:25.916146 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:25.916116    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f156855-5897-4da9-9e4c-dee0c247de3b" path="/var/lib/kubelet/pods/6f156855-5897-4da9-9e4c-dee0c247de3b/volumes"
Jul 29 01:55:31.191771 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.191735    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"]
Jul 29 01:55:31.192363 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.192344    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f156855-5897-4da9-9e4c-dee0c247de3b" containerName="maas-api"
Jul 29 01:55:31.192411 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.192367    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f156855-5897-4da9-9e4c-dee0c247de3b" containerName="maas-api"
Jul 29 01:55:31.192464 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.192453    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f156855-5897-4da9-9e4c-dee0c247de3b" containerName="maas-api"
Jul 29 01:55:31.195865 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.195847    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"
Jul 29 01:55:31.198268 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.198250    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 01:55:31.203052 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.203028    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"]
Jul 29 01:55:31.322290 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.322255    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16dee0de-885b-4108-8f50-0f8fdfa345bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q\" (UID: \"16dee0de-885b-4108-8f50-0f8fdfa345bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"
Jul 29 01:55:31.423443 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.423412    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16dee0de-885b-4108-8f50-0f8fdfa345bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q\" (UID: \"16dee0de-885b-4108-8f50-0f8fdfa345bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"
Jul 29 01:55:31.423971 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.423953    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16dee0de-885b-4108-8f50-0f8fdfa345bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q\" (UID: \"16dee0de-885b-4108-8f50-0f8fdfa345bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"
Jul 29 01:55:31.508118 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.508057    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"
Jul 29 01:55:31.640000 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.639973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"]
Jul 29 01:55:31.641394 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:55:31.641358    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16dee0de_885b_4108_8f50_0f8fdfa345bb.slice/crio-c83dd5374ac3821b25ab1c210a84d8aff41b9497ef696eaa19be58663267fac4 WatchSource:0}: Error finding container c83dd5374ac3821b25ab1c210a84d8aff41b9497ef696eaa19be58663267fac4: Status 404 returned error can't find the container with id c83dd5374ac3821b25ab1c210a84d8aff41b9497ef696eaa19be58663267fac4
Jul 29 01:55:31.860932 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:31.860902    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q" event={"ID":"16dee0de-885b-4108-8f50-0f8fdfa345bb","Type":"ContainerStarted","Data":"c83dd5374ac3821b25ab1c210a84d8aff41b9497ef696eaa19be58663267fac4"}
Jul 29 01:55:32.867422 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:32.867386    2565 generic.go:356] "Generic (PLEG): container finished" podID="16dee0de-885b-4108-8f50-0f8fdfa345bb" containerID="5c4507d3fa8fa7d57255ecbc2b0bf8004429a71243620542599827a65abbd95d" exitCode=0
Jul 29 01:55:32.867776 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:32.867472    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q" event={"ID":"16dee0de-885b-4108-8f50-0f8fdfa345bb","Type":"ContainerDied","Data":"5c4507d3fa8fa7d57255ecbc2b0bf8004429a71243620542599827a65abbd95d"}
Jul 29 01:55:34.005817 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:34.005794    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"
Jul 29 01:55:34.147291 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:34.147215    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16dee0de-885b-4108-8f50-0f8fdfa345bb-maas-api-service-ca\") pod \"16dee0de-885b-4108-8f50-0f8fdfa345bb\" (UID: \"16dee0de-885b-4108-8f50-0f8fdfa345bb\") "
Jul 29 01:55:34.147559 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:34.147538    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16dee0de-885b-4108-8f50-0f8fdfa345bb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "16dee0de-885b-4108-8f50-0f8fdfa345bb" (UID: "16dee0de-885b-4108-8f50-0f8fdfa345bb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:55:34.248486 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:34.248461    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/16dee0de-885b-4108-8f50-0f8fdfa345bb-maas-api-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:34.879674 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:34.879645    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"
Jul 29 01:55:34.879674 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:34.879660    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q" event={"ID":"16dee0de-885b-4108-8f50-0f8fdfa345bb","Type":"ContainerDied","Data":"c83dd5374ac3821b25ab1c210a84d8aff41b9497ef696eaa19be58663267fac4"}
Jul 29 01:55:34.879869 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:34.879703    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c83dd5374ac3821b25ab1c210a84d8aff41b9497ef696eaa19be58663267fac4"
Jul 29 01:55:46.725259 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:46.725225    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"]
Jul 29 01:55:46.725759 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:46.725532    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5" podUID="d34248c6-ad58-4ead-9d69-80c0ae98c3d2" containerName="maas-api" containerID="cri-o://162cc707b416dec32fc04d981571e183751f2709dd80cb0449579bdbe248a0cd" gracePeriod=30
Jul 29 01:55:46.929566 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:46.929509    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"]
Jul 29 01:55:46.931222 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:46.931194    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-9132e3-r7r2q"]
Jul 29 01:55:46.942204 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:46.942172    2565 generic.go:356] "Generic (PLEG): container finished" podID="d34248c6-ad58-4ead-9d69-80c0ae98c3d2" containerID="162cc707b416dec32fc04d981571e183751f2709dd80cb0449579bdbe248a0cd" exitCode=0
Jul 29 01:55:46.942373 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:46.942240    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5" event={"ID":"d34248c6-ad58-4ead-9d69-80c0ae98c3d2","Type":"ContainerDied","Data":"162cc707b416dec32fc04d981571e183751f2709dd80cb0449579bdbe248a0cd"}
Jul 29 01:55:46.984771 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:46.984684    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:55:47.063196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.063169    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cl8b5\" (UniqueName: \"kubernetes.io/projected/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-kube-api-access-cl8b5\") pod \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") "
Jul 29 01:55:47.063196 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.063201    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-openshift-service-ca\") pod \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") "
Jul 29 01:55:47.063476 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.063237    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-maas-api-tls\") pod \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\" (UID: \"d34248c6-ad58-4ead-9d69-80c0ae98c3d2\") "
Jul 29 01:55:47.063616 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.063588    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d34248c6-ad58-4ead-9d69-80c0ae98c3d2" (UID: "d34248c6-ad58-4ead-9d69-80c0ae98c3d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:55:47.065428 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.065406    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-kube-api-access-cl8b5" (OuterVolumeSpecName: "kube-api-access-cl8b5") pod "d34248c6-ad58-4ead-9d69-80c0ae98c3d2" (UID: "d34248c6-ad58-4ead-9d69-80c0ae98c3d2"). InnerVolumeSpecName "kube-api-access-cl8b5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:55:47.065502 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.065437    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d34248c6-ad58-4ead-9d69-80c0ae98c3d2" (UID: "d34248c6-ad58-4ead-9d69-80c0ae98c3d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 01:55:47.163959 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.163926    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cl8b5\" (UniqueName: \"kubernetes.io/projected/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-kube-api-access-cl8b5\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:47.163959 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.163954    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:47.163959 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.163968    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d34248c6-ad58-4ead-9d69-80c0ae98c3d2-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:47.915625 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.915593    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16dee0de-885b-4108-8f50-0f8fdfa345bb" path="/var/lib/kubelet/pods/16dee0de-885b-4108-8f50-0f8fdfa345bb/volumes"
Jul 29 01:55:47.948046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.948011    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5" event={"ID":"d34248c6-ad58-4ead-9d69-80c0ae98c3d2","Type":"ContainerDied","Data":"36aa3f3afc64280dce87d33868022ab100e44a2a5d237c6aa38c2d8528a291d2"}
Jul 29 01:55:47.948046 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.948032    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"
Jul 29 01:55:47.948262 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.948078    2565 scope.go:117] "RemoveContainer" containerID="162cc707b416dec32fc04d981571e183751f2709dd80cb0449579bdbe248a0cd"
Jul 29 01:55:47.965199 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.965175    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"]
Jul 29 01:55:47.971044 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:47.971023    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9132e3-8697bc7798-l4bc5"]
Jul 29 01:55:49.916238 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:49.916207    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d34248c6-ad58-4ead-9d69-80c0ae98c3d2" path="/var/lib/kubelet/pods/d34248c6-ad58-4ead-9d69-80c0ae98c3d2/volumes"
Jul 29 01:55:53.336495 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:53.336466    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"]
Jul 29 01:55:53.336918 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:53.336716    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy" containerID="cri-o://3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885" gracePeriod=30
Jul 29 01:55:57.370162 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.370128    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"]
Jul 29 01:55:57.370568 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.370477    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16dee0de-885b-4108-8f50-0f8fdfa345bb" containerName="revoke-keys"
Jul 29 01:55:57.370568 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.370489    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="16dee0de-885b-4108-8f50-0f8fdfa345bb" containerName="revoke-keys"
Jul 29 01:55:57.370568 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.370501    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d34248c6-ad58-4ead-9d69-80c0ae98c3d2" containerName="maas-api"
Jul 29 01:55:57.370568 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.370507    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d34248c6-ad58-4ead-9d69-80c0ae98c3d2" containerName="maas-api"
Jul 29 01:55:57.370568 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.370563    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d34248c6-ad58-4ead-9d69-80c0ae98c3d2" containerName="maas-api"
Jul 29 01:55:57.370754 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.370573    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="16dee0de-885b-4108-8f50-0f8fdfa345bb" containerName="revoke-keys"
Jul 29 01:55:57.375025 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.375006    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.377644 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.377623    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-27cc80-serving-cert\""
Jul 29 01:55:57.378370 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.378354    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 01:55:57.378469 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.378401    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 01:55:57.378469 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.378401    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gdmt7\""
Jul 29 01:55:57.386241 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.386185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"]
Jul 29 01:55:57.555061 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.555032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb8bcfe-8076-4f34-92ba-5156d76676b2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.555211 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.555108    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beb8bcfe-8076-4f34-92ba-5156d76676b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.555211 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.555130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tbzm\" (UniqueName: \"kubernetes.io/projected/beb8bcfe-8076-4f34-92ba-5156d76676b2-kube-api-access-2tbzm\") pod \"maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.655715 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.655619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb8bcfe-8076-4f34-92ba-5156d76676b2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.655880 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.655716    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beb8bcfe-8076-4f34-92ba-5156d76676b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.655880 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.655736    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tbzm\" (UniqueName: \"kubernetes.io/projected/beb8bcfe-8076-4f34-92ba-5156d76676b2-kube-api-access-2tbzm\") pod \"maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.656195 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.656176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb8bcfe-8076-4f34-92ba-5156d76676b2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.658143 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.658118    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beb8bcfe-8076-4f34-92ba-5156d76676b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.665890 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.665868    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tbzm\" (UniqueName: \"kubernetes.io/projected/beb8bcfe-8076-4f34-92ba-5156d76676b2-kube-api-access-2tbzm\") pod \"maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.685816 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.685795    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:57.823624 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.823598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"]
Jul 29 01:55:57.826273 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:55:57.826231    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb8bcfe_8076_4f34_92ba_5156d76676b2.slice/crio-520b252cf23717bb8b31da54f40d712e24b1cb7f1a8240d508caad2dabbdea5c WatchSource:0}: Error finding container 520b252cf23717bb8b31da54f40d712e24b1cb7f1a8240d508caad2dabbdea5c: Status 404 returned error can't find the container with id 520b252cf23717bb8b31da54f40d712e24b1cb7f1a8240d508caad2dabbdea5c
Jul 29 01:55:57.994678 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:57.994591    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh" event={"ID":"beb8bcfe-8076-4f34-92ba-5156d76676b2","Type":"ContainerStarted","Data":"520b252cf23717bb8b31da54f40d712e24b1cb7f1a8240d508caad2dabbdea5c"}
Jul 29 01:55:58.577158 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.577134    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:55:58.768187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-envoy\") pod \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") "
Jul 29 01:55:58.768187 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768187    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-credential-socket\") pod \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") "
Jul 29 01:55:58.768436 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768223    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-data\") pod \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") "
Jul 29 01:55:58.768436 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768281    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-podinfo\") pod \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") "
Jul 29 01:55:58.768436 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768331    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-certs\") pod \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") "
Jul 29 01:55:58.768436 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768377    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-token\") pod \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") "
Jul 29 01:55:58.768436 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768403    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istiod-ca-cert\") pod \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") "
Jul 29 01:55:58.768682 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768468    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgfw5\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-kube-api-access-dgfw5\") pod \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") "
Jul 29 01:55:58.768682 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768481    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c7fadeb-b681-4208-b90a-f2b15d07bae7" (UID: "8c7fadeb-b681-4208-b90a-f2b15d07bae7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:55:58.768682 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768515    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-socket\") pod \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\" (UID: \"8c7fadeb-b681-4208-b90a-f2b15d07bae7\") "
Jul 29 01:55:58.768682 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768664    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c7fadeb-b681-4208-b90a-f2b15d07bae7" (UID: "8c7fadeb-b681-4208-b90a-f2b15d07bae7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:55:58.768886 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768857    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:58.768886 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768868    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c7fadeb-b681-4208-b90a-f2b15d07bae7" (UID: "8c7fadeb-b681-4208-b90a-f2b15d07bae7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:55:58.768983 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768875    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:58.768983 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.768886    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c7fadeb-b681-4208-b90a-f2b15d07bae7" (UID: "8c7fadeb-b681-4208-b90a-f2b15d07bae7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 01:55:58.769395 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.769373    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c7fadeb-b681-4208-b90a-f2b15d07bae7" (UID: "8c7fadeb-b681-4208-b90a-f2b15d07bae7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:55:58.770644 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.770619    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-kube-api-access-dgfw5" (OuterVolumeSpecName: "kube-api-access-dgfw5") pod "8c7fadeb-b681-4208-b90a-f2b15d07bae7" (UID: "8c7fadeb-b681-4208-b90a-f2b15d07bae7"). InnerVolumeSpecName "kube-api-access-dgfw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:55:58.770644 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.770639    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c7fadeb-b681-4208-b90a-f2b15d07bae7" (UID: "8c7fadeb-b681-4208-b90a-f2b15d07bae7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 01:55:58.771178 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.771145    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c7fadeb-b681-4208-b90a-f2b15d07bae7" (UID: "8c7fadeb-b681-4208-b90a-f2b15d07bae7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 01:55:58.771178 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.771152    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c7fadeb-b681-4208-b90a-f2b15d07bae7" (UID: "8c7fadeb-b681-4208-b90a-f2b15d07bae7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 01:55:58.869851 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.869818    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:58.869851 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.869846    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:58.869851 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.869855    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgfw5\" (UniqueName: \"kubernetes.io/projected/8c7fadeb-b681-4208-b90a-f2b15d07bae7-kube-api-access-dgfw5\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:58.870077 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.869864    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:58.870077 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.869873    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:58.870077 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.869881    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:58.870077 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:58.869889    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c7fadeb-b681-4208-b90a-f2b15d07bae7-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 01:55:59.000774 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.000687    2565 generic.go:356] "Generic (PLEG): container finished" podID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerID="3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885" exitCode=0
Jul 29 01:55:59.000774 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.000741    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"
Jul 29 01:55:59.000774 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.000761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" event={"ID":"8c7fadeb-b681-4208-b90a-f2b15d07bae7","Type":"ContainerDied","Data":"3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885"}
Jul 29 01:55:59.001054 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.000805    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt" event={"ID":"8c7fadeb-b681-4208-b90a-f2b15d07bae7","Type":"ContainerDied","Data":"5af619bbf897b2c66bf2f4f39aa6df242f2612fdbb9b40f8967a7ae52940f412"}
Jul 29 01:55:59.001054 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.000826    2565 scope.go:117] "RemoveContainer" containerID="3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885"
Jul 29 01:55:59.002451 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.002430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh" event={"ID":"beb8bcfe-8076-4f34-92ba-5156d76676b2","Type":"ContainerStarted","Data":"16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307"}
Jul 29 01:55:59.002563 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.002476    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:55:59.013762 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.013745    2565 scope.go:117] "RemoveContainer" containerID="313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308"
Jul 29 01:55:59.022200 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.022171    2565 scope.go:117] "RemoveContainer" containerID="3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885"
Jul 29 01:55:59.022567 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:55:59.022540    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885\": container with ID starting with 3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885 not found: ID does not exist" containerID="3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885"
Jul 29 01:55:59.022651 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.022567    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885"} err="failed to get container status \"3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885\": rpc error: code = NotFound desc = could not find container \"3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885\": container with ID starting with 3b85eff85f4bc0c80c2d6cee27e2d3c6826aedc90cb4ad0c7f88d52351463885 not found: ID does not exist"
Jul 29 01:55:59.022651 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.022588    2565 scope.go:117] "RemoveContainer" containerID="313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308"
Jul 29 01:55:59.022754 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.022664    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh" podStartSLOduration=1.679600437 podStartE2EDuration="2.022648046s" totalImagesPullingTime="343.047609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:55:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:55:59.021472312 +0000 UTC m=+2735.660569142" watchObservedRunningTime="2026-07-29 01:55:59.022648046 +0000 UTC m=+2735.661744854"
Jul 29 01:55:59.022833 ip-10-0-139-204 kubenswrapper[2565]: E0729 01:55:59.022819    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308\": container with ID starting with 313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308 not found: ID does not exist" containerID="313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308"
Jul 29 01:55:59.022873 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.022838    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308"} err="failed to get container status \"313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308\": rpc error: code = NotFound desc = could not find container \"313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308\": container with ID starting with 313ec0f1e30ee4af33faa29a6116b030fce03986134969661110533a0bd2c308 not found: ID does not exist"
Jul 29 01:55:59.035545 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.035522    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"]
Jul 29 01:55:59.040763 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.040743    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9132e3-openshift-default-f4b9fbf56-rtllt"]
Jul 29 01:55:59.915764 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:55:59.915733    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" path="/var/lib/kubelet/pods/8c7fadeb-b681-4208-b90a-f2b15d07bae7/volumes"
Jul 29 01:56:05.013048 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:05.013021    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 01:56:22.844384 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.844347    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"]
Jul 29 01:56:22.844853 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.844834    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy"
Jul 29 01:56:22.844897 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.844857    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy"
Jul 29 01:56:22.844939 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.844934    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy"
Jul 29 01:56:22.844980 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.844944    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy"
Jul 29 01:56:22.848162 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.848143    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:22.850732 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.850708    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-a7bf0d-openshift-default-dockercfg-f6fmx\""
Jul 29 01:56:22.860984 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.860960    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"]
Jul 29 01:56:22.968711 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.968676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c45497-a292-4cda-b6f1-b639183e0d54-istio-podinfo\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:22.968903 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.968790    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c45497-a292-4cda-b6f1-b639183e0d54-istiod-ca-cert\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:22.968903 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.968835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-data\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:22.968903 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.968860    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-istio-token\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:22.968903 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.968887    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dkfn\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-kube-api-access-2dkfn\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:22.969081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.968933    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-envoy\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:22.969081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.968965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-certs\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:22.969081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.968994    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-socket\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:22.969081 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:22.969031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-credential-socket\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.070569 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.070529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c45497-a292-4cda-b6f1-b639183e0d54-istiod-ca-cert\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.070757 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.070581    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-data\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.070757 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.070600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-istio-token\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.070757 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.070619    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dkfn\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-kube-api-access-2dkfn\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.070922 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.070785    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-envoy\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.070922 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.070846    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-certs\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.070922 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.070875    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-socket\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.071069 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.070921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-credential-socket\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.071069 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.070964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c45497-a292-4cda-b6f1-b639183e0d54-istio-podinfo\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.071179 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.071068    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-data\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.071258 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.071224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-certs\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.071335 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.071290    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c45497-a292-4cda-b6f1-b639183e0d54-istiod-ca-cert\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.071508 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.071487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-socket\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.071557 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.071430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-credential-socket\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.073083 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.073059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-envoy\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.073604 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.073582    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c45497-a292-4cda-b6f1-b639183e0d54-istio-podinfo\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.078780 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.078755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-istio-token\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.078888 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.078862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dkfn\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-kube-api-access-2dkfn\") pod \"e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") " pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.158294 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.158199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:23.316522 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.316498    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"]
Jul 29 01:56:23.318083 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:56:23.318055    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c45497_a292_4cda_b6f1_b639183e0d54.slice/crio-b2ad2d5207574547b79dad8c526f2a939dbdb6a36c1bd629bdfdd762dd6d1953 WatchSource:0}: Error finding container b2ad2d5207574547b79dad8c526f2a939dbdb6a36c1bd629bdfdd762dd6d1953: Status 404 returned error can't find the container with id b2ad2d5207574547b79dad8c526f2a939dbdb6a36c1bd629bdfdd762dd6d1953
Jul 29 01:56:23.320372 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.320337    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:56:23.320473 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.320401    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:56:23.320473 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:23.320434    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:56:24.082887 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:24.082853    2565 scope.go:117] "RemoveContainer" containerID="78b5caca83ba9c771d3296fbf4cf2e5628f49822cd6784b9d00debdeaa0798bb"
Jul 29 01:56:24.117509 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:24.117484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" event={"ID":"16c45497-a292-4cda-b6f1-b639183e0d54","Type":"ContainerStarted","Data":"62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1"}
Jul 29 01:56:24.117615 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:24.117532    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" event={"ID":"16c45497-a292-4cda-b6f1-b639183e0d54","Type":"ContainerStarted","Data":"b2ad2d5207574547b79dad8c526f2a939dbdb6a36c1bd629bdfdd762dd6d1953"}
Jul 29 01:56:24.138603 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:24.138561    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" podStartSLOduration=2.138545709 podStartE2EDuration="2.138545709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:56:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:56:24.137100831 +0000 UTC m=+2760.776197667" watchObservedRunningTime="2026-07-29 01:56:24.138545709 +0000 UTC m=+2760.777642515"
Jul 29 01:56:24.158646 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:24.158616    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:24.163839 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:24.163816    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:25.122678 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:25.122644    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:25.123662 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:25.123645    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:26.140720 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.140680    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"]
Jul 29 01:56:26.141214 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.141198    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy"
Jul 29 01:56:26.141214 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.141215    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c7fadeb-b681-4208-b90a-f2b15d07bae7" containerName="istio-proxy"
Jul 29 01:56:26.146244 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.146223    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.148375 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.148356    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-a7bf0d-serving-cert\""
Jul 29 01:56:26.154229 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.154208    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"]
Jul 29 01:56:26.200624 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.200593    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-maas-api-tls\") pod \"maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.200798 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.200752    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.200870 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.200834    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzv2z\" (UniqueName: \"kubernetes.io/projected/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-kube-api-access-hzv2z\") pod \"maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.302039 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.302007    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.302210 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.302061    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzv2z\" (UniqueName: \"kubernetes.io/projected/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-kube-api-access-hzv2z\") pod \"maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.302210 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.302082    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-maas-api-tls\") pod \"maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.302633 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.302609    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-openshift-service-ca\") pod \"maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.304662 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.304635    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-maas-api-tls\") pod \"maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.309936 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.309913    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzv2z\" (UniqueName: \"kubernetes.io/projected/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-kube-api-access-hzv2z\") pod \"maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.461092 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.461000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:26.597410 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:26.597341    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"]
Jul 29 01:56:26.599668 ip-10-0-139-204 kubenswrapper[2565]: W0729 01:56:26.599641    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb00de64_8042_4b8e_95e5_f7e4c3a42f3d.slice/crio-afe703e6255d426dcf49b949b6de598c4ca89397ba4e58e74d89c0d1c7c340c6 WatchSource:0}: Error finding container afe703e6255d426dcf49b949b6de598c4ca89397ba4e58e74d89c0d1c7c340c6: Status 404 returned error can't find the container with id afe703e6255d426dcf49b949b6de598c4ca89397ba4e58e74d89c0d1c7c340c6
Jul 29 01:56:27.133404 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:27.133368    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr" event={"ID":"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d","Type":"ContainerStarted","Data":"afe703e6255d426dcf49b949b6de598c4ca89397ba4e58e74d89c0d1c7c340c6"}
Jul 29 01:56:28.139341 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:28.139288    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr" event={"ID":"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d","Type":"ContainerStarted","Data":"0516d00203191d6107ece5990887ba28632c4b3be3c3d1de621d9dd177260769"}
Jul 29 01:56:28.139737 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:28.139451    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:28.158106 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:28.158060    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr" podStartSLOduration=1.6234671139999999 podStartE2EDuration="2.158044117s" totalImagesPullingTime="534.577003ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 01:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 01:56:28.157980257 +0000 UTC m=+2764.797077065" watchObservedRunningTime="2026-07-29 01:56:28.158044117 +0000 UTC m=+2764.797140925"
Jul 29 01:56:34.149851 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:34.149823    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 01:56:41.164437 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:41.164402    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 01:56:41.164902 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:41.164474    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 01:56:42.209742 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:42.209710    2565 generic.go:356] "Generic (PLEG): container finished" podID="16c45497-a292-4cda-b6f1-b639183e0d54" containerID="62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1" exitCode=0
Jul 29 01:56:42.210156 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:42.209774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" event={"ID":"16c45497-a292-4cda-b6f1-b639183e0d54","Type":"ContainerDied","Data":"62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1"}
Jul 29 01:56:42.210156 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:42.210146    2565 scope.go:117] "RemoveContainer" containerID="62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1"
Jul 29 01:56:42.211173 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:42.211142    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:56:42.211289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:42.211213    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:56:42.211289 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:42.211263    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 01:56:43.219861 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:43.219820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" event={"ID":"16c45497-a292-4cda-b6f1-b639183e0d54","Type":"ContainerStarted","Data":"6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c"}
Jul 29 01:56:44.158394 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:44.158318    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:44.158554 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:44.158466    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 29 01:56:44.158554 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:44.158515    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 29 01:56:45.158784 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:45.158745    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 29 01:56:45.159152 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:45.158815    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 29 01:56:46.159037 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:46.159005    2565 patch_prober.go:28] interesting pod/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Jul 29 01:56:46.159521 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:46.159062    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Jul 29 01:56:47.161880 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:47.161846    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:47.162322 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:47.162096    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 01:56:47.162906 ip-10-0-139-204 kubenswrapper[2565]: I0729 01:56:47.162890    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 02:00:00.217697 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.217481    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj"]
Jul 29 02:00:00.222004 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.221981    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9"]
Jul 29 02:00:00.222124 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.222103    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj"
Jul 29 02:00:00.224634 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.224609    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 02:00:00.225085 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.225071    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr"]
Jul 29 02:00:00.225188 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.225175    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9"
Jul 29 02:00:00.228376 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.228352    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr"
Jul 29 02:00:00.233006 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.232989    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj"
Jul 29 02:00:00.241415 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.241395    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj"]
Jul 29 02:00:00.242548 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.242209    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9"
Jul 29 02:00:00.247057 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.247035    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9"]
Jul 29 02:00:00.266961 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.266899    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr"]
Jul 29 02:00:00.281983 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.281963    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr"
Jul 29 02:00:00.409564 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.409477    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj"]
Jul 29 02:00:00.413500 ip-10-0-139-204 kubenswrapper[2565]: W0729 02:00:00.413476    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b78791f_b21d_4e9a_b436_456bec227336.slice/crio-4c6a07eb0052d9805aa9f166b26b19b56aae91cb192ae652a11ced9994e2fed1 WatchSource:0}: Error finding container 4c6a07eb0052d9805aa9f166b26b19b56aae91cb192ae652a11ced9994e2fed1: Status 404 returned error can't find the container with id 4c6a07eb0052d9805aa9f166b26b19b56aae91cb192ae652a11ced9994e2fed1
Jul 29 02:00:00.435035 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.435007    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9"]
Jul 29 02:00:00.436487 ip-10-0-139-204 kubenswrapper[2565]: W0729 02:00:00.436450    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b522421_a6bb_499f_b996_f674939a35bf.slice/crio-d61778e148981bd181485cb13cde3ccd8e58b88befc8a0b5a891281274a490fd WatchSource:0}: Error finding container d61778e148981bd181485cb13cde3ccd8e58b88befc8a0b5a891281274a490fd: Status 404 returned error can't find the container with id d61778e148981bd181485cb13cde3ccd8e58b88befc8a0b5a891281274a490fd
Jul 29 02:00:00.471381 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:00.471359    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr"]
Jul 29 02:00:00.476899 ip-10-0-139-204 kubenswrapper[2565]: W0729 02:00:00.476872    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6a6dec8_7b10_447b_9e4f_dbc60d9e6d9a.slice/crio-1c6b3bfaf6c3367c36be6b4fb26d4ee6ffec6f7c96d3a1189379a2f483414f03 WatchSource:0}: Error finding container 1c6b3bfaf6c3367c36be6b4fb26d4ee6ffec6f7c96d3a1189379a2f483414f03: Status 404 returned error can't find the container with id 1c6b3bfaf6c3367c36be6b4fb26d4ee6ffec6f7c96d3a1189379a2f483414f03
Jul 29 02:00:01.134562 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:01.134463    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj" event={"ID":"8b78791f-b21d-4e9a-b436-456bec227336","Type":"ContainerStarted","Data":"6e571db09542c0e0ea7ab78202151f3f4f5b0ac29623a360252d62d8ac1e293a"}
Jul 29 02:00:01.134562 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:01.134524    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj" event={"ID":"8b78791f-b21d-4e9a-b436-456bec227336","Type":"ContainerStarted","Data":"4c6a07eb0052d9805aa9f166b26b19b56aae91cb192ae652a11ced9994e2fed1"}
Jul 29 02:00:01.136014 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:01.135989    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9" event={"ID":"7b522421-a6bb-499f-b996-f674939a35bf","Type":"ContainerStarted","Data":"87df44c80f3e55314260e38353a16e046451445fdd95afbda5c5a46932fa6b3e"}
Jul 29 02:00:01.136125 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:01.136027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9" event={"ID":"7b522421-a6bb-499f-b996-f674939a35bf","Type":"ContainerStarted","Data":"d61778e148981bd181485cb13cde3ccd8e58b88befc8a0b5a891281274a490fd"}
Jul 29 02:00:01.137597 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:01.137576    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr" event={"ID":"b6a6dec8-7b10-447b-9e4f-dbc60d9e6d9a","Type":"ContainerStarted","Data":"3a463a583cdc6b453c5176c171a1a81b47744f332cc970fb7734f7feb6a1b65f"}
Jul 29 02:00:01.137705 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:01.137608    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr" event={"ID":"b6a6dec8-7b10-447b-9e4f-dbc60d9e6d9a","Type":"ContainerStarted","Data":"1c6b3bfaf6c3367c36be6b4fb26d4ee6ffec6f7c96d3a1189379a2f483414f03"}
Jul 29 02:00:01.156810 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:01.156776    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj" podStartSLOduration=1.156763353 podStartE2EDuration="1.156763353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:00:01.155343717 +0000 UTC m=+2977.794440526" watchObservedRunningTime="2026-07-29 02:00:01.156763353 +0000 UTC m=+2977.795860160"
Jul 29 02:00:01.177938 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:01.177895    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9" podStartSLOduration=1.177881924 podStartE2EDuration="1.177881924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:00:01.176124791 +0000 UTC m=+2977.815221598" watchObservedRunningTime="2026-07-29 02:00:01.177881924 +0000 UTC m=+2977.816978732"
Jul 29 02:00:02.144167 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:02.144132    2565 generic.go:356] "Generic (PLEG): container finished" podID="8b78791f-b21d-4e9a-b436-456bec227336" containerID="6e571db09542c0e0ea7ab78202151f3f4f5b0ac29623a360252d62d8ac1e293a" exitCode=0
Jul 29 02:00:02.144609 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:02.144226    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj" event={"ID":"8b78791f-b21d-4e9a-b436-456bec227336","Type":"ContainerDied","Data":"6e571db09542c0e0ea7ab78202151f3f4f5b0ac29623a360252d62d8ac1e293a"}
Jul 29 02:00:02.146069 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:02.146045    2565 generic.go:356] "Generic (PLEG): container finished" podID="7b522421-a6bb-499f-b996-f674939a35bf" containerID="87df44c80f3e55314260e38353a16e046451445fdd95afbda5c5a46932fa6b3e" exitCode=0
Jul 29 02:00:02.146184 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:02.146086    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9" event={"ID":"7b522421-a6bb-499f-b996-f674939a35bf","Type":"ContainerDied","Data":"87df44c80f3e55314260e38353a16e046451445fdd95afbda5c5a46932fa6b3e"}
Jul 29 02:00:02.147941 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:02.147868    2565 generic.go:356] "Generic (PLEG): container finished" podID="b6a6dec8-7b10-447b-9e4f-dbc60d9e6d9a" containerID="3a463a583cdc6b453c5176c171a1a81b47744f332cc970fb7734f7feb6a1b65f" exitCode=0
Jul 29 02:00:02.148076 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:02.147899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr" event={"ID":"b6a6dec8-7b10-447b-9e4f-dbc60d9e6d9a","Type":"ContainerDied","Data":"3a463a583cdc6b453c5176c171a1a81b47744f332cc970fb7734f7feb6a1b65f"}
Jul 29 02:00:02.168454 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:02.168417    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr" podStartSLOduration=2.168404385 podStartE2EDuration="2.168404385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:00:01.205569304 +0000 UTC m=+2977.844666112" watchObservedRunningTime="2026-07-29 02:00:02.168404385 +0000 UTC m=+2978.807501192"
Jul 29 02:00:03.290526 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:03.290491    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj"
Jul 29 02:00:03.330922 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:03.330896    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr"
Jul 29 02:00:03.345990 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:03.345971    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9"
Jul 29 02:00:04.159448 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:04.159424    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr"
Jul 29 02:00:04.159448 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:04.159432    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754840-9jkjr" event={"ID":"b6a6dec8-7b10-447b-9e4f-dbc60d9e6d9a","Type":"ContainerDied","Data":"1c6b3bfaf6c3367c36be6b4fb26d4ee6ffec6f7c96d3a1189379a2f483414f03"}
Jul 29 02:00:04.159650 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:04.159499    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c6b3bfaf6c3367c36be6b4fb26d4ee6ffec6f7c96d3a1189379a2f483414f03"
Jul 29 02:00:04.160667 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:04.160653    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj"
Jul 29 02:00:04.160768 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:04.160697    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj" event={"ID":"8b78791f-b21d-4e9a-b436-456bec227336","Type":"ContainerDied","Data":"4c6a07eb0052d9805aa9f166b26b19b56aae91cb192ae652a11ced9994e2fed1"}
Jul 29 02:00:04.160768 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:04.160735    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c6a07eb0052d9805aa9f166b26b19b56aae91cb192ae652a11ced9994e2fed1"
Jul 29 02:00:04.162049 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:04.162029    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9" event={"ID":"7b522421-a6bb-499f-b996-f674939a35bf","Type":"ContainerDied","Data":"d61778e148981bd181485cb13cde3ccd8e58b88befc8a0b5a891281274a490fd"}
Jul 29 02:00:04.162049 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:04.162047    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9"
Jul 29 02:00:04.162164 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:04.162064    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d61778e148981bd181485cb13cde3ccd8e58b88befc8a0b5a891281274a490fd"
Jul 29 02:00:24.135991 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:24.135952    2565 scope.go:117] "RemoveContainer" containerID="78e68825adad79cd7113b900610d58a0841a70dbf556e6fd8141d2e1fe1ae82d"
Jul 29 02:00:24.200417 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:24.200395    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 02:00:24.208159 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:24.208138    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 02:00:24.213282 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:24.213264    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 02:00:24.219695 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:00:24.219676    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 02:02:24.165978 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:02:24.165947    2565 scope.go:117] "RemoveContainer" containerID="5c4507d3fa8fa7d57255ecbc2b0bf8004429a71243620542599827a65abbd95d"
Jul 29 02:05:24.228501 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:24.228469    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 02:05:24.235412 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:24.235391    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 02:05:24.241738 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:24.241722    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 02:05:24.248495 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:24.248477    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 02:05:34.833566 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.833526    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"]
Jul 29 02:05:34.834019 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.833928    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6a6dec8-7b10-447b-9e4f-dbc60d9e6d9a" containerName="cleanup"
Jul 29 02:05:34.834019 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.833940    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6a6dec8-7b10-447b-9e4f-dbc60d9e6d9a" containerName="cleanup"
Jul 29 02:05:34.834019 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.833954    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b78791f-b21d-4e9a-b436-456bec227336" containerName="cleanup"
Jul 29 02:05:34.834019 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.833960    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b78791f-b21d-4e9a-b436-456bec227336" containerName="cleanup"
Jul 29 02:05:34.834019 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.833971    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b522421-a6bb-499f-b996-f674939a35bf" containerName="cleanup"
Jul 29 02:05:34.834019 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.833977    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b522421-a6bb-499f-b996-f674939a35bf" containerName="cleanup"
Jul 29 02:05:34.834230 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.834030    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b522421-a6bb-499f-b996-f674939a35bf" containerName="cleanup"
Jul 29 02:05:34.834230 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.834041    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b78791f-b21d-4e9a-b436-456bec227336" containerName="cleanup"
Jul 29 02:05:34.834230 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.834047    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6a6dec8-7b10-447b-9e4f-dbc60d9e6d9a" containerName="cleanup"
Jul 29 02:05:34.836985 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.836965    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.839780 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.839757    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-74cb2e-openshift-default-dockercfg-qr8g6\""
Jul 29 02:05:34.854573 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.854549    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"]
Jul 29 02:05:34.896078 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.896047    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-socket\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.896241 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.896116    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-data\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.896241 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.896145    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-credential-socket\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.896241 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.896177    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq9qd\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-kube-api-access-lq9qd\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.896241 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.896215    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-envoy\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.896241 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.896242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istiod-ca-cert\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.896502 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.896347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-certs\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.896502 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.896384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-token\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.896502 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.896404    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-podinfo\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997108 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997067    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-certs\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997108 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997111    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-token\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997406 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997128    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-podinfo\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997406 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997248    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-socket\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997406 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997336    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-data\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997406 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997369    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-credential-socket\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997406 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq9qd\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-kube-api-access-lq9qd\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997682 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997441    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-envoy\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997682 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-certs\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997682 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997579    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istiod-ca-cert\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997682 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997649    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-socket\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.997956 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997933    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-credential-socket\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.998023 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.997989    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-data\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.998577 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.998550    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istiod-ca-cert\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.999860 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.999842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-podinfo\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:34.999940 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:34.999888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-envoy\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:35.012792 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.012755    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-token\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:35.013271 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.013253    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq9qd\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-kube-api-access-lq9qd\") pod \"e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") " pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:35.147505 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.147451    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:35.287637 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.287612    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"]
Jul 29 02:05:35.289206 ip-10-0-139-204 kubenswrapper[2565]: W0729 02:05:35.289177    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3d3f9b6_0e98_423e_b7cf_2ff52a593d19.slice/crio-9bccf5334cd3aeab9cef45ff68c0a5fbd2e61f9da7ac909e78b469599c97c814 WatchSource:0}: Error finding container 9bccf5334cd3aeab9cef45ff68c0a5fbd2e61f9da7ac909e78b469599c97c814: Status 404 returned error can't find the container with id 9bccf5334cd3aeab9cef45ff68c0a5fbd2e61f9da7ac909e78b469599c97c814
Jul 29 02:05:35.291743 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.291699    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:05:35.291829 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.291797    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:05:35.291867 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.291839    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:05:35.748145 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.748107    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" event={"ID":"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19","Type":"ContainerStarted","Data":"c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af"}
Jul 29 02:05:35.748338 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.748165    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" event={"ID":"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19","Type":"ContainerStarted","Data":"9bccf5334cd3aeab9cef45ff68c0a5fbd2e61f9da7ac909e78b469599c97c814"}
Jul 29 02:05:35.769520 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:35.769467    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" podStartSLOduration=1.769450574 podStartE2EDuration="1.769450574s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:05:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:05:35.76652634 +0000 UTC m=+3312.405623148" watchObservedRunningTime="2026-07-29 02:05:35.769450574 +0000 UTC m=+3312.408547381"
Jul 29 02:05:36.148031 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:36.147995    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:36.152938 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:36.152911    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:36.752695 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:36.752664    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:36.753672 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:36.753650    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:55.851408 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:55.851376    2565 generic.go:356] "Generic (PLEG): container finished" podID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerID="c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af" exitCode=0
Jul 29 02:05:55.851820 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:55.851458    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" event={"ID":"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19","Type":"ContainerDied","Data":"c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af"}
Jul 29 02:05:55.851863 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:55.851837    2565 scope.go:117] "RemoveContainer" containerID="c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af"
Jul 29 02:05:55.852831 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:55.852801    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:05:55.852927 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:55.852869    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:05:55.852927 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:55.852907    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:05:56.858581 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:56.858547    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" event={"ID":"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19","Type":"ContainerStarted","Data":"0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939"}
Jul 29 02:05:57.147799 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:57.147709    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:05:57.148095 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:57.148071    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 29 02:05:57.148184 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:57.148127    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 29 02:05:58.148562 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:58.148525    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 29 02:05:58.148959 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:58.148582    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 29 02:05:59.148117 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:59.148079    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 29 02:05:59.148327 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:05:59.148148    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 29 02:06:00.148719 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:00.148686    2565 patch_prober.go:28] interesting pod/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Jul 29 02:06:00.149083 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:00.148735    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Jul 29 02:06:01.152322 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:01.152277    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:06:01.152786 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:01.152677    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:06:01.153480 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:01.153461    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:06:03.640711 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.640680    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"]
Jul 29 02:06:03.643449 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.643429    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.645512 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.645491    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-e02970-openshift-default-dockercfg-9q6x5\""
Jul 29 02:06:03.656239 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.656182    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"]
Jul 29 02:06:03.671620 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.671595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istiod-ca-cert\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.671731 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.671633    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-podinfo\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.671731 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.671657    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-certs\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.671731 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.671680    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-data\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.671842 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.671731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-token\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.671842 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.671811    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-socket\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.671842 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.671835    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-credential-socket\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.671932 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.671916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwj7n\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-kube-api-access-xwj7n\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.671983 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.671940    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-envoy\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773021 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.772988    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-socket\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773216 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773027    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-credential-socket\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773216 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773100    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xwj7n\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-kube-api-access-xwj7n\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773372 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-envoy\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773372 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773263    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istiod-ca-cert\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773372 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773303    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-podinfo\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773527 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773372    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-certs\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773527 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773407    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-data\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773527 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773434    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-token\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773527 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773515    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-socket\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.773739 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773562    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-credential-socket\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.774423 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773790    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-certs\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.774423 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.773898    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-data\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.774423 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.774340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istiod-ca-cert\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.775922 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.775897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-envoy\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.776039 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.776023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-podinfo\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.783401 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.783377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-token\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.783573 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.783555    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwj7n\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-kube-api-access-xwj7n\") pod \"e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") " pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:03.954435 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:03.954340    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:04.095273 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:04.095238    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"]
Jul 29 02:06:04.097587 ip-10-0-139-204 kubenswrapper[2565]: W0729 02:06:04.097546    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f61bf03_4dff_473f_b1d4_94ba0dee7f34.slice/crio-3f05195ff8b7815bf7190abf9fa093f8f17d0054f60e7e476031c6daf71b8840 WatchSource:0}: Error finding container 3f05195ff8b7815bf7190abf9fa093f8f17d0054f60e7e476031c6daf71b8840: Status 404 returned error can't find the container with id 3f05195ff8b7815bf7190abf9fa093f8f17d0054f60e7e476031c6daf71b8840
Jul 29 02:06:04.099792 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:04.099759    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:06:04.099892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:04.099824    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:06:04.099892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:04.099852    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:06:04.898135 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:04.898098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" event={"ID":"7f61bf03-4dff-473f-b1d4-94ba0dee7f34","Type":"ContainerStarted","Data":"e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488"}
Jul 29 02:06:04.898552 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:04.898149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" event={"ID":"7f61bf03-4dff-473f-b1d4-94ba0dee7f34","Type":"ContainerStarted","Data":"3f05195ff8b7815bf7190abf9fa093f8f17d0054f60e7e476031c6daf71b8840"}
Jul 29 02:06:04.918957 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:04.918909    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" podStartSLOduration=1.9188946919999998 podStartE2EDuration="1.918894692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:06:04.91732452 +0000 UTC m=+3341.556421350" watchObservedRunningTime="2026-07-29 02:06:04.918894692 +0000 UTC m=+3341.557991498"
Jul 29 02:06:04.955270 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:04.955247    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:05.959942 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:05.959917    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:06.910643 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:06.910609    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:06.911645 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:06.911623    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:22.952443 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:22.952408    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 02:06:22.952865 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:22.952488    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 02:06:25.018913 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:25.018880    2565 generic.go:356] "Generic (PLEG): container finished" podID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerID="e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488" exitCode=0
Jul 29 02:06:25.019377 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:25.018954    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" event={"ID":"7f61bf03-4dff-473f-b1d4-94ba0dee7f34","Type":"ContainerDied","Data":"e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488"}
Jul 29 02:06:25.019451 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:25.019388    2565 scope.go:117] "RemoveContainer" containerID="e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488"
Jul 29 02:06:25.020451 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:25.020424    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:06:25.020509 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:25.020488    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:06:25.020543 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:25.020519    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:06:26.030951 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:26.030899    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" event={"ID":"7f61bf03-4dff-473f-b1d4-94ba0dee7f34","Type":"ContainerStarted","Data":"9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73"}
Jul 29 02:06:26.955370 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:26.955335    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:26.955574 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:26.955551    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 29 02:06:26.955647 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:26.955605    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 29 02:06:27.955566 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:27.955535    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 29 02:06:27.955939 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:27.955599    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 29 02:06:28.955038 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:28.954998    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 29 02:06:28.955230 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:28.955050    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 29 02:06:29.955237 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:29.955198    2565 patch_prober.go:28] interesting pod/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Jul 29 02:06:29.955641 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:29.955268    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Jul 29 02:06:30.958437 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:30.958408    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:30.958804 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:30.958667    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:06:30.959285 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:06:30.959264    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:07:36.755723 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.755623    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"]
Jul 29 02:07:36.758298 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.758275    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.760899 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.760873    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-5be2ca-openshift-default-dockercfg-t4g72\""
Jul 29 02:07:36.772832 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.772809    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"]
Jul 29 02:07:36.797146 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.797121    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-envoy\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.797295 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.797161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-socket\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.797295 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.797219    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw4wz\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-kube-api-access-cw4wz\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.797295 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.797252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-token\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.797448 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.797383    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-credential-socket\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.797448 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.797417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-podinfo\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.797536 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.797488    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.797536 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.797529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-data\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.797629 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.797550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-certs\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898188 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898157    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-data\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898188 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898192    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-certs\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-envoy\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898234    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-socket\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898265    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw4wz\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-kube-api-access-cw4wz\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898294    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-token\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898397    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-credential-socket\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-podinfo\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898784 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898839 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898797    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-socket\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898884 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898830    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-certs\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.898918 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.898897    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-credential-socket\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.899104 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.899076    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-data\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.899248 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.899201    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.900864 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.900842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-envoy\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.901098 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.901080    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-podinfo\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.906048 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.906023    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-token\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:36.906146 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:36.906130    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw4wz\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-kube-api-access-cw4wz\") pod \"e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") " pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:37.068789 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:37.068749    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:37.198809 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:37.198778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"]
Jul 29 02:07:37.201954 ip-10-0-139-204 kubenswrapper[2565]: W0729 02:07:37.201928    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264e4e37_0fbc_41b6_9cf7_ad1400dda01a.slice/crio-c9a74fdc9e6c86ff4a1ff6ca797d81a9a26388d05d3347f0a7bc872e96b646b1 WatchSource:0}: Error finding container c9a74fdc9e6c86ff4a1ff6ca797d81a9a26388d05d3347f0a7bc872e96b646b1: Status 404 returned error can't find the container with id c9a74fdc9e6c86ff4a1ff6ca797d81a9a26388d05d3347f0a7bc872e96b646b1
Jul 29 02:07:37.204075 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:37.204041    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:07:37.204182 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:37.204104    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:07:37.204182 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:37.204136    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:07:37.383168 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:37.383071    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" event={"ID":"264e4e37-0fbc-41b6-9cf7-ad1400dda01a","Type":"ContainerStarted","Data":"8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23"}
Jul 29 02:07:37.383168 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:37.383142    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" event={"ID":"264e4e37-0fbc-41b6-9cf7-ad1400dda01a","Type":"ContainerStarted","Data":"c9a74fdc9e6c86ff4a1ff6ca797d81a9a26388d05d3347f0a7bc872e96b646b1"}
Jul 29 02:07:37.404023 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:37.403976    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" podStartSLOduration=1.403961617 podStartE2EDuration="1.403961617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 02:07:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:07:37.401197317 +0000 UTC m=+3434.040294127" watchObservedRunningTime="2026-07-29 02:07:37.403961617 +0000 UTC m=+3434.043058425"
Jul 29 02:07:38.069592 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:38.069556    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:38.073971 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:38.073950    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:38.388528 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:38.388433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:38.389407 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:38.389386    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:57.495829 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:57.495742    2565 generic.go:356] "Generic (PLEG): container finished" podID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerID="8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23" exitCode=0
Jul 29 02:07:57.495829 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:57.495813    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" event={"ID":"264e4e37-0fbc-41b6-9cf7-ad1400dda01a","Type":"ContainerDied","Data":"8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23"}
Jul 29 02:07:57.496220 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:57.496139    2565 scope.go:117] "RemoveContainer" containerID="8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23"
Jul 29 02:07:57.497132 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:57.497106    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:07:57.497192 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:57.497171    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:07:57.497231 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:57.497210    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 29 02:07:58.502746 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:58.502715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" event={"ID":"264e4e37-0fbc-41b6-9cf7-ad1400dda01a","Type":"ContainerStarted","Data":"9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d"}
Jul 29 02:07:59.069472 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:59.069439    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:07:59.069694 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:59.069672    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 29 02:07:59.069774 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:07:59.069727    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 29 02:08:00.069786 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:00.069750    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 29 02:08:00.070157 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:00.069801    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 29 02:08:01.069196 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:01.069165    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 29 02:08:01.069376 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:01.069218    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 29 02:08:02.069034 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:02.068997    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Jul 29 02:08:02.069555 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:02.069061    2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Jul 29 02:08:03.072623 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:03.072593    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:08:03.072990 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:03.072821    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:08:03.073432 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:03.073413    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:08:16.853943 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:16.853911    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"]
Jul 29 02:08:16.854765 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:16.854121    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy" containerID="cri-o://9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d" gracePeriod=30
Jul 29 02:08:18.074895 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:18.074856    2565 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 02:08:18.075235 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:18.074934    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 02:08:22.109018 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.108993    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:08:22.112079 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112061    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-certs\") pod \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") "
Jul 29 02:08:22.112163 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112094    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-envoy\") pod \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") "
Jul 29 02:08:22.112163 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112109    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-data\") pod \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") "
Jul 29 02:08:22.112163 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112147    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-socket\") pod \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") "
Jul 29 02:08:22.112163 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112162    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istiod-ca-cert\") pod \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") "
Jul 29 02:08:22.112393 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112200    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw4wz\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-kube-api-access-cw4wz\") pod \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") "
Jul 29 02:08:22.112393 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112249    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-podinfo\") pod \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") "
Jul 29 02:08:22.112393 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112356    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "264e4e37-0fbc-41b6-9cf7-ad1400dda01a" (UID: "264e4e37-0fbc-41b6-9cf7-ad1400dda01a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:08:22.112549 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112428    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-credential-socket\") pod \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") "
Jul 29 02:08:22.112549 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112462    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-token\") pod \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\" (UID: \"264e4e37-0fbc-41b6-9cf7-ad1400dda01a\") "
Jul 29 02:08:22.112549 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112475    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "264e4e37-0fbc-41b6-9cf7-ad1400dda01a" (UID: "264e4e37-0fbc-41b6-9cf7-ad1400dda01a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:08:22.112735 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112600    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "264e4e37-0fbc-41b6-9cf7-ad1400dda01a" (UID: "264e4e37-0fbc-41b6-9cf7-ad1400dda01a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:08:22.112735 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.112690    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "264e4e37-0fbc-41b6-9cf7-ad1400dda01a" (UID: "264e4e37-0fbc-41b6-9cf7-ad1400dda01a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:08:22.113053 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.113027    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:08:22.113145 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.113052    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:08:22.113145 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.113059    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-data" (OuterVolumeSpecName: "istio-data") pod "264e4e37-0fbc-41b6-9cf7-ad1400dda01a" (UID: "264e4e37-0fbc-41b6-9cf7-ad1400dda01a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:08:22.113145 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.113068    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:08:22.113145 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.113098    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:08:22.114431 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.114408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "264e4e37-0fbc-41b6-9cf7-ad1400dda01a" (UID: "264e4e37-0fbc-41b6-9cf7-ad1400dda01a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 02:08:22.114717 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.114699    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-token" (OuterVolumeSpecName: "istio-token") pod "264e4e37-0fbc-41b6-9cf7-ad1400dda01a" (UID: "264e4e37-0fbc-41b6-9cf7-ad1400dda01a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:08:22.114891 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.114865    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-kube-api-access-cw4wz" (OuterVolumeSpecName: "kube-api-access-cw4wz") pod "264e4e37-0fbc-41b6-9cf7-ad1400dda01a" (UID: "264e4e37-0fbc-41b6-9cf7-ad1400dda01a"). InnerVolumeSpecName "kube-api-access-cw4wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:08:22.114891 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.114874    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "264e4e37-0fbc-41b6-9cf7-ad1400dda01a" (UID: "264e4e37-0fbc-41b6-9cf7-ad1400dda01a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:08:22.214246 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.214220    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:08:22.214246 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.214242    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:08:22.214246 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.214251    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw4wz\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-kube-api-access-cw4wz\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:08:22.214481 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.214259    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:08:22.214481 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.214267    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/264e4e37-0fbc-41b6-9cf7-ad1400dda01a-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:08:22.625980 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.625951    2565 generic.go:356] "Generic (PLEG): container finished" podID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerID="9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d" exitCode=0
Jul 29 02:08:22.626143 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.626002    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"
Jul 29 02:08:22.626143 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.626006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" event={"ID":"264e4e37-0fbc-41b6-9cf7-ad1400dda01a","Type":"ContainerDied","Data":"9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d"}
Jul 29 02:08:22.626143 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.626115    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr" event={"ID":"264e4e37-0fbc-41b6-9cf7-ad1400dda01a","Type":"ContainerDied","Data":"c9a74fdc9e6c86ff4a1ff6ca797d81a9a26388d05d3347f0a7bc872e96b646b1"}
Jul 29 02:08:22.626143 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.626135    2565 scope.go:117] "RemoveContainer" containerID="9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d"
Jul 29 02:08:22.635520 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.635502    2565 scope.go:117] "RemoveContainer" containerID="8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23"
Jul 29 02:08:22.643534 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.643519    2565 scope.go:117] "RemoveContainer" containerID="9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d"
Jul 29 02:08:22.643785 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:08:22.643767    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d\": container with ID starting with 9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d not found: ID does not exist" containerID="9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d"
Jul 29 02:08:22.643845 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.643793    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d"} err="failed to get container status \"9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d\": rpc error: code = NotFound desc = could not find container \"9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d\": container with ID starting with 9641fa9b0a0587533bb87d957bb0b24ad1bb3482ed5f10bbf587b28f98f7db3d not found: ID does not exist"
Jul 29 02:08:22.643845 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.643809    2565 scope.go:117] "RemoveContainer" containerID="8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23"
Jul 29 02:08:22.644051 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:08:22.644033    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23\": container with ID starting with 8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23 not found: ID does not exist" containerID="8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23"
Jul 29 02:08:22.644111 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.644061    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23"} err="failed to get container status \"8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23\": rpc error: code = NotFound desc = could not find container \"8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23\": container with ID starting with 8f19a3038f3d33785bede2f94f58c36d6a205b1628ffa9b741f6f0ab7a7b1c23 not found: ID does not exist"
Jul 29 02:08:22.650395 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.650377    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"]
Jul 29 02:08:22.657708 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:22.657684    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-5be2ca-openshift-default-bc7768bb4-9ppqr"]
Jul 29 02:08:23.918521 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:08:23.918488    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" path="/var/lib/kubelet/pods/264e4e37-0fbc-41b6-9cf7-ad1400dda01a/volumes"
Jul 29 02:09:40.409924 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:40.409874    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"]
Jul 29 02:09:40.410483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:40.410110    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy" containerID="cri-o://0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939" gracePeriod=30
Jul 29 02:09:45.668250 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.668222    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:09:45.756979 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.756880    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-socket\") pod \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") "
Jul 29 02:09:45.756979 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.756947    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-token\") pod \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") "
Jul 29 02:09:45.757207 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757016    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-credential-socket\") pod \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") "
Jul 29 02:09:45.757207 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757045    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-podinfo\") pod \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") "
Jul 29 02:09:45.757207 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757074    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-data\") pod \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") "
Jul 29 02:09:45.757207 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757094    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lq9qd\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-kube-api-access-lq9qd\") pod \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") "
Jul 29 02:09:45.757434 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757194    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" (UID: "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:45.757434 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757270    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istiod-ca-cert\") pod \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") "
Jul 29 02:09:45.757434 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757368    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-envoy\") pod \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") "
Jul 29 02:09:45.757434 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757393    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-certs\") pod \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\" (UID: \"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19\") "
Jul 29 02:09:45.757660 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757434    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" (UID: "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:45.757720 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757667    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" (UID: "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:09:45.757932 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757860    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" (UID: "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:45.758105 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.757991    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-data" (OuterVolumeSpecName: "istio-data") pod "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" (UID: "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:45.758105 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.758021    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:45.758105 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.758045    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:45.758105 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.758059    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:45.759430 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.759395    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" (UID: "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 02:09:45.759525 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.759477    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-kube-api-access-lq9qd" (OuterVolumeSpecName: "kube-api-access-lq9qd") pod "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" (UID: "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19"). InnerVolumeSpecName "kube-api-access-lq9qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:09:45.759835 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.759815    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-token" (OuterVolumeSpecName: "istio-token") pod "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" (UID: "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:09:45.759892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.759848    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" (UID: "a3d3f9b6-0e98-423e-b7cf-2ff52a593d19"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:45.858595 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.858560    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:45.858595 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.858588    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:45.858809 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.858596    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:45.858809 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.858630    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lq9qd\" (UniqueName: \"kubernetes.io/projected/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-kube-api-access-lq9qd\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:45.858809 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.858642    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:45.858809 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:45.858654    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:46.036917 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.036885    2565 generic.go:356] "Generic (PLEG): container finished" podID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerID="0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939" exitCode=0
Jul 29 02:09:46.037105 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.036949    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"
Jul 29 02:09:46.037105 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.036948    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" event={"ID":"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19","Type":"ContainerDied","Data":"0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939"}
Jul 29 02:09:46.037105 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.037019    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl" event={"ID":"a3d3f9b6-0e98-423e-b7cf-2ff52a593d19","Type":"ContainerDied","Data":"9bccf5334cd3aeab9cef45ff68c0a5fbd2e61f9da7ac909e78b469599c97c814"}
Jul 29 02:09:46.037105 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.037043    2565 scope.go:117] "RemoveContainer" containerID="0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939"
Jul 29 02:09:46.046163 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.046146    2565 scope.go:117] "RemoveContainer" containerID="c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af"
Jul 29 02:09:46.054797 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.054777    2565 scope.go:117] "RemoveContainer" containerID="0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939"
Jul 29 02:09:46.055102 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:09:46.055083    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939\": container with ID starting with 0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939 not found: ID does not exist" containerID="0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939"
Jul 29 02:09:46.055161 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.055112    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939"} err="failed to get container status \"0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939\": rpc error: code = NotFound desc = could not find container \"0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939\": container with ID starting with 0bdd56eba60becb79505af8ec7985d22e3fbf75aa487d726e90b661c6dd54939 not found: ID does not exist"
Jul 29 02:09:46.055161 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.055130    2565 scope.go:117] "RemoveContainer" containerID="c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af"
Jul 29 02:09:46.055411 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:09:46.055388    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af\": container with ID starting with c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af not found: ID does not exist" containerID="c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af"
Jul 29 02:09:46.055457 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.055421    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af"} err="failed to get container status \"c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af\": rpc error: code = NotFound desc = could not find container \"c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af\": container with ID starting with c90669bec117b2b12ce304e344da51b742f8d210cddc7dd73829c9f13e1713af not found: ID does not exist"
Jul 29 02:09:46.056799 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.056778    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"]
Jul 29 02:09:46.062559 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:46.062537    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-74cb2e-openshift-default-8586697bcb-ksxdl"]
Jul 29 02:09:47.916298 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:47.916261    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" path="/var/lib/kubelet/pods/a3d3f9b6-0e98-423e-b7cf-2ff52a593d19/volumes"
Jul 29 02:09:54.078428 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:54.078392    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"]
Jul 29 02:09:54.078898 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:54.078585    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy" containerID="cri-o://9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73" gracePeriod=30
Jul 29 02:09:59.329176 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.329150    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:09:59.400105 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400024    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-certs\") pod \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") "
Jul 29 02:09:59.400255 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400127    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-credential-socket\") pod \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") "
Jul 29 02:09:59.400255 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400167    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwj7n\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-kube-api-access-xwj7n\") pod \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") "
Jul 29 02:09:59.400255 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400222    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-socket\") pod \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") "
Jul 29 02:09:59.400255 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400243    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7f61bf03-4dff-473f-b1d4-94ba0dee7f34" (UID: "7f61bf03-4dff-473f-b1d4-94ba0dee7f34"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:59.400483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400246    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istiod-ca-cert\") pod \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") "
Jul 29 02:09:59.400483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400283    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-podinfo\") pod \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") "
Jul 29 02:09:59.400483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400360    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-envoy\") pod \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") "
Jul 29 02:09:59.400483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400427    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-token\") pod \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") "
Jul 29 02:09:59.400483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400449    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-data\") pod \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\" (UID: \"7f61bf03-4dff-473f-b1d4-94ba0dee7f34\") "
Jul 29 02:09:59.400731 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400482    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7f61bf03-4dff-473f-b1d4-94ba0dee7f34" (UID: "7f61bf03-4dff-473f-b1d4-94ba0dee7f34"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:59.400731 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7f61bf03-4dff-473f-b1d4-94ba0dee7f34" (UID: "7f61bf03-4dff-473f-b1d4-94ba0dee7f34"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:59.400731 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400558    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7f61bf03-4dff-473f-b1d4-94ba0dee7f34" (UID: "7f61bf03-4dff-473f-b1d4-94ba0dee7f34"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:09:59.400897 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400804    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:59.400897 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400822    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:59.400897 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400837    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:59.400897 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.400849    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:59.401612 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.401588    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-data" (OuterVolumeSpecName: "istio-data") pod "7f61bf03-4dff-473f-b1d4-94ba0dee7f34" (UID: "7f61bf03-4dff-473f-b1d4-94ba0dee7f34"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:59.402697 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.402667    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-token" (OuterVolumeSpecName: "istio-token") pod "7f61bf03-4dff-473f-b1d4-94ba0dee7f34" (UID: "7f61bf03-4dff-473f-b1d4-94ba0dee7f34"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:09:59.402847 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.402822    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7f61bf03-4dff-473f-b1d4-94ba0dee7f34" (UID: "7f61bf03-4dff-473f-b1d4-94ba0dee7f34"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 02:09:59.403021 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.403005    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-kube-api-access-xwj7n" (OuterVolumeSpecName: "kube-api-access-xwj7n") pod "7f61bf03-4dff-473f-b1d4-94ba0dee7f34" (UID: "7f61bf03-4dff-473f-b1d4-94ba0dee7f34"). InnerVolumeSpecName "kube-api-access-xwj7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:09:59.403074 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.403057    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7f61bf03-4dff-473f-b1d4-94ba0dee7f34" (UID: "7f61bf03-4dff-473f-b1d4-94ba0dee7f34"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:09:59.502370 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.502336    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xwj7n\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-kube-api-access-xwj7n\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:59.502370 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.502368    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:59.502370 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.502377    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:59.502617 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.502385    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:09:59.502617 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:09:59.502393    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7f61bf03-4dff-473f-b1d4-94ba0dee7f34-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:00.112326 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.112274    2565 generic.go:356] "Generic (PLEG): container finished" podID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerID="9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73" exitCode=0
Jul 29 02:10:00.112500 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.112343    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"
Jul 29 02:10:00.112500 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.112340    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" event={"ID":"7f61bf03-4dff-473f-b1d4-94ba0dee7f34","Type":"ContainerDied","Data":"9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73"}
Jul 29 02:10:00.112500 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.112465    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l" event={"ID":"7f61bf03-4dff-473f-b1d4-94ba0dee7f34","Type":"ContainerDied","Data":"3f05195ff8b7815bf7190abf9fa093f8f17d0054f60e7e476031c6daf71b8840"}
Jul 29 02:10:00.112500 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.112488    2565 scope.go:117] "RemoveContainer" containerID="9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73"
Jul 29 02:10:00.121371 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.121356    2565 scope.go:117] "RemoveContainer" containerID="e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488"
Jul 29 02:10:00.129359 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.129339    2565 scope.go:117] "RemoveContainer" containerID="9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73"
Jul 29 02:10:00.129618 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:10:00.129597    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73\": container with ID starting with 9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73 not found: ID does not exist" containerID="9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73"
Jul 29 02:10:00.129721 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.129628    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73"} err="failed to get container status \"9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73\": rpc error: code = NotFound desc = could not find container \"9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73\": container with ID starting with 9df334437cb3e113da5f521397048fee3f7123ce7a1fd50b914c5e79e513fe73 not found: ID does not exist"
Jul 29 02:10:00.129721 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.129645    2565 scope.go:117] "RemoveContainer" containerID="e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488"
Jul 29 02:10:00.129836 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:10:00.129816    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488\": container with ID starting with e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488 not found: ID does not exist" containerID="e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488"
Jul 29 02:10:00.129878 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.129840    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488"} err="failed to get container status \"e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488\": rpc error: code = NotFound desc = could not find container \"e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488\": container with ID starting with e79387c8723939c3d62eb71b4e77b8c0e6dfabecb9a33eca37050889d43e8488 not found: ID does not exist"
Jul 29 02:10:00.133527 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.133504    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"]
Jul 29 02:10:00.140011 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:00.139990    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-e02970-openshift-default-7db49664f4-c4f7l"]
Jul 29 02:10:01.915976 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:01.915946    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" path="/var/lib/kubelet/pods/7f61bf03-4dff-473f-b1d4-94ba0dee7f34/volumes"
Jul 29 02:10:05.041744 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.041711    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"]
Jul 29 02:10:05.042202 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.041920    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh" podUID="beb8bcfe-8076-4f34-92ba-5156d76676b2" containerName="maas-api" containerID="cri-o://16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307" gracePeriod=30
Jul 29 02:10:05.075711 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.075667    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj"]
Jul 29 02:10:05.080372 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.080342    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-27cc80-29754840-t7cpj"]
Jul 29 02:10:05.298687 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.298620    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 02:10:05.359179 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.359144    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb8bcfe-8076-4f34-92ba-5156d76676b2-openshift-service-ca\") pod \"beb8bcfe-8076-4f34-92ba-5156d76676b2\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") "
Jul 29 02:10:05.359393 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.359210    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tbzm\" (UniqueName: \"kubernetes.io/projected/beb8bcfe-8076-4f34-92ba-5156d76676b2-kube-api-access-2tbzm\") pod \"beb8bcfe-8076-4f34-92ba-5156d76676b2\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") "
Jul 29 02:10:05.359393 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.359285    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beb8bcfe-8076-4f34-92ba-5156d76676b2-maas-api-tls\") pod \"beb8bcfe-8076-4f34-92ba-5156d76676b2\" (UID: \"beb8bcfe-8076-4f34-92ba-5156d76676b2\") "
Jul 29 02:10:05.359545 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.359521    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/beb8bcfe-8076-4f34-92ba-5156d76676b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "beb8bcfe-8076-4f34-92ba-5156d76676b2" (UID: "beb8bcfe-8076-4f34-92ba-5156d76676b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:10:05.361494 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.361467    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beb8bcfe-8076-4f34-92ba-5156d76676b2-kube-api-access-2tbzm" (OuterVolumeSpecName: "kube-api-access-2tbzm") pod "beb8bcfe-8076-4f34-92ba-5156d76676b2" (UID: "beb8bcfe-8076-4f34-92ba-5156d76676b2"). InnerVolumeSpecName "kube-api-access-2tbzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:10:05.361584 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.361492    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/beb8bcfe-8076-4f34-92ba-5156d76676b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "beb8bcfe-8076-4f34-92ba-5156d76676b2" (UID: "beb8bcfe-8076-4f34-92ba-5156d76676b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:10:05.460994 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.460955    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/beb8bcfe-8076-4f34-92ba-5156d76676b2-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:05.460994 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.460985    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tbzm\" (UniqueName: \"kubernetes.io/projected/beb8bcfe-8076-4f34-92ba-5156d76676b2-kube-api-access-2tbzm\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:05.460994 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.460996    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/beb8bcfe-8076-4f34-92ba-5156d76676b2-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:05.916510 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:05.916476    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b78791f-b21d-4e9a-b436-456bec227336" path="/var/lib/kubelet/pods/8b78791f-b21d-4e9a-b436-456bec227336/volumes"
Jul 29 02:10:06.144383 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:06.144346    2565 generic.go:356] "Generic (PLEG): container finished" podID="beb8bcfe-8076-4f34-92ba-5156d76676b2" containerID="16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307" exitCode=0
Jul 29 02:10:06.144882 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:06.144422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh" event={"ID":"beb8bcfe-8076-4f34-92ba-5156d76676b2","Type":"ContainerDied","Data":"16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307"}
Jul 29 02:10:06.144882 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:06.144440    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"
Jul 29 02:10:06.144882 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:06.144480    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh" event={"ID":"beb8bcfe-8076-4f34-92ba-5156d76676b2","Type":"ContainerDied","Data":"520b252cf23717bb8b31da54f40d712e24b1cb7f1a8240d508caad2dabbdea5c"}
Jul 29 02:10:06.144882 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:06.144511    2565 scope.go:117] "RemoveContainer" containerID="16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307"
Jul 29 02:10:06.153231 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:06.153213    2565 scope.go:117] "RemoveContainer" containerID="16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307"
Jul 29 02:10:06.153516 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:10:06.153498    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307\": container with ID starting with 16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307 not found: ID does not exist" containerID="16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307"
Jul 29 02:10:06.153591 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:06.153525    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307"} err="failed to get container status \"16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307\": rpc error: code = NotFound desc = could not find container \"16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307\": container with ID starting with 16184e9d7c3edf095ce9f8250b9bdef41514d58ef89e1629fe66ca2e2fbb9307 not found: ID does not exist"
Jul 29 02:10:06.163715 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:06.163690    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"]
Jul 29 02:10:06.167524 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:06.167472    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-27cc80-7475cb64b-v49nh"]
Jul 29 02:10:07.915890 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:07.915848    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beb8bcfe-8076-4f34-92ba-5156d76676b2" path="/var/lib/kubelet/pods/beb8bcfe-8076-4f34-92ba-5156d76676b2/volumes"
Jul 29 02:10:12.566347 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566285    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"]
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566654    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566665    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566672    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566678    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566692    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb8bcfe-8076-4f34-92ba-5156d76676b2" containerName="maas-api"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566697    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb8bcfe-8076-4f34-92ba-5156d76676b2" containerName="maas-api"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566707    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566712    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566722    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566727    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566733    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566739    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566792    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566798    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566804    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f61bf03-4dff-473f-b1d4-94ba0dee7f34" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566810    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy"
Jul 29 02:10:12.566808 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566814    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="264e4e37-0fbc-41b6-9cf7-ad1400dda01a" containerName="istio-proxy"
Jul 29 02:10:12.567295 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566820    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy"
Jul 29 02:10:12.567295 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.566826    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb8bcfe-8076-4f34-92ba-5156d76676b2" containerName="maas-api"
Jul 29 02:10:12.569045 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.569022    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"
Jul 29 02:10:12.571447 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.571422    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b5c94\""
Jul 29 02:10:12.580831 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.580806    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"]
Jul 29 02:10:12.728774 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.728741    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2605a8-cc49-4d3b-a750-fd49d52ca534-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9\" (UID: \"3d2605a8-cc49-4d3b-a750-fd49d52ca534\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"
Jul 29 02:10:12.829802 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.829706    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2605a8-cc49-4d3b-a750-fd49d52ca534-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9\" (UID: \"3d2605a8-cc49-4d3b-a750-fd49d52ca534\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"
Jul 29 02:10:12.830379 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.830357    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2605a8-cc49-4d3b-a750-fd49d52ca534-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9\" (UID: \"3d2605a8-cc49-4d3b-a750-fd49d52ca534\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"
Jul 29 02:10:12.878877 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:12.878839    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"
Jul 29 02:10:13.028793 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:13.028755    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"]
Jul 29 02:10:13.032362 ip-10-0-139-204 kubenswrapper[2565]: W0729 02:10:13.032290    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2605a8_cc49_4d3b_a750_fd49d52ca534.slice/crio-32fe6821b122ecbc07aa7f9f0c87e2257187404cae9c9e25625650970dd70c59 WatchSource:0}: Error finding container 32fe6821b122ecbc07aa7f9f0c87e2257187404cae9c9e25625650970dd70c59: Status 404 returned error can't find the container with id 32fe6821b122ecbc07aa7f9f0c87e2257187404cae9c9e25625650970dd70c59
Jul 29 02:10:13.182415 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:13.182294    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9" event={"ID":"3d2605a8-cc49-4d3b-a750-fd49d52ca534","Type":"ContainerStarted","Data":"32fe6821b122ecbc07aa7f9f0c87e2257187404cae9c9e25625650970dd70c59"}
Jul 29 02:10:14.189135 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:14.189039    2565 generic.go:356] "Generic (PLEG): container finished" podID="3d2605a8-cc49-4d3b-a750-fd49d52ca534" containerID="5e1db63e34fc397cba2e718739d7d0e450533d85d5eb8d855d50321dea3221d7" exitCode=0
Jul 29 02:10:14.189135 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:14.189116    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9" event={"ID":"3d2605a8-cc49-4d3b-a750-fd49d52ca534","Type":"ContainerDied","Data":"5e1db63e34fc397cba2e718739d7d0e450533d85d5eb8d855d50321dea3221d7"}
Jul 29 02:10:15.324138 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:15.324118    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"
Jul 29 02:10:15.456287 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:15.456205    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2605a8-cc49-4d3b-a750-fd49d52ca534-maas-api-service-ca\") pod \"3d2605a8-cc49-4d3b-a750-fd49d52ca534\" (UID: \"3d2605a8-cc49-4d3b-a750-fd49d52ca534\") "
Jul 29 02:10:15.456583 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:15.456561    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d2605a8-cc49-4d3b-a750-fd49d52ca534-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3d2605a8-cc49-4d3b-a750-fd49d52ca534" (UID: "3d2605a8-cc49-4d3b-a750-fd49d52ca534"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:10:15.557542 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:15.557521    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d2605a8-cc49-4d3b-a750-fd49d52ca534-maas-api-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:16.200922 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:16.200837    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"
Jul 29 02:10:16.200922 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:16.200865    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9" event={"ID":"3d2605a8-cc49-4d3b-a750-fd49d52ca534","Type":"ContainerDied","Data":"32fe6821b122ecbc07aa7f9f0c87e2257187404cae9c9e25625650970dd70c59"}
Jul 29 02:10:16.200922 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:16.200910    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32fe6821b122ecbc07aa7f9f0c87e2257187404cae9c9e25625650970dd70c59"
Jul 29 02:10:18.059550 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.059522    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"]
Jul 29 02:10:18.060006 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.059759    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr" podUID="eb00de64-8042-4b8e-95e5-f7e4c3a42f3d" containerName="maas-api" containerID="cri-o://0516d00203191d6107ece5990887ba28632c4b3be3c3d1de621d9dd177260769" gracePeriod=30
Jul 29 02:10:18.096474 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.096449    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9"]
Jul 29 02:10:18.098945 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.098918    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a7bf0d-29754840-52qd9"]
Jul 29 02:10:18.212578 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.212546    2565 generic.go:356] "Generic (PLEG): container finished" podID="eb00de64-8042-4b8e-95e5-f7e4c3a42f3d" containerID="0516d00203191d6107ece5990887ba28632c4b3be3c3d1de621d9dd177260769" exitCode=0
Jul 29 02:10:18.212739 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.212590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr" event={"ID":"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d","Type":"ContainerDied","Data":"0516d00203191d6107ece5990887ba28632c4b3be3c3d1de621d9dd177260769"}
Jul 29 02:10:18.315053 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.314978    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"]
Jul 29 02:10:18.322765 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.322737    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a7bf0d-qwjq9"]
Jul 29 02:10:18.327417 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.327384    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 02:10:18.483135 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.483106    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzv2z\" (UniqueName: \"kubernetes.io/projected/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-kube-api-access-hzv2z\") pod \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") "
Jul 29 02:10:18.483300 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.483214    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-openshift-service-ca\") pod \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") "
Jul 29 02:10:18.483300 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.483257    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-maas-api-tls\") pod \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\" (UID: \"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d\") "
Jul 29 02:10:18.483563 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.483539    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eb00de64-8042-4b8e-95e5-f7e4c3a42f3d" (UID: "eb00de64-8042-4b8e-95e5-f7e4c3a42f3d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:10:18.483634 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.483622    2565 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-openshift-service-ca\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:18.485239 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.485214    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eb00de64-8042-4b8e-95e5-f7e4c3a42f3d" (UID: "eb00de64-8042-4b8e-95e5-f7e4c3a42f3d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 02:10:18.485339 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.485274    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-kube-api-access-hzv2z" (OuterVolumeSpecName: "kube-api-access-hzv2z") pod "eb00de64-8042-4b8e-95e5-f7e4c3a42f3d" (UID: "eb00de64-8042-4b8e-95e5-f7e4c3a42f3d"). InnerVolumeSpecName "kube-api-access-hzv2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:10:18.584996 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.584948    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-maas-api-tls\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:18.584996 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:18.584968    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzv2z\" (UniqueName: \"kubernetes.io/projected/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d-kube-api-access-hzv2z\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:19.218583 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:19.218548    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr" event={"ID":"eb00de64-8042-4b8e-95e5-f7e4c3a42f3d","Type":"ContainerDied","Data":"afe703e6255d426dcf49b949b6de598c4ca89397ba4e58e74d89c0d1c7c340c6"}
Jul 29 02:10:19.219056 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:19.218629    2565 scope.go:117] "RemoveContainer" containerID="0516d00203191d6107ece5990887ba28632c4b3be3c3d1de621d9dd177260769"
Jul 29 02:10:19.219056 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:19.218564    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"
Jul 29 02:10:19.241348 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:19.241324    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"]
Jul 29 02:10:19.250195 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:19.250171    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-a7bf0d-b4ddcb75b-xjqrr"]
Jul 29 02:10:19.916258 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:19.916223    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d2605a8-cc49-4d3b-a750-fd49d52ca534" path="/var/lib/kubelet/pods/3d2605a8-cc49-4d3b-a750-fd49d52ca534/volumes"
Jul 29 02:10:19.916547 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:19.916533    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b522421-a6bb-499f-b996-f674939a35bf" path="/var/lib/kubelet/pods/7b522421-a6bb-499f-b996-f674939a35bf/volumes"
Jul 29 02:10:19.916838 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:19.916826    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb00de64-8042-4b8e-95e5-f7e4c3a42f3d" path="/var/lib/kubelet/pods/eb00de64-8042-4b8e-95e5-f7e4c3a42f3d/volumes"
Jul 29 02:10:24.237293 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:24.237263    2565 scope.go:117] "RemoveContainer" containerID="6e571db09542c0e0ea7ab78202151f3f4f5b0ac29623a360252d62d8ac1e293a"
Jul 29 02:10:24.246242 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:24.246223    2565 scope.go:117] "RemoveContainer" containerID="87df44c80f3e55314260e38353a16e046451445fdd95afbda5c5a46932fa6b3e"
Jul 29 02:10:24.246364 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:10:24.246345    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e571db09542c0e0ea7ab78202151f3f4f5b0ac29623a360252d62d8ac1e293a\": container with ID starting with 6e571db09542c0e0ea7ab78202151f3f4f5b0ac29623a360252d62d8ac1e293a not found: ID does not exist" containerID="6e571db09542c0e0ea7ab78202151f3f4f5b0ac29623a360252d62d8ac1e293a"
Jul 29 02:10:24.246431 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:24.246383    2565 image_gc_manager.go:222] "Failed to monitor images" err="get container status: runtime container status: rpc error: code = NotFound desc = could not find container \"6e571db09542c0e0ea7ab78202151f3f4f5b0ac29623a360252d62d8ac1e293a\": container with ID starting with 6e571db09542c0e0ea7ab78202151f3f4f5b0ac29623a360252d62d8ac1e293a not found: ID does not exist"
Jul 29 02:10:24.270755 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:24.270738    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 02:10:24.278320 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:24.278286    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-thlhl_11070fc4-a765-4b3c-9491-06a78e7def55/ovn-acl-logging/0.log"
Jul 29 02:10:25.526771 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:25.526740    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"]
Jul 29 02:10:25.527183 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:25.526966    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy" containerID="cri-o://6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c" gracePeriod=30
Jul 29 02:10:30.773029 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.773005    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 02:10:30.778093 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778068    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-envoy\") pod \"16c45497-a292-4cda-b6f1-b639183e0d54\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") "
Jul 29 02:10:30.778175 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778119    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-credential-socket\") pod \"16c45497-a292-4cda-b6f1-b639183e0d54\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") "
Jul 29 02:10:30.778175 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778150    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c45497-a292-4cda-b6f1-b639183e0d54-istiod-ca-cert\") pod \"16c45497-a292-4cda-b6f1-b639183e0d54\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") "
Jul 29 02:10:30.778241 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778190    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-istio-token\") pod \"16c45497-a292-4cda-b6f1-b639183e0d54\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") "
Jul 29 02:10:30.778241 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778228    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dkfn\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-kube-api-access-2dkfn\") pod \"16c45497-a292-4cda-b6f1-b639183e0d54\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") "
Jul 29 02:10:30.778347 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778261    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c45497-a292-4cda-b6f1-b639183e0d54-istio-podinfo\") pod \"16c45497-a292-4cda-b6f1-b639183e0d54\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") "
Jul 29 02:10:30.778347 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778291    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-certs\") pod \"16c45497-a292-4cda-b6f1-b639183e0d54\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") "
Jul 29 02:10:30.778456 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778346    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-data\") pod \"16c45497-a292-4cda-b6f1-b639183e0d54\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") "
Jul 29 02:10:30.778456 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778369    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-socket\") pod \"16c45497-a292-4cda-b6f1-b639183e0d54\" (UID: \"16c45497-a292-4cda-b6f1-b639183e0d54\") "
Jul 29 02:10:30.778655 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778603    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16c45497-a292-4cda-b6f1-b639183e0d54-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "16c45497-a292-4cda-b6f1-b639183e0d54" (UID: "16c45497-a292-4cda-b6f1-b639183e0d54"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 02:10:30.778655 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778651    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "16c45497-a292-4cda-b6f1-b639183e0d54" (UID: "16c45497-a292-4cda-b6f1-b639183e0d54"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:10:30.778881 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778812    2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/16c45497-a292-4cda-b6f1-b639183e0d54-istiod-ca-cert\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:30.778881 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778831    2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-certs\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:30.778881 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778829    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "16c45497-a292-4cda-b6f1-b639183e0d54" (UID: "16c45497-a292-4cda-b6f1-b639183e0d54"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:10:30.779036 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.778966    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "16c45497-a292-4cda-b6f1-b639183e0d54" (UID: "16c45497-a292-4cda-b6f1-b639183e0d54"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:10:30.779377 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.779353    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-data" (OuterVolumeSpecName: "istio-data") pod "16c45497-a292-4cda-b6f1-b639183e0d54" (UID: "16c45497-a292-4cda-b6f1-b639183e0d54"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:10:30.780338 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.780296    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "16c45497-a292-4cda-b6f1-b639183e0d54" (UID: "16c45497-a292-4cda-b6f1-b639183e0d54"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 02:10:30.780439 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.780396    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-istio-token" (OuterVolumeSpecName: "istio-token") pod "16c45497-a292-4cda-b6f1-b639183e0d54" (UID: "16c45497-a292-4cda-b6f1-b639183e0d54"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:10:30.780992 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.780964    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/16c45497-a292-4cda-b6f1-b639183e0d54-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "16c45497-a292-4cda-b6f1-b639183e0d54" (UID: "16c45497-a292-4cda-b6f1-b639183e0d54"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 02:10:30.781074 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.780982    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-kube-api-access-2dkfn" (OuterVolumeSpecName: "kube-api-access-2dkfn") pod "16c45497-a292-4cda-b6f1-b639183e0d54" (UID: "16c45497-a292-4cda-b6f1-b639183e0d54"). InnerVolumeSpecName "kube-api-access-2dkfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 02:10:30.879964 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.879899    2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-envoy\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:30.879964 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.879925    2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-credential-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:30.879964 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.879935    2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-istio-token\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:30.879964 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.879943    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dkfn\" (UniqueName: \"kubernetes.io/projected/16c45497-a292-4cda-b6f1-b639183e0d54-kube-api-access-2dkfn\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:30.879964 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.879953    2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/16c45497-a292-4cda-b6f1-b639183e0d54-istio-podinfo\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:30.879964 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.879960    2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-istio-data\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:30.879964 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:30.879968    2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/16c45497-a292-4cda-b6f1-b639183e0d54-workload-socket\") on node \"ip-10-0-139-204.ec2.internal\" DevicePath \"\""
Jul 29 02:10:31.280269 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.280232    2565 generic.go:356] "Generic (PLEG): container finished" podID="16c45497-a292-4cda-b6f1-b639183e0d54" containerID="6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c" exitCode=0
Jul 29 02:10:31.280487 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.280301    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"
Jul 29 02:10:31.280487 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.280301    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" event={"ID":"16c45497-a292-4cda-b6f1-b639183e0d54","Type":"ContainerDied","Data":"6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c"}
Jul 29 02:10:31.280487 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.280439    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m" event={"ID":"16c45497-a292-4cda-b6f1-b639183e0d54","Type":"ContainerDied","Data":"b2ad2d5207574547b79dad8c526f2a939dbdb6a36c1bd629bdfdd762dd6d1953"}
Jul 29 02:10:31.280487 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.280461    2565 scope.go:117] "RemoveContainer" containerID="6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c"
Jul 29 02:10:31.289590 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.289562    2565 scope.go:117] "RemoveContainer" containerID="62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1"
Jul 29 02:10:31.297471 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.297454    2565 scope.go:117] "RemoveContainer" containerID="6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c"
Jul 29 02:10:31.297707 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:10:31.297688    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c\": container with ID starting with 6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c not found: ID does not exist" containerID="6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c"
Jul 29 02:10:31.297779 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.297719    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c"} err="failed to get container status \"6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c\": rpc error: code = NotFound desc = could not find container \"6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c\": container with ID starting with 6c7e9c948511d1a518b1c2699d4c383abc5b472509ceaf1b1c4c0c49595a5b3c not found: ID does not exist"
Jul 29 02:10:31.297779 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.297742    2565 scope.go:117] "RemoveContainer" containerID="62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1"
Jul 29 02:10:31.297969 ip-10-0-139-204 kubenswrapper[2565]: E0729 02:10:31.297947    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1\": container with ID starting with 62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1 not found: ID does not exist" containerID="62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1"
Jul 29 02:10:31.298008 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.297976    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1"} err="failed to get container status \"62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1\": rpc error: code = NotFound desc = could not find container \"62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1\": container with ID starting with 62857952b66f907c1deef7960fdf99e397caab2b3913b14849cf53e686a66ac1 not found: ID does not exist"
Jul 29 02:10:31.308337 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.305233    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"]
Jul 29 02:10:31.311792 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.311769    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-a7bf0d-openshift-default-55789ff888-kx85m"]
Jul 29 02:10:31.916275 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.916238    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" path="/var/lib/kubelet/pods/16c45497-a292-4cda-b6f1-b639183e0d54/volumes"
Jul 29 02:10:31.977292 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:31.977263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fb7fdd9-2dz9l_a471de76-f010-43de-bab0-8158c6f513fc/manager/0.log"
Jul 29 02:10:32.331595 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:32.331569    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d7cdd4c-cl4ps_34c5d87e-b059-4563-86e7-3909a5205c58/copy-manifests/0.log"
Jul 29 02:10:32.339080 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:32.339057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d7cdd4c-cl4ps_34c5d87e-b059-4563-86e7-3909a5205c58/manager/0.log"
Jul 29 02:10:33.193584 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:33.193550    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754825-4m74m_ecbdd87a-c73f-42b8-a995-2edf73f09f26/cleanup/0.log"
Jul 29 02:10:33.336404 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:33.336383    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754840-9jkjr_b6a6dec8-7b10-447b-9e4f-dbc60d9e6d9a/cleanup/0.log"
Jul 29 02:10:36.010593 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:36.010559    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h_6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b/istio-proxy/0.log"
Jul 29 02:10:36.135146 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:36.135120    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qgkj2_5cf415d9-2db2-4858-a2ad-04133e2822a0/discovery/0.log"
Jul 29 02:10:36.481136 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:36.481102    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-dtd8w_e1924cc2-8894-4a5b-b66e-3389b980963f/istio-proxy/1.log"
Jul 29 02:10:37.301327 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:37.301279    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-jjql8_b2f89f1f-53c2-4c7e-8475-194e789ce129/main/0.log"
Jul 29 02:10:37.530159 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:37.530129    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fkv25v_cf33614f-e014-473d-9e6b-b98b76e31b63/main/0.log"
Jul 29 02:10:46.074996 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:46.074961    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2k7wg_438c0d21-3d37-4f76-b8b8-a80944438de8/global-pull-secret-syncer/0.log"
Jul 29 02:10:46.330277 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:46.330180    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p9484_893f315a-1489-4167-b2f0-e41ac01d4301/konnectivity-agent/0.log"
Jul 29 02:10:46.416255 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:46.416226    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-204.ec2.internal_15a642e5dbdb7944579e1ac85ffb4c8a/haproxy/0.log"
Jul 29 02:10:53.941247 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:53.941211    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-dhgmg_368387bd-4f4b-4ec0-9d6b-8500c5c8e353/cluster-monitoring-operator/0.log"
Jul 29 02:10:54.012062 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.012038    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pt7db_cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5/kube-state-metrics/0.log"
Jul 29 02:10:54.054076 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.054054    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pt7db_cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5/kube-rbac-proxy-main/0.log"
Jul 29 02:10:54.112950 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.112933    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-pt7db_cd23a66e-e5b1-4146-8a37-d82f6bf9ebc5/kube-rbac-proxy-self/0.log"
Jul 29 02:10:54.193887 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.193815    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-x42kl_c80277b8-582e-46e5-9e10-2cfe9c5af9f6/monitoring-plugin/0.log"
Jul 29 02:10:54.398041 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.398009    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqffm_1568b0ae-58b5-452f-8a8e-a1e6b8154237/node-exporter/0.log"
Jul 29 02:10:54.423431 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.423409    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqffm_1568b0ae-58b5-452f-8a8e-a1e6b8154237/kube-rbac-proxy/0.log"
Jul 29 02:10:54.459284 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.459232    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqffm_1568b0ae-58b5-452f-8a8e-a1e6b8154237/init-textfile/0.log"
Jul 29 02:10:54.591685 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.591661    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f221889-79d3-496c-845c-310df60244a0/prometheus/0.log"
Jul 29 02:10:54.623605 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.623580    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f221889-79d3-496c-845c-310df60244a0/config-reloader/0.log"
Jul 29 02:10:54.650908 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.650884    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f221889-79d3-496c-845c-310df60244a0/thanos-sidecar/0.log"
Jul 29 02:10:54.676542 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.676524    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f221889-79d3-496c-845c-310df60244a0/kube-rbac-proxy-web/0.log"
Jul 29 02:10:54.710183 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.710102    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f221889-79d3-496c-845c-310df60244a0/kube-rbac-proxy/0.log"
Jul 29 02:10:54.741481 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.741457    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f221889-79d3-496c-845c-310df60244a0/kube-rbac-proxy-thanos/0.log"
Jul 29 02:10:54.773958 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.773932    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6f221889-79d3-496c-845c-310df60244a0/init-config-reloader/0.log"
Jul 29 02:10:54.863779 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:54.863750    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-76lds_67c483ef-ddd3-4ae7-b056-e00756212219/prometheus-operator-admission-webhook/0.log"
Jul 29 02:10:55.513363 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513330    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"]
Jul 29 02:10:55.513736 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513696    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy"
Jul 29 02:10:55.513736 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513707    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3d3f9b6-0e98-423e-b7cf-2ff52a593d19" containerName="istio-proxy"
Jul 29 02:10:55.513736 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513723    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb00de64-8042-4b8e-95e5-f7e4c3a42f3d" containerName="maas-api"
Jul 29 02:10:55.513736 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513732    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb00de64-8042-4b8e-95e5-f7e4c3a42f3d" containerName="maas-api"
Jul 29 02:10:55.513736 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513738    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d2605a8-cc49-4d3b-a750-fd49d52ca534" containerName="revoke-keys"
Jul 29 02:10:55.513892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513744    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d2605a8-cc49-4d3b-a750-fd49d52ca534" containerName="revoke-keys"
Jul 29 02:10:55.513892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513756    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy"
Jul 29 02:10:55.513892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513761    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy"
Jul 29 02:10:55.513892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513769    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy"
Jul 29 02:10:55.513892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513773    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy"
Jul 29 02:10:55.513892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513823    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy"
Jul 29 02:10:55.513892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513831    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d2605a8-cc49-4d3b-a750-fd49d52ca534" containerName="revoke-keys"
Jul 29 02:10:55.513892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513836    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="16c45497-a292-4cda-b6f1-b639183e0d54" containerName="istio-proxy"
Jul 29 02:10:55.513892 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.513841    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb00de64-8042-4b8e-95e5-f7e4c3a42f3d" containerName="maas-api"
Jul 29 02:10:55.516215 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.516198    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.518426 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.518407    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hd2h\"/\"kube-root-ca.crt\""
Jul 29 02:10:55.519176 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.519159    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-2hd2h\"/\"default-dockercfg-8smzm\""
Jul 29 02:10:55.519250 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.519163    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-2hd2h\"/\"openshift-service-ca.crt\""
Jul 29 02:10:55.533234 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.533209    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"]
Jul 29 02:10:55.570687 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.570661    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smx6\" (UniqueName: \"kubernetes.io/projected/8b7b495f-20c2-480c-b3f8-6282cbe21036-kube-api-access-7smx6\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.570806 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.570704    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-podres\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.570806 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.570730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-proc\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.570806 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.570796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-sys\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.570913 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.570832    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-lib-modules\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.671945 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.671911    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-proc\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.672126 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.671960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-sys\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.672126 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.671992    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-lib-modules\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.672126 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.672040    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-proc\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.672126 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.672069    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smx6\" (UniqueName: \"kubernetes.io/projected/8b7b495f-20c2-480c-b3f8-6282cbe21036-kube-api-access-7smx6\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.672126 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.672098    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-sys\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.672126 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.672119    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-podres\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.672415 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.672139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-lib-modules\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.672415 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.672251    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8b7b495f-20c2-480c-b3f8-6282cbe21036-podres\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.682158 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.682139    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smx6\" (UniqueName: \"kubernetes.io/projected/8b7b495f-20c2-480c-b3f8-6282cbe21036-kube-api-access-7smx6\") pod \"perf-node-gather-daemonset-dcg45\" (UID: \"8b7b495f-20c2-480c-b3f8-6282cbe21036\") " pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.825718 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.825636    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:55.965982 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:55.965913    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"]
Jul 29 02:10:55.968338 ip-10-0-139-204 kubenswrapper[2565]: W0729 02:10:55.968292    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8b7b495f_20c2_480c_b3f8_6282cbe21036.slice/crio-1f49451095ed4ce1dd7bc05b87ee9f84eee215cef09f50df72581533027dfe0c WatchSource:0}: Error finding container 1f49451095ed4ce1dd7bc05b87ee9f84eee215cef09f50df72581533027dfe0c: Status 404 returned error can't find the container with id 1f49451095ed4ce1dd7bc05b87ee9f84eee215cef09f50df72581533027dfe0c
Jul 29 02:10:56.398884 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:56.398802    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45" event={"ID":"8b7b495f-20c2-480c-b3f8-6282cbe21036","Type":"ContainerStarted","Data":"4093a920d431512907d395e9c2298252b689429a72cea34216f3e649af42770e"}
Jul 29 02:10:56.398884 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:56.398854    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45" event={"ID":"8b7b495f-20c2-480c-b3f8-6282cbe21036","Type":"ContainerStarted","Data":"1f49451095ed4ce1dd7bc05b87ee9f84eee215cef09f50df72581533027dfe0c"}
Jul 29 02:10:56.398884 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:56.398878    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:10:56.419673 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:56.419615    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45" podStartSLOduration=1.419596735 podStartE2EDuration="1.419596735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 02:10:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 02:10:56.418819122 +0000 UTC m=+3633.057915931" watchObservedRunningTime="2026-07-29 02:10:56.419596735 +0000 UTC m=+3633.058693555"
Jul 29 02:10:56.973234 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:56.973198    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/2.log"
Jul 29 02:10:56.979918 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:56.979894    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-h567k_6a88e7bc-78c9-45de-8b6c-6462af16a7c9/console-operator/3.log"
Jul 29 02:10:59.335829 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:59.335799    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w6266_515d5fad-7061-41fd-b0b9-c04e9a68205a/dns/0.log"
Jul 29 02:10:59.360860 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:59.360838    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w6266_515d5fad-7061-41fd-b0b9-c04e9a68205a/kube-rbac-proxy/0.log"
Jul 29 02:10:59.389837 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:10:59.389820    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lfbss_0e8f9521-62b0-466a-bce8-29da863f6032/dns-node-resolver/0.log"
Jul 29 02:11:00.015843 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:00.015815    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-798f887b5c-x5p7q_0d71b7b9-fbd1-4414-bdd6-0b42e4d16d8d/registry/0.log"
Jul 29 02:11:00.100770 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:00.100738    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-s8bh7_48eb1cb9-59b2-4872-af62-482f69ebdb68/node-ca/0.log"
Jul 29 02:11:01.054504 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:01.054473    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h_6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b/istio-proxy/0.log"
Jul 29 02:11:01.322487 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:01.322403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qgkj2_5cf415d9-2db2-4858-a2ad-04133e2822a0/discovery/0.log"
Jul 29 02:11:01.420558 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:01.420530    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-dtd8w_e1924cc2-8894-4a5b-b66e-3389b980963f/istio-proxy/0.log"
Jul 29 02:11:01.468831 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:01.468792    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-dtd8w_e1924cc2-8894-4a5b-b66e-3389b980963f/istio-proxy/1.log"
Jul 29 02:11:02.414363 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:02.414339    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-2hd2h/perf-node-gather-daemonset-dcg45"
Jul 29 02:11:02.502301 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:02.502272    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sbsln_07cd5f44-2d82-43e8-9672-6f9c02e885fa/serve-healthcheck-canary/0.log"
Jul 29 02:11:03.157358 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:03.157330    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5579b_e0b4baf1-4be3-47ec-b35d-d8b2906fea97/kube-rbac-proxy/0.log"
Jul 29 02:11:03.180587 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:03.180555    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5579b_e0b4baf1-4be3-47ec-b35d-d8b2906fea97/exporter/0.log"
Jul 29 02:11:03.209098 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:03.209065    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5579b_e0b4baf1-4be3-47ec-b35d-d8b2906fea97/extractor/0.log"
Jul 29 02:11:06.292654 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:06.292622    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h_6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b/istio-proxy/0.log"
Jul 29 02:11:06.506350 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:06.506297    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-76fb7fdd9-2dz9l_a471de76-f010-43de-bab0-8158c6f513fc/manager/0.log"
Jul 29 02:11:06.583616 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:06.583550    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qgkj2_5cf415d9-2db2-4858-a2ad-04133e2822a0/discovery/0.log"
Jul 29 02:11:06.659637 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:06.659610    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-dtd8w_e1924cc2-8894-4a5b-b66e-3389b980963f/istio-proxy/0.log"
Jul 29 02:11:06.708206 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:06.708184    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-dtd8w_e1924cc2-8894-4a5b-b66e-3389b980963f/istio-proxy/1.log"
Jul 29 02:11:06.788260 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:06.788237    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d7cdd4c-cl4ps_34c5d87e-b059-4563-86e7-3909a5205c58/manager/0.log"
Jul 29 02:11:06.817932 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:06.817909    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d7cdd4c-cl4ps_34c5d87e-b059-4563-86e7-3909a5205c58/copy-manifests/0.log"
Jul 29 02:11:08.151206 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:08.151178    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-zgd5h_6a28a9fa-8b90-4a6d-a9ae-52b6870bdf8b/istio-proxy/0.log"
Jul 29 02:11:08.274561 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:08.274531    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c7f9c9bb4-2gkhc_64b5fa3a-136a-4f6f-8488-3f2262864c62/manager/0.log"
Jul 29 02:11:08.341574 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:08.341526    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jnmwm_6aad3f7b-9862-43d0-a64b-b88a9c78b151/openshift-lws-operator/0.log"
Jul 29 02:11:08.417498 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:08.417429    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-qgkj2_5cf415d9-2db2-4858-a2ad-04133e2822a0/discovery/0.log"
Jul 29 02:11:08.473483 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:08.473454    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-dtd8w_e1924cc2-8894-4a5b-b66e-3389b980963f/istio-proxy/0.log"
Jul 29 02:11:08.525298 ip-10-0-139-204 kubenswrapper[2565]: I0729 02:11:08.525276    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-dtd8w_e1924cc2-8894-4a5b-b66e-3389b980963f/istio-proxy/1.log"